AMD Instinct MI325X
The Instinct MI325X is the memory-upgraded refresh of the MI300X: the same CDNA 3 compute (304 compute units) with 256 GB of HBM3E at 6 TB/s and a 1,000 W peak board power, launched 10 October 2024. It stays on the OAM form factor with Infinity Fabric, passively cooled, so it slots into MI300-generation platforms where the board supports the higher power. GPU Smith specs it where memory capacity per GPU is the constraint but a move to the MI350 generation (and its ROCm/datatype changes) is not yet justified.
- Compute is identical to the MI300X on paper; the gain is 256 GB at 6 TB/s (33 percent more capacity, 13 percent more bandwidth by arithmetic from AMD's figures). Decode-bound inference benefits; compute-bound work does not.
- 256 GB lets a 70B model in FP16 (about 140 GB of weights) leave over 100 GB for KV cache on a single GPU.
- No FP6 or FP4 hardware; if quantised throughput is the plan, the MI350 series is the generation that adds MXFP4.
- The 1,000 W figure is a peak board rating; validate sustained clocks in your chassis.
How much memory does the MI325X have?
256 GB of HBM3E at 6 TB/s peak bandwidth with full-chip ECC.
MI325X vs MI300X?
Same CDNA 3 compute. The MI325X has 256 GB HBM3E at 6 TB/s versus 192 GB HBM3 at 5.3 TB/s, and a 1,000 W versus 750 W peak board power.
What is the MI325X power draw?
AMD lists 1,000 W peak board power over 54V UBB.
Is the MI325X replaced by the MI350 series?
The MI350 series (MI355X, MI350P) is the newer CDNA 4 generation with MXFP4 and MXFP6; the MI325X remains on AMD's product list.