NVIDIA GB300 NVL72
The GB300 NVL72 is the Blackwell Ultra revision of NVIDIA's rack scale platform: the same 48U, 72 GPU, single NVLink domain layout as GB200 NVL72, but each B300 GPU carries 288 GB of HBM3e instead of roughly 186 GB, lifting the rack's NVLink-domain memory pool to 20 TB and its dense FP4 throughput to about 1.1 EFLOPS. It is aimed at teams running large scale reasoning and long context inference alongside training, where the extra memory per GPU and doubled 800 Gb/s scale out networking matter more than raw FLOPS growth. Facility demands go up along with the compute: reported operating power sits at 132 kW to 140 kW continuous, again 100 percent direct to chip liquid cooled with no rack fans.
- The jump from GB200 to GB300 NVL72 is a memory and networking upgrade more than a raw compute upgrade: 288 GB per GPU and 800 Gb/s scale out per GPU matter most for long context inference and multi rack training, not for single rack FLOPS.
- 132 to 140 kW continuous per rack pushes further past what most enterprise data centers can deliver than GB200 NVL72 already did; treat any facility not already qualified for 120 kW plus liquid cooled racks as needing a fresh power and cooling study, not a minor upgrade.
- Floor loading and slab requirements carry over unchanged from GB200 NVL72 since the reference chassis and rough weight are the same, but combine that with the higher power draw and the facility bar for GB300 is strictly higher, not just different.
- For most enterprise buyers who cannot host a 130 kW plus liquid cooled rack, an air cooled 8-GPU HGX B300 or B200 fleet remains the practical fallback, at the cost of losing the single 72-GPU NVLink domain and the larger per GPU memory pool.
- Because GB200 and GB300 NVL72 share a chassis footprint and power shelf design, a facility built out for GB200 is close to GB300 ready; the delta is mostly a higher cooling and power budget, not a redesign.
How much does a GB300 NVL72 cost?
Reported estimates put a training class rack at $3.7M to $4.0M, based on an analyst's read of Apple's GB300 order; inference optimized configurations have been reported as high as $6M to $6.5M. NVIDIA does not publish an official price.
GB200 NVL72 vs GB300 NVL72: what actually changed?
Same 72 GPU, 48U, single NVLink domain layout, but GB300 uses Blackwell Ultra B300 GPUs with 288 GB HBM3e each (versus roughly 186 GB), pushing rack memory to 20 TB, dense FP4 throughput to about 1.1 EFLOPS, and scale out networking to 800 Gb/s per GPU via ConnectX-8, double GB200's 400 Gb/s.
What power does a GB300 NVL72 rack need?
Operating power is reported at 132 kW to 140 kW continuous, with peak or transient draw reported up to 155 kW by at least one OEM. That runs through the same 8-shelf, 480V three phase power architecture as GB200 NVL72.
Is GB300 NVL72 actually shipping, or still announced?
It is shipping. Dell delivered the first units to CoreWeave in July 2025, CoreWeave reached general availability that August, and Microsoft Azure and AWS both stood up GB300 NVL72 capacity within the following months.