AI Network Designer Design a network →

Supermicro SuperCluster GB300 NVL72

72 × GB300 (Blackwell Ultra) per rack, with 72 compute rails at 800G. That is 57.6 Tb/s of scale-out network per rack.

Rack-scale. The indivisible unit is a whole rack of 72 GPUs, so GPU counts round to multiples of 72 instead of to a node boundary. The figures above are per rack. See GB200 and GB300 NVL72 networking for what the three internal networks do and which of them you actually buy.

What this means for the fabric

72 compute NICs means 72 rails. In a rail-optimized design each of those rails is sized on its own against the rack count, then multiplied back up, so the leaf tier is driven by the rail count and not by the total endpoint count.

Storage and in-band management are separate fabrics with their own switches and their own optics, and the 18 BMC ports per rack feed the out-of-band network, which also has to carry every switch and every PDU in the cluster.

Power and racks

At 120 kW typical draw, this rack fills a rack's power budget long before it fills the space. A 45 kW rack takes 1 of them on power alone, against 0 on rack units. Power is what actually sets the rack count.

Notes

Supermicro's build of the NVIDIA GB300 NVL72 rack. Same rack-scale unit of 72 GPUs and the same liquid-cooling and power envelope as the NVIDIA reference; the difference is who integrates and supports it.

Source: Supermicro SuperCluster GB300 NVL72 datasheet. Needs verification

Related