AI Network Designer Design a network →

Generic Generic HGX 8-GPU node

8 × Unspecified GPU per node, with 8 compute rails at 400G. That is 3.2 Tb/s of scale-out network per node.

What this means for the fabric

8 compute NICs means 8 rails. In a rail-optimized design each of those rails is sized on its own against the node count, then multiplied back up, so the leaf tier is driven by the rail count and not by the total endpoint count.

Storage and in-band management are separate fabrics with their own switches and their own optics, and the 1 BMC port per node feed the out-of-band network, which also has to carry every switch and every PDU in the cluster.

Power and racks

At 10 kW typical draw, this node fills a rack's power budget long before it fills the space. A 45 kW rack takes 4 of them on power alone, against 5 on rack units. Power is what actually sets the rack count.

Notes

Edit every field to match your actual server. nodesPerRack is null here, so rack density is derived from the power and RU budget rather than fixed.

Source: Neutral starting point for a custom build. Placeholder

Related