ASRock Rack 4U16X-GNR2 NVIDIA HGX B300 8-GPU Tray DLC
The bottom portion of the chassis is the GPU tray. This slides out on its own internal rail system.
Removing the cover reveals the cold plates and the ConnectX-8 OSFP connections.
The entire GPU tray can be removed from the system. It is quite heavy just because the cold plates are heavy.
Here is an interesting view. The cold plates need to cool the GPUs, but also the NVIDIA NVLink Switches and NVIDIA ConnectX-8 SuperNICs.
The cold plates have a protective cover with openings for the various screw holes.
These also have a leak detection around key connection points.
Here is a look at under the cold plate cover.
At the rear of the tray, there are the high-density connectors.
Here is a look inside the system so you can see where these connectors ultimately plug into.
Next, let us get to the system topology.
@ Patrick. A few corrections.
Other than these corrections, It’s an amazing piece of machine. Too bad, my rack is already full ;-)
A question. What kind of coolant is used, plain water?. Assuming some kind of additive is used for preventing corrosion, clogging etc.
Could the same kind of fluid be used as used with the Immersion Cooling method ?
That fluid is dielectric fluid which would not harm the server if there is a leak. Just a thought.
Thanks Robrt. I think those got eaten between draft and pushing it over to the main site.
Excellent in-depth review! I really like how the article goes beyond specifications and explores the server’s real-world design, cooling, networking, and AI infrastructure capabilities. It’s a valuable resource for anyone interested in next-generation GPU servers and enterprise AI deployments.