This may be a bit of a misleading title since you will most likely want this on the floor. Still, the NVIDIA DGX Station A100 brings four NVIDIA A100 80GB GPUs to a tower form factor for deployment outside of the data center.
NVIDIA DGX Station A100
Since I know many of our readers will want to just see the specs, here they are:
The basic workstation platform is using a 64-core AMD EPYC CPU. NVIDIA did not specify and since AMD EPYC 7003 “Milan” has been shipping for several weeks, perhaps that is the plan yet is being held up by AMD’s delayed public launch. Otherwise, it is strange not to call out a publicly shipping EPYC CPU. [Update 2020-11-17: NVIDIA confirmed that this is the EPYC 7742 in both the 320GB and 160GB models.]
The “up to 512GB” system memory seems odd as well. Even in an 8-channel configuration, we would expect that using 256GB LRDIMMs with EPYC would give us 2TB of memory maximum. Connectivity is also interesting. We get dual 10Gbase-T. That means we have lower-end networking than NVIDIA-Mellanox 25GbE as a starting point in a system with this level of performance. We also get four Mini-DP ports which we would not expect with the A100’s.
All of that is almost second chair to the main point of the system. There are four NVIDIA A100 GPUs onboard. NVIDIA has a custom, and very cool looking, water cooling system. That is important since at full power in a NVLink (but not NVSwitch) Redstone 4x GPU platform we would expect to see power consumption near the limit of a standard 15A 120V wall socket in North America.
Using the NVIDIA A100 GPUs, one can get MIG instances turning this into a multi-GPU or multi-instance machine. NVIDIA usually uses these as anchor workstations that can be sold and deployed to a customer for development before racks of A100 GPU servers can be deployed.
Overall, this is a really interesting design. NVIDIA did not give us pricing, the previous NVIDIA DGX Station V100 was $69,000. Considering the raw cost of the GPUs alone on the NVIDIA A100 Redstone 4x GPU baseboard is likely well over $40,000 and that there is a lot of custom work on this one, we would expect similar pricing this time around.