Gigabyte G481-S80 Power Consumption
We put the server into in our data center using 208V 30A Schneider Electric APC PDUs. We measured power using the Intel Xeon Gold 6138 CPUs, and saw some great figures:
- Idle: 0.79kW
- 70% Load: 2.61kW
- 100% Load: 3.32kW
- Peak: 3.49kW
Note these results were taken using a 208V Schneider Electric / APC PDU at 17.7C and 71% RH. Our testing window shown here had a +/- 0.3C and +/- 2% RH variance. The ambient temperatures and humidity factors are important as they greatly influence server power consumption, especially in densely populated GPU servers such as this.
Overall, this is excellent power consumption, actually lower than we saw in some of our 1080Ti based systems. At the same time, this is around 1kW/U so you are likely going to want to spec 40kW racks. Not all data centers can handle this power, especially facilities that are in office buildings that were built for lower-power comptue racks.
We also wanted to point out that the power consumption varied greatly in our testing. We have workloads where the 16GB of HBM2 memory was being used, and the GPU utilization across 8x GPUs was pegged at 95% and we saw power consumption in the 1.4kW-1.5kW range. This is important if you are in a facility with metered power and are trying to budget. Assuming peak load at all times is not realistic for most installations.
STH Server Spider: Gigabyte G481-S80
This is going to be the second review we are going to use the STH Server Spider. Our goal is to start giving a quick visual depiction of the types of parameters that a server is targeted at.
The focus of the Gigabyte G481-S80 is simple: it is designed to be a GPU compute server. One of the interesting parts of the server is that it has a relatively dense storage configuration. It is also designed for high-end networking with a standard configuration having over 400Gbps of networking.
We really like this platform. Unlike building solutions around PCIe switches, there is a balance that the Gigabyte G481-S80 achieves. Storage and networking capabilities are well beyond what most PCIe GPU systems offer and that is a big deal. Moving from one system to many systems is where one is quickly presented with challenges feeding the GPUs. As a “DGX-1.5” class system one has NVLink plus a well-conceived PCIe complex that makes the system work. Looking ahead, Cascade Lake-SP and Optane Persistent Memory will turn the Gigabyte G481-S80 into an absolutely tantalizing upgrade over NVIDIA’s DGX-1.
As you might be able to tell from this article, there is a follow-up being worked on. We did not want to publish MLperf v0.5 results as the suite needs time to mature. We also have a few other benchmarks we wanted to present and a few comparison points headed into the lab this quarter. Stay tuned for DeepLearning12 content featuring the Gigabyte G481-S80.
We are also going to make a somewhat unprecedented offer. If you have a self contained Docker file and want some training or other performance data, get in touch and we will see if we can schedule running it on the machine.