Gigabyte has a 48 DIMM 2P AMD EPYC Genoa GPU Server at SC22

6
Gigabyte G493 ZB0 AMD EPYC Genoa GPU Server At SC22 Memory Slots
Gigabyte G493 ZB0 AMD EPYC Genoa GPU Server At SC22 Memory Slots

At SC22, we saw a number of really interesting systems. This week, we are showing them to you and this edition is focused on a few of the items we saw in the Gigabyte SC22 booth. We are not going to be able to cover everything, but we wanted to show off a few unique ones.

Gigabyte’s Ampere Arm and NVIDIA Servers

One of the most interesting servers we saw was the Gigabyte G492-PD0. This is a server based around a NVIDIA HGX 8x GPU subsystem. The big difference is that it uses a single Ampere Altra/ Altra Max processor instead of two x86 processors.

Gigabyte G492 PD0 Ampere Altra Max And NVIDIA HGX Server At SC22 1
Gigabyte G492 PD0 Ampere Altra Max And NVIDIA HGX Server At SC22 1

You may have noticed in the screen above the system a STH shirt. That is because the system next to it was a 2U server and so my NVIDIA GTC video was playing.

Patrick On Screen At Gigabyte SC22 Booth
Patrick On Screen At Gigabyte SC22 Booth

The video shown at the booth was a different video from what we had on STH, but if you want to learn more about the Ampere Arm server plus NVIDIA GPU offering, you can see: The Most Important Server of 2022 The Gigabyte Ampere Altra Max and NVIDIA A100.

We had a video for that one as well.

Gigabyte AMD EPYC 9004 “Genoa” Systems at SC22

Gigabyte had a ton of AMD EPYC “Genoa” systems at SC22. Perhpas the most interesting was the Gigabyte G493-ZB0.

Gigabyte G493 ZB0 AMD EPYC Genoa GPU Server At SC22 1
Gigabyte G493 ZB0 AMD EPYC Genoa GPU Server At SC22 1

In what may be one of my favorite photos from thousands of the show, one can see that along with some standard I/O, the front of the system is essentially just a large pass-through vent to improve airflow. If you think there is something exciting on the other side of that vent, you are right.

Gigabyte G493 ZB0 AMD EPYC Genoa GPU Server At SC22 2
Gigabyte G493 ZB0 AMD EPYC Genoa GPU Server At SC22 2

Inside there is a dual-socket AMD EPYC 9004 Genoa motherboard. This is notable because it is a 24 DIMM per CPU or 2DPC dual-socket design. As such, there are 48 DDR5 DIMM slots in the server. That is an absolutely massive number rivaling the sheer number of DIMM slots found in current generation 4-socket 3rd Generation Intel Xeon Scalable Cooper Lake systems.

Gigabyte G493 ZB0 AMD EPYC Genoa GPU Server At SC22 Memory Slots
Gigabyte G493 ZB0 AMD EPYC Genoa GPU Server At SC22 Memory Slots

In our AMD EPYC Genoa Gaps Intel Xeon in Stunning Fashion launch coverage and ourĀ How to Populate AMD EPYC 9004 Genoa Memory Channels guide, we noted that 2DPC dual-socket configurations will be supported in 2023, but Gigabyte has the solution today.

Behind this motherboard is a massive fan wall.

Gigabyte G493 ZB0 AMD EPYC Genoa GPU Server At SC22 3
Gigabyte G493 ZB0 AMD EPYC Genoa GPU Server At SC22 3

The rear of the system has 8x double-width PCIe slots, but then another two that are above for a total of 10 cards that can be installed. This system has massive CPU, memory, and GPU/ accelerator possibilities making it extremely exciting.

Gigabyte G493 ZB0 AMD EPYC Genoa GPU Server At SC22 4
Gigabyte G493 ZB0 AMD EPYC Genoa GPU Server At SC22 4

Perhaps the most interesting use case here will be to see if this is a CXL enabled server. We could imagine companies using something like this for 48x DDR5 RDIMMs plus CXL memory expanders to get massive DRAM capacities.

Aside from that system, one really interesting one we saw was a 2U 4-node Genoa system.

Gigabyte H273 Z81 At SC22 1
Gigabyte H273 Z81 At SC22 1

The Gigabyte H273-Z81 packs 8x AMD EPYC Genoa processors into a 2U space. This is clearly a generation beyond the Milan version we showed in How Liquid Cooling Servers Works with Gigabyte and CoolIT.

It is certainly a challenge to cool eight high-power CPUs and 96 DIMMs (~5W each) in a 2U chassis. That is part of the reason we started showing liquid cooling severla quarters ago.

Final Words

Gigabyte had many more systems and even immersion cooling in its booth. I just wanted to show a few of the more unique solutions off. It was also funny to see my video looping in the booth around the Arm servers. Hopefully we will start to review the new systems starting in early 2023.

Update: We just published our video that has more views and some video on this one here:

 

6 COMMENTS

  1. Good god, that 2U quad-node machine is a monster! Can you even imagine EIGHT Epyc Genoas in ONE box?! God, the potential core counts alone are unfathomable! I realize that’s split across four dual-socket nodes, but damn son! At this point, is it fair to start calling these things mainframes? Because the MASSIVE I/O and compute capacity of these things oughtta plant them squarely into that class regardless of architecture. Plus, I keep waiting to see one of these companies produce an actual x86-64 based mainframe, that’s literally the last class type that hasn’t been developed with x86 processors. I’ve seen ’em in POWER, IBM’s z/Architecture and even some Arm variants, but not yet in x86.

  2. RE: GENOAD8UD-2T
    It took Asrock 8 months from “preliminary” status to actually launch their WRX80 board, hopefully it’s not going to be the same with the Genoa board since it’s more mainstream.

LEAVE A REPLY

Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.