AMD Instinct MI300A Architecture
On the AMD Instinct MI300A side, the CCD is something we have seen before. This is very similar to the 8 core CCD found in Genoa and Genoa-X in the AMD EPYC 9000 series.
In terms of the memory subsystem, it still has the 128-channel HBM3 controller, but it has three CCDs for x86 compute and six XCDs for GPU compute.
Something that is a bit different on this is data locality. AMD still has its NPS function, but on the MI300A there is a single and three partition option. On the MI300X side there are one, two, four, and eight partition (for eight XCDs.)
Next, let us get to the MI300 packaging technologies.
STH testing when?
Great article as always Patrick and Team STH
It looks like a couple of MI300A systems are available: https://www.gigabyte.com/Enterprise/GPU-Server/G383-R80-rev-AAM1 and https://www.amax.com/ai-optimized-solutions/acelemax-dgs-214a/
Couldn’t find prices but if it’s supposed to compete with GH then it’ll be around U$30K.
It’s a good question which of the MI300A or MI300X is going to be more popular. As a GPU could the MI300X be paired with Intel or even IBM Power CPUs?
I personally find the APU more interesting. Not because the design is new so much as the fact that real problems are often solved using a mixture of algorithms some of which work well on GPUs and others better suited to CPUs.
Do you know if mi300A supports CXL memory?
I hope to see some uniprocessor MI300A systems hit the market. As of today only quad and octo.
Maybe a sort of cube form factor, PSU on the bottom, then mobo and gigantic cooler on the top. A SOC compute monster.
In the spirit of all the small Ryzen 7940hs tiny desktops. Just, you know, more.