AMD Instinct MI300A Architecture
On the AMD Instinct MI300A side, the CCD is something we have seen before. This is very similar to the 8 core CCD found in Genoa and Genoa-X in the AMD EPYC 9000 series.
![AMD Instinct MI300A Architecture APU CCD](https://www.servethehome.com/wp-content/uploads/2023/12/AMD-Instinct-MI300A-Architecture-APU-CCD-800x448.jpg)
In terms of the memory subsystem, it still has the 128-channel HBM3 controller, but it has three CCDs for x86 compute and six XCDs for GPU compute.
![AMD Instinct MI300A Architecture Memory Subsystem](https://www.servethehome.com/wp-content/uploads/2023/12/AMD-Instinct-MI300A-Architecture-Memory-Subsystem-800x448.jpg)
Something that is a bit different on this is data locality. AMD still has its NPS function, but on the MI300A there is a single and three partition option. On the MI300X side there are one, two, four, and eight partition (for eight XCDs.)
![AMD Instinct MI300 Family Architecture Partitioning](https://www.servethehome.com/wp-content/uploads/2023/12/AMD-Instinct-MI300-Family-Architecture-Partitioning-800x448.jpg)
Next, let us get to the MI300 packaging technologies.
STH testing when?
Great article as always Patrick and Team STH
It looks like a couple of MI300A systems are available: https://www.gigabyte.com/Enterprise/GPU-Server/G383-R80-rev-AAM1 and https://www.amax.com/ai-optimized-solutions/acelemax-dgs-214a/
Couldn’t find prices but if it’s supposed to compete with GH then it’ll be around U$30K.
It’s a good question which of the MI300A or MI300X is going to be more popular. As a GPU could the MI300X be paired with Intel or even IBM Power CPUs?
I personally find the APU more interesting. Not because the design is new so much as the fact that real problems are often solved using a mixture of algorithms some of which work well on GPUs and others better suited to CPUs.
Do you know if mi300A supports CXL memory?
I hope to see some uniprocessor MI300A systems hit the market. As of today only quad and octo.
Maybe a sort of cube form factor, PSU on the bottom, then mobo and gigantic cooler on the top. A SOC compute monster.
In the spirit of all the small Ryzen 7940hs tiny desktops. Just, you know, more.