Today was perhaps one of the biggest days for evolving Arm’s business. Traditionally, Arm has sold its IP to other companies to integrate into their designs. With the Arm AGI CPU, Arm is evolving to sell full chips.
Arm AGI CPU Launched
When we first saw Arm in the data center, the company was selling IP to customers to integrate into their own chips. Over the years, this evolved with Neoverse cores and Neoverse CSS.
The new design will bring up to 136 Arm Neoverse V3 cores into a single socket. That is just a bit more than the Microsoft Azure Cobalt 200 with 132 Arm Neoverse V3 Cores. Arm is targeting those cores with 2MB of L2 cache per core. On the I/O side there are 96 PCIe Gen6 lanes and CXL support for memory expansion. With the DRAM supply challenges, the CXL Memory Expansion devices, as we highlighted, are becoming extremely popular.
Arm is using a dual-chiplet design with the PCIe and memory controllers on the two dies that are the same. This is more like 5th Gen Intel Xeon Processors Emerald Rapids in terms of using two integrated dies. Arm says that its new CPUs have 12-channel memory at up to DDR5-8800. As a reference, we expect both Intel and AMD to have 16-channel DDR5 platforms with higher speed MRDIMM support later this year.
Arm says that 4-6GB/s is the sweet spot for per core memory bandwidth.
That is what Arm is saying that will drive performance over other solutions in agentic workflows.
Something really interesting is that Arm is showing its x86 competition as an AMD EPYC processor, not an Intel Xeon. Times have changed.
The key idea is that this design with many single socket nodes is that it will allow for over 8,000 cores per ORv3 36kW air cooled rack, and much more on the liquid-cooled double wide form factors.
On competing with customers, Arm actually highlighted that the market is enormous. Meta, is perhaps the headline customer for the line.
OpenAI was on stage so we might expect them to be a big customer. Others, like Cloudflare, SAP, and others, were noted as well.
Arm is not doing this as a one-off. Instead, Arm has a multi-year roadmap for future chips.
Arm also has partners like Lenovo, ASRock Rack, QCT, and Supermicro lined up to sell systems based on the design.
Final Words
Arm is saying that it will be in production later in 2026. That is exciting. Hopefully, we will get these systems to test out soon. This is a huge deal for Arm and one that we will be diving into more in the coming months. An advantage of a rapidly growing data center market is that we get more competition and more server CPUs. 2026 is shaping up to be completely different than 2026 in that regard.
