AMD Ryzen AI Halo Agentic AI CPU Performance
We have seen the AMD Ryzen AI Max+ 395 quite a few times now. Still, we have the new AgentSTH V7 test bench rolling out, so we wanted to at least show where the AMD Ryzen AI Halo stacks up. Specifically, we wanted to see if the little box with big cooling has out-sized performance because it is from AMD itself. We are using the GMKtec EVO-X2 as one comparison point since that was the first Strix Halo system we tested. The next planned AMD Strix Halo review after this one will be the Minisforum N5 Max, a 64GB version, the first 64GB model we tested, and so we wanted to add that as well, roughly a year separating it from the EVO-X2 review. We will swap that Minisforum for the company’s Minisforum MS-S1 Max for the GPU/ AI testing, just because having half the memory means that we cannot run the same models/ context lengths with the 64GB system.
AMD Ryzen AI Halo LM Bench
Kicking off, we have the AMD Ryzen AI Max+ 395 LM Bench results, looking at the working set size versus latency.
A question we had was whether this was substantially different than other AMD Ryzen AI Max+ 395 systems, so here is a look at the 64B results.
You can see that comparing this to the GMKtec EVO-X2 and the Minisforum N5 Max, we see fairly similar results.
The N5 Max is a 64GB machine and is on the newer side, while the 128GB EVO-X2 is the first Strix Halo system we tested. All three look similar here.
AMD Ryzen AI Halo Core-to-Core Latency
We also wanted to do a quick core-to-core latency test. Here we have all three systems:
It makes sense that all three are relatively close, in terms of latency, but it was something we wanted to look at to see if AMD was doing anything special with the Ryzen AI Halo.
Estimated STH SPEC CPU2026 Performance
SPEC CPU2026 is the company’s new benchmark suite. Its predecessor, CPU2017, was a de facto industry standard in the server industry. We are running this using open-source compilers at -O3 optimization levels, so our results should not be directly compared to the official numbers on the SPEC website. Instead, these are benchmarks at lower compiler optimization levels and should only be compared to STH results.
We start with the estimated STH SPEC CPU2026 int rate results:
Here you can see that all of the systems are relatively close in terms of performance, but as we would expect, Minisforum has the best single-core performance from the bunch since the company’s systems are focused on performance, despite being a NAS system. Here are the subtest scores:
Moving on to the STH estimated fp rate side, we see a similar pattern:
Here are the subtests:
Overall, you can see the performance of the entire set of loaded chips fairly well here. Next, however, we wanted to get to our AgentSTH V7 testing.
