Arm says its AGI CPU delivers nearly 2X the performance per rack of AMD EPYC 9755 in new agentic AI CPU tests
Arm claims its AGI CPU delivers nearly 2X the modeled rack performance of AMD’s EPYC 9755 across seven agentic AI workloads, using a new evaluation methodology developed with Fujitsu, Meta, and OpenAI
Arm has unveiled its AGI CPU, a specialized data center processor tailored for agentic AI workloads. In preliminary tests, the AGI CPU outperformed AMD's EPYC 9755 by nearly double in terms of performance per rack, based on a combination of chip performance and server-power assumptions evaluated across seven workloads. This claim is grounded in a new CPU evaluation methodology developed by Arm in collaboration with Fujitsu, Meta, and OpenAI.
The findings, however, are not definitive, as they are specific to the selected processors, workloads, and the Arm's custom evaluation methodology. Several other chipmakers, including AMD and Intel, utilize different benchmarks to calculate performance. The AGI CPU is designed to handle complex, multi-step workflows required by agentic AI systems.
These systems execute tools, retrieve data, maintain state within isolated environments, and manage communication with external services, such as databases and APIs. The CPU plays a crucial role in supporting these surrounding workloads, ensuring that they run efficiently and do not impede accelerator performance. The methodology established by Arm emphasizes representative agent workloads, repeatable CPU measurements, and validation against end-to-end task outcomes.
This approach focuses on how much useful work a system can sustain while maintaining responsiveness, rather than merely counting the number of agents that can run concurrently. To quantify performance, Arm conducted tests on seven workloads, including MySQL database transactions, NGINX web and API handling, Milvus vector search, Terminal-Bench 2 (sandboxed agent tasks), SWE-bench replay (software engineering workflow), fastText (CPU word representation training), and vLLM (CPU overhead with model compute bypassed).
The AGI CPU demonstrated superior performance in most tests, averaging 1.20x the performance of the AMD EPYC 9755, compared to its actual 1.99x advantage at the rack level.
Written by urgent.news from Tom's Hardware's reporting — not their text. Machine-written — may contain errors; check the original before relying on it.
