Arm AGI CPU vs EPYC 9755: Signal65's 1.99x Per‑Rack Claim

Key facts from the Arm announcements #

Arm presents up to 2x performance per rack versus a leading x86 server processor as an independently verified result. The Arm benchmark announcement spells out what that means: Signal65 verified Arm AGI CPU against AMD EPYC Turin, and the headline is "Nearly 2x more work per rack", an average of 1.99x modeled performance per rack against AMD EPYC 9755 across seven workloads. The 2x and the 1.99x are the same result.

• Signal65 analysis, summarized in the Arm OCP Global Summit 2026 article, reports an average of 1.99x modeled performance per rack compared with AMD EPYC 9755 across seven representative agentic AI workloads.
• The same Signal65 verification reported up to 45% lower sandbox creation latency versus AMD EPYC 9965, according to the Arm benchmark announcement and the Arm software ecosystem article.
• Supermicro designs shown at OCP include a 21-inch liquid-cooled configuration supporting 128 Arm AGI CPUs and a wider design scaling to 336 CPUs (Arm OCP Global Summit 2026 article).
• Redis 8.10.1 vector search benchmarks on AWS Graviton5 showed 16–27% more context fetches per dollar than x86 (Arm software ecosystem article).

Why it matters for agent infrastructure #

Arm argues that agent infrastructure has to be evaluated across the whole workflow. The Arm software ecosystem article states that evaluation should cover the complete workflow rather than model inference performance alone, and it adds: "the software around the model becomes just as important as inference itself."

This suggests that teams who benchmark only inference throughput would miss the sandbox, database, API and retrieval steps that Arm lists as agent execution time. For engineers, the practical step is to profile where an agent spends its time before choosing hardware or tuning the stack. The OCP article adds that agentic CPU performance is measured as how efficiently infrastructure supports work as agents run concurrently, rather than how quickly one operation completes.

Comparing the benchmark figures correctly #

The 1.99x figure is modeled at rack level. According to the Arm benchmark announcement, the same benchmark scripts ran on both platforms, and measured server-level performance was the basis for the rack-level model; Arm attributes the result to higher compute density and power efficiency. By workload group, the modeled averages are 1.7x for tooling, 2.0x for agentic workflows and orchestration, and 2.2x for reasoning and planning. The figure therefore describes work per rack, not the speed of a single processor.

The Redis result measures AWS Graviton5 rather than Arm AGI CPU, so it belongs to a separate setup from the rack and sandbox figures. Engineers comparing these numbers should keep each one tied to its workload, dataset or load condition.

Who is affected and what to check #

Teams building agents on Arm64 should check their own workload mix, because Arm says infrastructure needs vary by agent type. Coding agents depend on CPU performance and sandboxing, enterprise workflow agents on API and database efficiency, and research agents on search, retrieval and memory. Arm also notes that personal assistants prioritize interactive responsiveness and robotics adds latency-sensitive coordination, so each agent type should be profiled separately (Arm software ecosystem article).

Infrastructure operators evaluating rack designs should review the Supermicro configurations. The OCP article says Arm's Open Agentic Infrastructure Platform gives providers flexibility to choose the technologies and partners that fit their workloads, rather than prescribing one system configuration.

For software enablement, the Arm software ecosystem article lists Arm Learning Paths on llama.cpp agents, executing AI-generated code in isolated Firecracker microVMs, RAG with LangChain and FAISS, and vLLM deployment on Arm-based platforms. Arm is also contributing Arm Performix, Arm Performix CI and Arm Migrate Ease skills through OpenAnolis SkillHub, and AWS has introduced Graviton developer skills.

Customer service demo on the CPU #

Arm built an on-CPU, multi-agent customer service application with LangGraph and LangChain. A CPU-hosted small language model classifies incoming requests and routes them to agents for meeting scheduling, customer complaints, product inquiries and refunds (Arm software ecosystem article).

The routing agents combine CPU-based inference, enterprise data retrieval, external model APIs and tool execution. For engineers, this is a concrete pattern to test: a classifier and its routing logic can run on the host CPU alongside the tool calls that complete the workflow.