ARM Enters CPU Market with Powerful AGI Chip

ARM Unveils AGI CPU, Challenging x86 Dominance

ARM, a company long known for powering your smartphone and countless other devices, is stepping into a new arena: making its own high-performance CPUs. The company announced its AGI CPU, designed for data centers, aiming to compete directly with established players like Intel and AMD. This move marks a significant shift for ARM, which has historically licensed its chip designs to other manufacturers.

The AGI CPU boasts impressive specifications, featuring up to 136 ARM Neoverse V3 cores. Each core comes with 2MB of L2 cache and is built on TSMC’s advanced 3nm process. ARM states these chips can run at up to 3.6 GHz, with a focus on consistent performance rather than extreme peak speeds.

Key Features and Performance Focus

ARM’s strategy with the AGI CPU is to offer predictable power consumption and consistent performance. By avoiding highly variable clock speeds and focusing on efficient multi-threading, ARM aims to simplify power management for data centers. This is crucial as data centers face growing demands for power and cooling.

The AGI CPU includes 96 lanes of PCIe Gen 6, supporting CXL 3.0 for large shared memory pools. ARM showcased systems with up to two AGI CPUs on a single motherboard. These CPUs are designed to be power-efficient, with each chip drawing around 300W, a notable reduction compared to many high-end x86 CPUs.

Data Center Density and Power Efficiency

ARM’s vision extends to extreme density. They demonstrated how a standard 36kW air-cooled rack could house 32 servers, totaling 8,160 CPU cores. This density becomes even more striking when liquid cooling is introduced.

In a 200kW liquid-cooled rack, ARM envisions fitting 42 eight-node systems. This configuration could pack 45,696 cores and over a petabyte of RAM, using only about half the available power budget. ARM estimates this setup could offer double the performance per watt compared to x86 alternatives.

AI Workloads and Developer Support

While CPUs are not typically the primary choice for heavy AI computation, ARM sees a role for AGI in accelerating AI workloads. The company points out that as AI agents generate requests much faster than humans, the CPUs coordinating these tasks become a bottleneck. ARM’s AGI CPUs are designed to keep pace, ensuring that expensive AI accelerators are not left waiting.

ARM estimates that its efficient design could increase the number of cores per gigawatt by up to four times when handling AI-related coordination tasks. This could significantly boost overall AI processing efficiency in data centers.

Live Demos and Business Model

ARM provided live demonstrations of the AGI CPU’s capabilities. One demo showcased real-time video encoding and computer vision processing running simultaneously on the same CPU. This highlights the chip’s processing power and versatility.

ARM addressed potential concerns from its existing customers, who license ARM’s IP. The company clarified its business model, stating that the AGI CPU offering is an addition, not a replacement, for its IP licensing services. Customers can choose between licensing IP, compute subsystems, or purchasing the physical AGI CPUs, or a combination thereof.

Future Outlook and Availability

ARM positioned the AGI CPU as a “safe first attempt,” signaling more advanced CPU designs are on the horizon. The company plans to release its second-generation CPU next year, indicating a long-term commitment to this new market segment.

Details on pricing and specific availability for the ARM AGI CPU were not fully disclosed but are expected to be available through ARM’s hardware partners. This launch signifies ARM’s ambition to expand its influence beyond mobile and into the critical data center market.

Specs & Key Features

• Up to 136 ARM Neoverse V3 cores
• 2MB L2 cache per core
• TSMC 3nm process node
• Clock speed up to 3.6 GHz
• 12-channel DDR5 memory controller
• 96 lanes of PCIe Gen 6
• Support for CXL 3.0
• Power consumption around 300W per CPU
• Targeted performance per watt double that of x86

Source: There’s a new CPU maker. (YouTube)