Cerebras Deploys Disaggregated Inference to Increase AI Throughput Efficiency
Cerebras launched a disaggregated inference architecture using AMD GPUs and wafer-scale systems, achieving a 5x increase in power efficiency.

Cerebras Systems has transitioned its disaggregated inference architecture into production, reporting a fivefold increase in throughput per megawatt. By offloading prompt processing (prefill) to AMD Instinct GPUs and reserving its wafer-scale CS-3 systems for token generation (decode), the company has optimized power efficiency without compromising response latency. This production deployment follows initial testing conducted in October 2026.
The architecture addresses the distinct computational requirements of large language model inference. Prefill operations are compute-intensive and well-suited for standard GPU architectures, whereas decode operations are memory-bound and benefit from the high-bandwidth, on-chip SRAM capacity of wafer-scale hardware. By separating these stages, operators can maximize the utility of their existing power budgets in constrained data center environments.
To facilitate broader adoption, the company has released a software stack and a decode-only SDK. These tools enable infrastructure partners to integrate their own prefill engines—such as vLLM or SGLang—with Cerebras’ decode engine via an RDMA-based KV Portal. This interface manages the transfer of intermediate model states and key-value caches between the two hardware pools.
Early-access partners include Amazon Web Services, Fireworks AI, Gimlet Labs, and General Compute. The company has set a strategic target to scale this disaggregated inference model across hundreds of megawatts of capacity within its own cloud and partner deployments by the end of 2027.
While the reported performance gains are significant, the scalability of this model remains subject to operational variables. Future performance will depend on the consistency of throughput across diverse partner-selected accelerators, varied software frameworks, and large-scale cluster deployments. The transition from a single shared endpoint to widespread infrastructure integration will be the primary indicator of the architecture's long-term viability in commercial data centers.
More stories
- Türkiye Desk: GTA 6 puts console access and network demand in focus
- Microsoft plans Project Helix as Xbox console for PC games
- OpenAI buys travel startup Odessia
- FURSOY posts 500 MHz Linux-capable RISC-V core
- SpaceX catches Starship upper stage but loses its booster
- Democrats push AI regulation as two state veterans arrive
- Xbox executive defends GTA 6 pre-order volume by pointing to console market share
- Activision will reportedly let Warzone players turn off the paid cosmetics that fund its empire
Latest news
- Average 30-year mortgage APR falls 21bp to 7.13%
- Home insurers charge low-score homeowners nearly $2,000 more
- Ruto pledges police reforms after 127 protest deaths
- Botswana ranks last for feeling safe after dark at 28%
- Connected Advocacy and 7 partners seek local climate finance control
- German founders need 3,942 hours to open small business
- EU methane rule faces three-year delay push by gas groups
- Liberia to cut port charges, add 30 days of free storage

