tech

AMD takes a shot at Nvidia by betting on AI's next big shift

AMD is betting the future of AI won't rely on a single chip, unveiling a Cerebras partnership and new Helios system to challenge Nvidia.

AMD takes a shot at Nvidia by betting on AI's next big shift

TL;DR

  • AMD is partnering with chip startup Cerebras on a new approach to AI inference.
  • This partnership focuses on "disaggregated inference," splitting workloads across different hardware.
  • AMD's Helios server system is designed for processing requests, while Cerebras' chip specializes in generating responses.
  • The demand for AI chips has increased significantly, with Nvidia currently dominating AI training.
  • AMD claims its Helios system offers better performance per dollar compared to Nvidia's Vera Rubin NVL72 rack.
  • Key partners for AMD's infrastructure include OpenAI, Meta, Microsoft, Oracle, and Anthropic.