tech

Meta's new AI chips will begin production in September

The company is taking a modular approach to designing these chips, anticipating that their needs will change as AI evolves rapidly by the time the chips are in production.

Meta's new AI chips will begin production in September

TL;DR

  • Meta plans to start producing its latest AI-specific chips in September to lower GPU costs.
  • The new chips are part of the Meta Training and Inference Accelerator (MTIA) program.
  • Meta is collaborating with Broadcom on chip design and TSMC for manufacturing.
  • The chips feature a modular design (chiplets) to adapt to evolving AI needs.
  • These custom chips are intended for training models, broader AI workloads, and inference.
  • Meta expects to save on buying GPUs from Nvidia and AMD but will continue to purchase from them.
  • The company is making significant capital expenditures towards its AI efforts, including data center expansion.
  • Other tech companies like OpenAI, Anthropic, Amazon, and Google are also developing their own AI chips.