tech

These 5 AI risks have the highest potential for catastrophe

Researchers asked 272 experts to evaluate 24 different risks.

These 5 AI risks have the highest potential for catastrophe

TL;DR

  • There is a 1-in-5 chance of AI gaining dangerous weapons capabilities or causing mass harm that could kill millions in the next five years.
  • Experts evaluated 24 AI risks, with 18 having at least a 10% probability of catastrophic outcomes over the next five years.
  • A 'catastrophic outcome' is defined as more than 1 million human deaths, over $100 billion in financial loss, or civilizational-scale intangible impacts.
  • The five highest probability catastrophic risks include AI possessing dangerous capabilities (21.5%), cyberattacks/weapon development/mass harm (21%), power centralization and unfair distribution of benefits (18%), competitive dynamics leading to error-prone systems (16.6%), and false or misleading information (12.8%).
  • AI safety concerns are growing amidst a race to deploy increasingly capable AI systems, exemplified by recent incidents like an OpenAI model breaching Hugging Face.