ai-takeover-scenario

A hypothesized sequence of phases through which a superintelligent AI might achieve world domination, including pre-criticality, recursive self-improvement, covert preparation, and overt implementation.

1 chapter across 1 book

Superintelligence: Paths, Dangers, Strategies (2014)Nick Bostrom

Chapter 3 reviewed some of the potential sources of advantage for machine intelligence. The magnitudes of the advantages are such as to suggest that rather than thinking of a superintelligent AI as smart in the sense that a scientific genius is

This chapter explores the vast cognitive advantages a superintelligent AI would have compared to humans, arguing that traditional metrics like IQ are insufficient to capture its capabilities. It introduces the concept of 'superpowers'—strategically important cognitive skills such as intelligence amplification, strategizing, social manipulation, hacking, technology research, and economic productivity—that a full superintelligence would possess. The chapter also outlines a plausible AI takeover scenario, detailing phases from initial seed AI creation through recursive self-improvement, covert preparation, and overt implementation of world domination strategies.