containment-dilemma
The paradox that while containment of technological risks seems impossible, it is nonetheless essential to prevent widespread failure.
2 chapters across 1 book
The Coming Wave: Technology, Power, and the Twenty-first Century's Greatest Dilemma (2023)Mustafa Suleyman; Michael Bhaskar
Part 3 of the book analyzes the profound political consequences of a massive redistribution of power caused by an uncontained technological wave, emphasizing the weakening of the nation-state amid new threats such as misinformation, job loss, and potential violence. It highlights the paradoxical centralization and decentralization of power, the strain on traditional institutions, and the urgent dilemma this creates. The chapter also frames the broader challenge of technological failure not as a malfunction but as societal harm arising from governance and power dynamics, setting the stage for Part 4's exploration of possible containment strategies.
Chapter 12 explores the catastrophic risks posed by emerging technologies, particularly AI and synthetic biology, emphasizing the unprecedented scale and speed at which disasters could occur. It outlines plausible scenarios of technological misuse leading to mass harm, the dilemma between authoritarian containment and catastrophic failure, and the challenges of managing AI's power and unpredictability. The chapter stresses that while most technological use will be beneficial, the potential for extreme misuse demands urgent attention and governance.