← Back to Concept Index

system-recalcitrance

The resistance or difficulty encountered when attempting to improve an intelligent system.

1 chapter across 1 book

Superintelligence: Paths, Dangers, Strategies (2014)Nick Bostrom

CHAPTER 4

Chapter 4 examines the dynamics of the transition from human-level machine intelligence to radical superintelligence, focusing on the speed and nature of this change. It introduces the concepts of optimization power and system recalcitrance to analyze whether the intelligence explosion will be gradual or sudden. The chapter emphasizes the importance of understanding these factors near the threshold of human-equivalent general reasoning ability.