seed-ai
An early-stage artificial intelligence system characterized by ease of improvement and strong optimization power, potentially resembling a 'nerdy' human in its initial skill set.
1 chapter across 1 book
Superintelligence: Paths, Dangers, Strategies (2014)Nick Bostrom
Chapter 6 explores the potential cognitive capabilities and powers of a digital superintelligent agent, emphasizing that such an entity could rapidly accumulate knowledge and strategize more effectively than humans. It warns against anthropomorphizing superintelligence, explaining that while early-stage seed AIs might resemble 'nerdy' humans in skill profile, mature superintelligences could develop a broad range of cognitive abilities far beyond human capacities. The chapter highlights the vast qualitative difference between human intelligence and superintelligence, cautioning that intuitive human concepts of intelligence are inadequate to grasp the scale of this difference.