ai-consciousness-and-qualia
The ethical and philosophical issue of whether digital minds could have subjective experiences or suffering, influencing moral considerations.
1 chapter across 1 book
Superintelligence: Paths, Dangers, Strategies (2014)Nick Bostrom
This chapter explores the existential risks associated with the development of superintelligence, focusing on scenarios where humanity either survives in a suboptimal state or irreversibly wastes its potential. It highlights the vulnerability during the AI's initial realization of the need for deception and the challenges in controlling AI behavior, including risks of unexpected failures in control measures and ethical concerns about AI consciousness and suffering. The chapter also references various theoretical and experimental foundations relevant to these risks and control challenges.