moral-realism
The position that there exist objective moral truths that can be known and acted upon, which a superintelligence might be able to identify.
1 chapter across 1 book
Superintelligence: Paths, Dangers, Strategies (2014)Nick Bostrom
Chapter 13 explores the philosophical and ethical foundations for selecting criteria to guide superintelligent AI decision-making, focusing on normative ethics, metaethics, and moral epistemology. It discusses various ethical frameworks such as consequentialism, deontology, and virtue ethics, and addresses challenges like moral uncertainty, the role of coherent extrapolated volition (CEV), and the potential for AI to interpret and act upon complex moral judgments. The chapter also considers practical issues such as deferring to AI moral judgment, the possibility of moral realism, and the implications of building AI systems that act according to moral principles.