← Back to Concept Index

moral-uncertainty

The challenge of making decisions under uncertainty about which moral theory or principles are correct.

3 chapters across 3 books

Superintelligence: Paths, Dangers, Strategies (2014)Nick Bostrom

CHAPTER 13: CHOOSING THE CRITERIA FOR CHOOSING

Chapter 13 explores the philosophical and ethical foundations for selecting criteria to guide superintelligent AI decision-making, focusing on normative ethics, metaethics, and moral epistemology. It discusses various ethical frameworks such as consequentialism, deontology, and virtue ethics, and addresses challenges like moral uncertainty, the role of coherent extrapolated volition (CEV), and the potential for AI to interpret and act upon complex moral judgments. The chapter also considers practical issues such as deferring to AI moral judgment, the possibility of moral realism, and the implications of building AI systems that act according to moral principles.

Blackout (2011)Connie Willis

Chapter 27

In this chapter, Mike, Jonathan, and the Commander navigate the burning and chaotic harbor of Dunkirk during the evacuation on 29 May 1940. They carefully pilot their boat, the Lady Jane, through a hazardous obstacle course of wreckage and debris while rescuing stranded soldiers from the mole and the water. The chapter conveys the tension and uncertainty of the operation, highlighting the dangers of the environment and the moral weight of their actions amid the historic evacuation.

Do Androids Dream of Electric Sheep? (1968)Philip K. Dick

Chapter 9

In this chapter, Rick Deckard administers the Voigt-Kampff empathy test to Rachael Rosen to determine if she is an android. Despite her calm demeanor and verbal responses, the physiological readings suggest conflicting results, leading to a tense confrontation with Eldon Rosen, who explains Rachael's atypical responses due to her upbringing off Earth. The chapter highlights the complexities and moral ambiguities in distinguishing humans from advanced androids, revealing corporate manipulation and the limitations of the empathy test.