What moral decisions should driverless cars make? | Iyad Rahwan

Technology and Society: The Ethics of Driverless Cars

Introduction to Traffic Accidents

• The Department of Transport reported 35,000 traffic-related deaths in the US last year, with a global total of 1.2 million fatalities annually.

Promises of Driverless Car Technology

• Driverless cars aim to reduce accidents by eliminating human error, potentially decreasing accident rates by up to 90%.

• A hypothetical scenario is presented where a driverless car must choose between swerving to hit one person or crashing into a wall, raising ethical questions about decision-making in emergencies.

Ethical Dilemmas and the Trolley Problem

• The speaker critiques the tendency to dismiss such scenarios as unrealistic, emphasizing that real-life decisions will involve complex calculations regarding risk and trade-offs.

• Waiting for complete safety before adopting technology also presents ethical dilemmas; delaying could result in millions more deaths.

Public Perception and Social Dilemmas

• Suggestions from the public on how driverless cars should behave highlight a lack of consensus on ethical decision-making.

• A survey was conducted to gauge societal values regarding these ethical dilemmas, comparing utilitarianism (Bentham) versus duty-bound ethics (Kant).

Survey Findings and Consumer Behavior

• Most respondents favored utilitarian principles for driverless cars but expressed reluctance to purchase such vehicles themselves.

• This reflects a social dilemma where individuals want personal safety prioritized while expecting others' vehicles to minimize harm.

Historical Context: Tragedy of the Commons

• The concept of "tragedy of the commons" is introduced through an analogy involving farmers sharing grazing land, illustrating how individual rational choices can lead to collective detriment.

• This dilemma parallels issues like overfishing and climate change, highlighting challenges in managing shared resources effectively.

Implications for Driverless Car Regulation

• In regulating driverless cars, public safety becomes the common good; however, prioritizing individual passenger safety may undermine overall societal welfare.

The Ethical Dilemma of Autonomous Vehicles

The Tragedy of the Algorithmic Commons

• The speaker uses a sheep metaphor to illustrate the challenges posed by autonomous systems, likening them to "electric sheep" that operate independently, leading to potential unforeseen consequences.

Regulation and Social Dilemmas

• Traditionally, social dilemmas are addressed through regulation where governments or communities collectively decide on desired outcomes and necessary constraints on individual behavior.

Public Sentiment on Regulation

• A survey revealed public resistance to regulations aimed at minimizing harm in cars; individuals expressed they would avoid purchasing regulated vehicles despite their safety benefits.

• This paradox suggests that enforcing regulations could inadvertently lead to greater harm if consumers reject safer technologies due to regulatory constraints.

Understanding Trade-offs in Decision Making

• The Moral Machine website was developed by students to present users with ethical dilemmas involving autonomous vehicles, collecting over five million decisions from one million participants globally.

• This initiative aims to illuminate societal preferences regarding trade-offs in life-and-death scenarios and highlight the complexities faced by regulators in making ethical choices.

Societal Cooperation and Ethical Considerations

• Recent regulations from the Department of Transport included a checklist for carmakers emphasizing ethical considerations, indicating a growing recognition of these issues within policy frameworks.

• The discussion transitions from specific vehicle dilemmas (e.g., swerve or stay) to broader societal agreements on acceptable trade-offs, framing it as a social dilemma rather than merely a technological challenge.

Asimov's Laws and Future Implications

• Reference is made to Isaac Asimov's laws of robotics, culminating in the introduction of a zeroth law prioritizing humanity's overall well-being, raising questions about its application in driverless technology regulation.