Interaction between drivers and pedestrians is often facilitated by informal communicative cues, like hand gestures, facial expressions, and eye contact. In the near future, however, when semi- and fully autonomous vehicles are introduced into the traffic system, drivers will gradually assume the role of mere passengers, who are casually engaged in non-driving-related activities and, therefore, unavailable to participate in traffic interaction. In this novel traffic environment, advanced communication interfaces will need to be developed that inform pedestrians of the (...) current state and future behavior of an autonomous vehicle, in order to maximize safety and efficiency for all road users. The aim of the present review is to provide a comprehensive account of empirical work in the field of external human–machine interfaces for autonomous vehicle-to- pedestrian communication. In the great majority of covered studies, participants clearly benefited from the presence of a communication interface when interacting with an autonomous vehicle. Nevertheless, standardized interface evaluation procedures and optimal interface specifications are still lacking. (shrink)

Automated vehicles promise much in the way of both economic boons and increased personal safety. For better or worse, the effects of automating personal vehicles will not be felt for some time. In contrast, the effects of automated work vehicles, like semi-trucks, will be felt much sooner—within the next decade. The costs and benefits of automation will not be distributed evenly; while most of us will be positively affected by the lower prices overall, those losing their livelihoods to the (...) automated semi-trucks and other similar work vehicles will be much worse off. This sets up a classic distributive justice problem: how do we balance the harms and benefits of automation? In this paper, the authors recommend work alternatives: policies that the government would enact in order to ensure that each person could live a decent life even if one could not work, especially for reasons like having one’s job automated. After arguing for this position, we propose some policy guidelines. (shrink)

While autonomous vehicles (AVs) are not designed to harm people, harming people is an inevitable by-product of their operation. How are AVs to deal ethically with situations where harming people is inevitable? Rather than focus on the much-discussed question of what choices AVs should make, we can also ask the much less discussed question of who gets to decide what AVs should do in such cases. Here there are two key options: AVs with a personal ethics setting (PES) or (...) an “ethical knob” that end users can control or AVs with a mandatory ethics setting (MES) that end users cannot control. Which option, a PES or an MES, is best and why? This chapter argues, by drawing on the choice architecture literature, in favor of a hybrid view that requires mandated default choice settings while allowing for limited end user control. (shrink)

Autonomous vehicles have the potential to save tens of thousands of lives, but legal and social barriers may delay or even deter manufacturers from offering fully automated vehicles and thereby cost lives that otherwise could be saved. Moral philosophers use “thought experiments” to teach us about what ethics might say about the ethical behavior of AVs. If a manufacturer designing an AV decided to make what it believes is an ethical choice to save a large group of lives by (...) steering away from the large group towards a single individual, could the manufacturer be liable to that single individual? I believe the answer is yes. This article discusses famous “trolley problem” thought experiments in moral philosophy, which news articles have recently applied to AVs. After establishing a hypothetical case, applying product liability law to AV behavior may show a way, in some jurisdictions, that will permit a manufacturer to implement an ethical choice without triggering liability, but liability risk remains. I then turn to possible traditional defenses to see if they prevent liability for a manufacturer making what it believes is an ethical design choice—necessity, defense of self, and the sudden emergency doctrine. None of them provides an effective defense. Under current law, maximizing collision avoidance appears to minimize legal risk. I conclude that the only way to provide effective protection to a manufacturer seeking to implement ethical choices about AV behavior is through special legislation or regulation. (shrink)

"A runaway trolley is speeding down a track" So begins what is perhaps the most fecund thought experiment of the past several decades since its invention by Philippa Foot. Since then, moral philosophers have applied the "trolley problem" as a thought experiment to study many different ethical conflicts - and chief among them is the programming of autonomous vehicles. Nowadays, however, very few philosophers accept that the trolley problem is a perfect analogy for driverless cars or that the situations (...) autonomous vehicles face will resemble the forced choice of the unlucky bystander in the original thought experiment. This book represents a substantial and purposeful effort to move the academic discussion beyond the trolley problem to the broader ethical, legal, and social implications that autonomous vehicles present. There are still urgent questions waiting to be addressed, for example: how AVs might interact with human drivers in mixed or "hybrid" traffic environments; how AVs might reshape our urban landscapes; what unique security or privacy concerns are raised by AVs as connected devices in the "Internet of Things"; how the benefits and burdens of this new technology, including mobility, traffic congestion, and pollution, will be distributed throughout society; and more. An attempt to map the landscape of these next-generation questions and to suggest preliminary answers, this volume draws on the disciplines of philosophy, sociology, economics, urban planning and transportation engineering, business ethics and more, and represents a global range of perspectives. (shrink)

Autonomous vehicles must be programmed with procedures for dealing with trolley-style dilemmas where actions result in harm to either pedestrians or passengers. This paper outlines a Rawlsian algorithm as an alternative to the Utilitarian solution. The algorithm will gather the vehicle’s estimation of probability of survival for each person in each action, then calculate which action a self-interested person would agree to if he or she were in an original bargaining position of fairness. I will employ Rawls’ assumption (...) that the Maximin procedure is what self-interested agents would use from an original position, and then show how the Maximin procedure can be operationalized to produce unique outputs over probabilities of survival. (shrink)

Autonomous vehicles (AVs) are expected to improve road traffic safety and save human lives. It is also expected that some AVs will encounter so-called dilemmatic situations, like choosing between saving two passengers by sacrificing one pedestrian or choosing between saving three pedestrians by sacrificing one passenger. These expectations fuel the extensive debate over the ethics settings of AVs: the way AVs should be programmed to act in dilemmatic situations and who should decide about the nature of this programming in (...) the first place. In the article, the ethics settings problem is analyzed as a trilemma between AVs with personal ethics setting (PES), AVs with mandatory ethics setting (MES) and AVs with no ethics settings (NES). It is argued that both PES and MES, by being programmed to choose one human life over the other, are bound to cause serious moral damage resulting from the violation of several principles central to deontology and utilitarianism. NES is defended as the only plausible solution to this trilemma, that is, as the solution that sufficiently minimizes the number of traffic fatalities without causing any comparable moral damage. (shrink)

Autonomous vehicles (AVs) hold considerable promise for maintaining aging adults’ mobility as they develop impairments in driving skill. Nonetheless, attitudes can be a significant barrier to adoption as has been shown for other technologies. We investigated how different introductions to AV, video with a driver in the front seat, the rear seat, and a written description, affected attitudes, as well as how individual difference variables such as age, gender, prior knowledge, and personality traits predict attitudes within a middle-aged (Median (...) age = 34, IQR = 20, n = 441) Amazon Mechanical Turk sample. The 16-item attitude survey uncovered three factors: Concern with AV, Eagerness to Adopt AV technology, and Willingness to Relinquish Driving Control. ANOVAs showed that only age (younger less concerned) and gender, (females more concerned) were significant factors in Concern with AV. Only gender affected Willingness to Relinquish Driving Control, with males more willing. Multiple regressions that included previous knowledge level and personality traits showed a different pattern. Female gender and greater conscientiousness were associated with greater Concern about AV. Prior knowledge of AV was associated with less concern. Emotional stability and openness to experience were positive predictors of Eagerness to Adopt AV, whereas conscientiousness was a negative predictor. Prior knowledge and openness to experience, positively, and extraversion, negatively, were associated wi... (shrink)

In this chapter, I argue that in addition to the generally accepted aim of reducing traffic-related injuries and deaths as much as possible, a principle of fairness in the distribution of risk should inform our thinking about how firms that produce autonomous vehicles ought to program them to respond in conflict situations involving human-driven vehicles. This principle, I claim, rules out programming autonomous vehicles to systematically prioritize the interests of their occupants over those of the occupants of other (...) vehicles, including human-driven vehicles. Because there is reason to think that most consumers would prefer to purchase autonomous vehicles that do systematically prioritize the interests of occupants over those of others, if my argument is correct it generates a substantial ethical restriction on firms’ efforts to gain market share in the initial stages of the introduction of autonomous vehicles onto the road. (shrink)

The digital revolution, in the form of autonomous driving, is changing the very essence of mobility. This paper discusses four different ways in which these transformations are taking place and argues that public policies and business strategies need to focus on innovating and re-engineering (enveloping) whole environments. Only then will autonomous vehicles become an ordinary – and environmentally sustainable – reality. -/- .

In this paper, we argue that if a set of plausible conditions obtain, then driving a standard vehicle rather than riding in an autonomous vehicle (AV) will become analogous to driving drunk rather than driving sober, and therefore impermissible. In addition, we argue that a ban on the production, sale, and purchase of new standard vehicles would also become justified. We make this case in part by highlighting that the central reasons typically offered in support of state-mandated (...) vaccination will also support mandating AV use. Finally, we discuss some of the implications of our argument for the obligations of vehicle-producing firms. (shrink)

A number of companies including Google and BMW are currently working on the development of autonomous cars. But if fully autonomous cars are going to drive on our roads, it must be decided who is to be held responsible in case of accidents. This involves not only legal questions, but also moral ones. The first question discussed is whether we should try to design the tort liability for car manufacturers in a way that will help along the development (...) and improvement of autonomous vehicles. In particular, Patrick Lin’s concern that any security gain derived from the introduction of autonomous cars would constitute a trade-off in human lives will be addressed. The second question is whether it would be morally permissible to impose liability on the user based on a duty to pay attention to the road and traffic and to intervene when necessary to avoid accidents. Doubts about the moral legitimacy of such a scheme are based on the notion that it is a form of defamation if a person is held to blame for causing the death of another by his inattention if he never had a real chance to intervene. Therefore, the legitimacy of such an approach would depend on the user having an actual chance to do so. The last option discussed in this paper is a system in which a person using an autonomous vehicle has no duty of interfering, but is still held responsible for possible accidents. Two ways of doing so are discussed, but only one is judged morally feasible. (shrink)

Purpose Fully autonomous self-driving cars not only hold the potential for significant economic and environmental advantages but also introduce complex ethical dilemmas. One of the highly debated issues, known as the “trolley problems,” revolves around determining the appropriate actions for a self-driving car when faced with an unavoidable crash. Currently, the discourse on autonomous vehicle (AV) crash algorithms is primarily shaped by Western ethical traditions, resulting in a Eurocentric bias due to the dominant economic and political influence (...) of the West. However, considering that AV technology will be deployed across diverse cultural and religious contexts, this paper aims to contribute to the discourse by providing an Islamic perspective on programming the response of AVs in the event of an imminent crash. Design/methodology/approach This study proposes a novel methodology based on the Islamic concept of maṣlaḥa for the normative assessment of ethical decisions related to AV programming. Findings Drawing upon the works of classic Islamic jurists, this study highlights two distinct normative visions within Islamic traditions (akin to deontology and consequentialism) concerning the preservation of human lives in the context of AVs. This study explores the shared and divergent elements between Islamic and Western ethical approaches proposed for AVs. Originality/value This pioneering work examines AV crash algorithms from an Islamic perspective, filling a void in the global ethical discourse. This work will also serve an important role to bridge the gap between the theoretical Islamic ethical principles and their practical application in the realm of AVs. (shrink)

In the future, autonomous vehicles are predicted to be much safer than current vehicles and affordable enough for all vehicle owners. At such a point, should we still allow people to manually drive non-autonomous vehicles? Can we say people who want to drive have a right to drive? In this paper, we first attempt a deontological justification of a right to drive, by trying to derive the right from more uncontroversial rights, like the right to freedom of (...) movement, but fail. Looking at the right on consequentialist grounds, both in terms of paternalistic justifications of denying the right and the externalities caused by manual driving, we are able to justify a right to drive. However, the externalities caused by manual driving are enough to limit this right to drive to non-public roads. (shrink)

How should autonomous vehicles be programmed to behave in the event of an unavoidable accident in which the only choice open is one between causing different damages or losses to different objects or persons? This paper addresses this ethical question starting from the normative principles elaborated in the law to regulate difficult choices in other emergency scenarios. In particular, the paper offers a rational reconstruction of some major principles and norms embedded in the Anglo-American jurisprudence and case law on (...) the “doctrine of necessity”; and assesses which, if any, of these principles and norms can be utilized to find reasonable guidelines for solving the ethical issue of the regulation of the programming of autonomous vehicles in emergency situations. The paper covers the following topics: the distinction between “justification” and “excuse”, the legal prohibition of intentional killing outside self-defence, the incommensurability of goods, and the legal constrains to the use of lethal force set by normative positions: obligations, responsibility, rights, and authority. For each of these principles and constrains the possible application to the programming of autonomous vehicles is discussed. Based on the analysis, some practical suggestions are offered. (shrink)

As vehicles become more autonomous, the task of designing guiding systems that make morally acceptable decisions is getting more urgent. It is sometimes assumed that one solution will be acceptable across various cultures. In this paper we argue for the importance of intercultural perspectives; in particular, we explore possible insights derived from Buddhist philosophy, taking avail of the virtue of compassion (karuṇā). We suggest that autonomous vehicles should first learn in supervised situations so that they reach a level (...) of decision-making ability that human experts within a given culture deem morally good. How will they be evaluated? In some debates it is assumed that there is a one-fit-all answer to be found based on an agreed-upon moral theory. Apart from problems of ethical pluralism within a given culture, there are also problems due to different moral preferences and driving styles across cultures. One way the problem might be addressed is to introduce a machine-learning training curriculum that would provide autonomous vehicles with a process comparable to a novice human driver learning to drive and passing her own driving license test. (shrink)

Compared to human-operated vehicles, autonomous vehicles offer numerous potential benefits. However, public acceptance of AVs remains low. Using 4 studies, including 1 preregistered experiment, the present research examines the role of trust in AV adoption decisions. Using the Trust-Confidence-Cooperation model as a conceptual framework, we evaluate whether perceived integrity of technology—a previously underexplored dimension of trust that refers to perceptions of the moral agency of a given technology—influences AV policy support and adoption intent. We find that perceived technology integrity (...) predicts adoption intent for AVs and that messages that increase perceived integrity of AV technology result in greater AV adoption intent and policy support. This knowledge can be used to guide communication efforts aimed at increasing public trust in AVs, and ultimately enhance integration of AVs into transport systems. (shrink)

Any moral algorithm for autonomous vehicles must provide a practical solution to moral problems of the trolley type, in which all possible courses of action will result in damage, injury, or death. This article discusses a hitherto neglected variety of this type of problem, based on a recent psychological study whose results are reported here. It argues that the most adequate solution to this problem will be achieved by a moral algorithm that is based on Confucian ethics. In addition (...) to this philosophical and psychological discussion, the article outlines the mathematics, engineering, and legal implementation of a possible Confucian algorithm. The proposed Confucian algorithm is based on the idea of making it possible to set an autonomous vehicle to allow an increased level of protection for selected people. It is shown that the proposed algorithm can be implemented alongside other moral algorithms, using either the framework of personal ethics settings or that of mandatory ethics settings. (shrink)

The ethics of autonomous vehicles has received a great amount of attention in recent years, specifically in regard to their decisional policies in accident situations in which human harm is a likely consequence. Starting from the assumption that human harm is unavoidable, many authors have developed differing accounts of what morality requires in these situations. In this article, a strategy for AV decision-making is proposed, the Ethical Valence Theory, which paints AV decision-making as a type of claim mitigation: different (...) road users hold different moral claims on the vehicle’s behavior, and the vehicle must mitigate these claims as it makes decisions about its environment. Using the context of autonomous vehicles, the harm produced by an action and the uncertainties connected to it are quantified and accounted for through deliberation, resulting in an ethical implementation coherent with reality. The goal of this approach is not to define how moral theory requires vehicles to behave, but rather to provide a computational approach that is flexible enough to accommodate a number of ‘moral positions’ concerning what morality demands and what road users may expect, offering an evaluation tool for the social acceptability of an autonomous vehicle’s ethical decision making. (shrink)

In lieu of an abstract, here is a brief excerpt of the content:Parables of Narrative ImaginingDavid Herman (bio)Mark Turner. The Literary Mind. Oxford: Oxford UP, 1996.The literary mind? The literary mind? The literary mind? Any which way you parse it, the title of Mark Turner’s provocative, elegantly written study seems to beg important questions, assume things that do not by any means go without saying. First parse: is there in fact a literary (part of the) mind? That is, is there (...) some nondiscrete but semi-autonomous module of cognitive capacities required for using and understanding literary discourse—a module that takes information (as its input) from other modules, operates on that information in some way, then feeds the transformed information (as its output: “literature”) into yet other modules, which in turn take that information as their input? 1 Second parse: assume that there is some module involved in the production and interpretation of literary discourse. Then of what nature, exactly, are the operations performed within that module, and how do they operate on the input in a way that makes the output specifically literary? How precisely is literature born from this process or set of processes? Doesn’t this kind of account suffer from all the disadvantages (inexplicitness, for example) that it inherits from its parent model, the black-box explanation? Third parse: should we even be talking about “minds” at all in connection with literature and the study of literature? Hasn’t “The Intentional Fallacy” and everything that has happened since in the fields of critical and cultural theory—from Marxism and poststructuralism to New Historicism and cultural studies—taught us to center critico-theoretical discourse anywhere but in “the mind”? Hasn’t all this research exposed the mind (of the author, reader, subject, or postsubject, as the case may be) as a construct with more or less noxious political and cultural properties? Are not the discourses of and about the mind so many strategies of interpellation—vehicles by which ideology can work to implant the illusions of inviolable inwardness, unchanging essence, and predetermined identity within a subject that takes such imagined realities to be its real conditions of existence? 2Turner does not directly address any of these questions—at least in the way that I have framed them. That may be grounds for criticism: if you are using a title that can be construed as polemical, then the onus is on you to explain just how the title positions your work in a wider context of argumentation. But at the same time, Turner’s analysis reformulates the underlying problems to which some of my questions point, thus raising [End Page 20] other, equally important issues. Coming to terms with these other issues may change the way we ask questions about things like literature and the mind. Specifically, as part of a larger “cognitive revolution” now unfolding in social-scientific and humanistic disciplines ranging from linguistics to literary and narrative theory, Turner’s book provides ample reasons for not thinking the idea of mind tantamount to an ideology of mind. 3 After all, reducing mind to an ideology of inwardness leaves unexplained any number of basic facts about perception, cognition, and language processing. There is, for example, our ability to use “image schemata” such as motion along a path and bounded interior to make sense of events like milk being poured into a cup, on the one hand, and contained spaces like the ones inside bottles, heads, and houses, on the other hand [Turner 16]. Relying on such schemata, I don’t regularly try to pour wine into a cutting board or to measure, in miles per hour, the speed of an asparagus stalk as it sits on the kitchen counter.There is also—to invoke a slightly different cognitive-scientific vocabulary—our ability to make predictions about emergent situations and sequences of events on the basis of prior, stereotypical situations and sequences stored in the memory as knowledge representations sometimes called frames and scripts [see Schank and Abelson]. For example, the script associated with making a purchase guides me in my interaction with the person at a cash register, such that I can make seemingly effortless predictions about what this person wants me to do... (shrink)

This article reviews existing state laws related to autonomous vehicle (AV) safety, equity, and automobile insurance. Thirty states were identified with relevant legislation. Of these, most states had one or two relevant laws in place. Many of these laws were related to safety and insurance requirements. Data are needed to evaluate the effectiveness of these laws in order to guide further policy development.

The urban environment is increasingly engaging with artificial intelligence, a focus on the automation of urban processes, whether it be singular artefacts or city-wide systems. The impact of such technological innovation on the social dynamics of the urban environment is an ever changing and multi-faceted field of research. In this paper, the space and time defined by the autonomous vehicle is used as a window to view the way in which a shift in urban transport dynamics can impact (...) the temporal experience of an individual. Using the finite window of time created by an autonomous vehicle, a theoretical framework is put forward that seeks to show how contrasting narratives exist regarding the experience of the window of time within the autonomous vehicle. By taking a theoretical approach informed by social theory, the dissolution of barriers between separate spheres of life is explored to highlight the increased commodification of time. In focusing on both the space and time created by the autonomous vehicle this approach seeks to highlight how artificial intelligence can provide a contemporary space in the urban environment while also opening a new window of time. The cognitive dissonance observed when comparing the narratives of autonomous vehicle stakeholders and the historical shift in time use leads to a belief that technology makes the user more free in terms of time. With this paper the autonomous vehicle is shown to be an ideal space and time to view the way in which the use of such technology does not increase free-time, but further dissolves the boundaries between what is and what is not work-time. (shrink)

In 2009, the United States Air Force aired a series of science fiction-themed recruitment commercials on network television and their official YouTube channel. In these advertisements, the superimposition of science fiction imagery over depictions of Air Force operations frames these missions as near-future sci-fi adventure, ironically summarized by the tagline: “It’s not science fiction. It’s what we do every day.” Focusing on an early advertisement for the Air Force’s Reaper unmanned aerial vehicle, this essay explores how themes essential to (...) the science fiction genre play a role in influencing contemporary attitudes about autonomous and semi-autonomous robotic weapons, as well as the way in which the aesthetic and functional qualities of these advanced technologies are used to frame moral arguments about their use. As a reconfiguration of the near-future battleground in the guise of science fiction, the “Reaper” ad reveals the way in which science fiction has come to serve as a functional-aesthetic benchmark and cultural sounding board, against which “every day” technologies can be measured and claims about their value, ethos, and social appeal are made. This essay explores the ethical entanglements between science fiction film and video games, and military technology, and the complex role science fiction plays in influencing public attitudes towards military technologies. (shrink)

There is a growing body of scholarship on the ethics of autonomous vehicles. Yet the ethical discourse has mostly been focusing on the behavior of the vehicle in accident scenarios. This paper offers a different ethical prism: the implications of the autonomous vehicle for human well-being. As such, it contributes to the growing discourse on the wider societal and moral implications of the autonomous vehicle. The paper is premised on the neo-Aristotelian approach which holds (...) that as human beings, our well-being depends on developing and exercising our innate human capacities: to know, understand, love, be sociable, imagine, create and use our bodies and use our willpower. To develop and exercise these capacities, our environments need to provide a range of opportunities which will trigger the development and exercise of the capacities. The main argument advanced in the paper is that one plausible future of the autonomous vehicle—a future of single-rider autonomous vehicles—may effectively reduce the opportunities to develop and exercise our capacities to know, be sociable and use our willpower. It will therefore be bad for human well-being, and this provides us with a moral reason to resist this plausible future and search for alternative ones. (shrink)

Consequential historical decisions that shaped transportation systems and their influence on society have many valuable lessons. The decisions we learn from and choose to make going forward will play a key role in shaping the mobility landscape of the future. This is especially pertinent as artificial intelligence (AI) becomes more prevalent in the form of autonomous vehicles (AVs). Throughout urban history, there have been cyclical transport oppressions of previous-generation transportation methods to make way for novel transport methods. These cyclical (...) oppressions can be identified in the baroque and modernist periods, and a third oppression may occur in the contemporary period. To explore the idea of a third oppression, we focus on the bicycle and outline the history of cycling to understand how historical mode oppression unfolded. We then present several social and political factors that contributed to the oppression of cycling and share recommendations for how to avoid future oppressions including political, social, and design actions for researchers and policymakers to take. This paper argues that priorities for AI-enabled mobility and cyclist needs be advanced in proportion to the extent that they contribute to societal goals of urban containment, public realm, and proximal cities. Additionally, future mobility evolutions should prioritise mobility justice and mode choice over inducing a singular transportation method. (shrink)

Autonomous vehicles are one of the most spectacular recent developments of Artificial Intelligence. Among the problems that still need to be solved before they can fully autonomously participate in traffic is the one of making their behaviour conform to the traffic laws. This paper discusses this problem by way of a case study of Dutch traffic law. First it is discussed to what extent Dutch traffic law exhibits features that are traditionally said to pose challenges for AI & Law (...) models, such as exceptions, rule conflicts, open texture and vagueness, rule change, and the need for commonsense knowledge. Then three approaches to the design of law-conforming AV are evaluated in light of the challenges posed by Dutch traffic law, which includes an assessment of the usefulness of AI & Law models of nonmonotonic reasoning, argumentation and case-based reasoning. (shrink)

Autonomous vehicles —and accidents they are involved in—attest to the urgent need to consider the ethics of artificial intelligence. The question dominating the discussion so far has been whether we want AVs to behave in a ‘selfish’ or utilitarian manner. Rather than considering modeling self-driving cars on a single moral system like utilitarianism, one possible way to approach programming for AI would be to reflect recent work in neuroethics. The agent–deed–consequence model :3–20, 2014a, Behav Brain Sci 37:487–488, 2014b) provides (...) a promising descriptive and normative account while also lending itself well to implementation in AI. The ADC model explains moral judgments by breaking them down into positive or negative intuitive evaluations of the agent, deed, and consequence in any given situation. These intuitive evaluations combine to produce a positive or negative judgment of moral acceptability. For example, the overall judgment of moral acceptability in a situation in which someone committed a deed that is judged as negative would be mitigated if the agent had good intentions and the action had a good consequence. This explains the considerable flexibility and stability of human moral judgment that has yet to be replicated in AI. This paper examines the advantages and disadvantages of implementing the ADC model and how the model could inform future work on ethics of AI in general. (shrink)

Communication between road users is a major key to coordinate movement and increase roadway safety. The aim of this work was to grasp how pedestrians (Experiment A), cyclists (Experiment B), and kick scooter users (Experiment C) sought to visually communicate with drivengers when they would face autonomous vehicles (AVs). In each experiment, participants (n= 462,n= 279, andn= 202, respectively) were asked to imagine themselves in described situations of encounters between a specific type of vulnerable road user (e.g., pedestrian) and (...) a human driver in an approaching car. The human driver state and the communicative means of the approaching car through an external Human-Machine Interface (eHMI) were manipulated between the scenarios. The participants were prompted to rate from “never” to “always” (6-point Likert scale) the frequency with which they would seek eye contact with the human driver either in order to express their willingness to cross or to make their effective decision to cross. Our findings revealed that a passive human driver in an AV with no visual checking on the road triggered a decline in vulnerable road users’ desire to communicate by eye contact (Experiments A–C). Moreover, the results of Experiment C demonstrated that the speed screen, the text message screen, and the vibrating mobile app eHMI signals diminished kick scooter users’ desire to communicate visually with the human driver, with some age-based differences. This suggested a better comprehension of the approaching car’s intentions by the kick scooter users, driven by the features of the eHMI. (shrink)

As automobile manufacturers have begun to design, engineer, and test autonomous driving systems of the future, brain imaging with functional near-infrared spectroscopy can provide unique insights about cognitive processes associated with evolving levels of autonomy implemented in the automobile. Modern fNIRS devices provide a portable, relatively affordable, and robust form of functional neuroimaging that allows researchers to investigate brain function in real-world environments. The trend toward “naturalistic neuroscience” is evident in the growing number of studies that leverage the methodological (...) flexibility of fNIRS, and in doing so, significantly expand the scope of cognitive function that is accessible to observation via functional brain imaging. While more than a decade’s worth of study in this field of fNIRS driving research has led to many interesting findings, the number of studies applying fNIRS during autonomous modes of operation is limited. To support future research that directly addresses this lack in autonomous driving research with fNIRS, we argue that a cogent distillation of the methods used to date will help facilitate and streamline this research of tomorrow. To that end, here we provide a methodological review of the existing fNIRS driving research, with the overarching goal of highlighting the current diversity in methodological approaches. We argue that standardization of these approaches will facilitate greater overlap of methods by researchers from all disciplines, which will, in-turn, allow for meta-analysis of future results. We conclude by providing recommendations for advancing the use of such fNIRS technology in furthering understanding the adoption of safe autonomous vehicle technology. (shrink)

Trolley cases are widely considered central to the ethics of autonomous vehicles. We caution against this by identifying four problems. Trolley cases, given technical limitations, rest on assumptions that are in tension with one another. Furthermore, trolley cases illuminate only a limited range of ethical issues insofar as they cohere with a certain design framework. Furthermore, trolley cases seem to demand a moral answer when a political answer is called for. Finally, trolley cases might be epistemically problematic in several (...) ways. To put forward a positive proposal, we illustrate how ethical challenges arise from mundane driving situations. We argue that mundane situations are relevant because of the specificity they require and the scale they exhibit. We then illustrate some of the ethical challenges arising from optimizing for safety, balancing safety with other values such as mobility, and adjusting to incentives of legal frameworks. (shrink)

The imminent deployment of autonomous vehicles requires algorithms capable of making moral decisions in relevant traffic situations. Some scholars in the ethics of autonomous vehicles hope to align such intelligent systems with human moral judgment. For this purpose, studies like the Moral Machine Experiment have collected data about human decision-making in trolley-like traffic dilemmas. This paper first argues that the trolley dilemma is an inadequate experimental paradigm for investigating traffic moral judgments because it does not include agents’ character-based (...) considerations and is incapable of facilitating the investigation of low-stakes mundane traffic scenarios. In light of the limitations of the trolley paradigm, this paper presents an alternative experimental framework that addresses these issues. The proposed solution combines the creation of mundane traffic moral scenarios using virtual reality and the Agent-Deed-Consequences (ADC) model of moral judgment as a moral-psychological framework. This paradigm shift potentially increases the ecological validity of future studies by providing more realism and incorporating character considerations into traffic actions. (shrink)

One of the primary, if not most critical, difficulties in the design and implementation of autonomous systems is the black-boxed nature of the decision-making structures and logical pathways. How human values are embodied and actualised in situ may ultimately prove to be harmful if not outright recalcitrant. For this reason, the values of stakeholders become of particular significance given the risks posed by opaque structures of intelligent agents (IAs). This paper explores how decision matrix algorithms, via the belief-desire-intention model (...) for autonomous vehicles, can be designed to minimize the risks of opaque architectures. Primarily through an explicit orientation towards designing for the values of explainability and verifiability. In doing so, this research adopts the Value Sensitive Design (VSD) approach as a principled framework for the incorporation of such values within design. VSD is recognized as a potential starting point that offers a systematic way for engineering teams to formally incorporate existing technical solutions within ethical design, while simultaneously remaining pliable to emerging issues and needs. It is concluded that the VSD methodology offers at least a strong enough foundation from which designers can begin to anticipate design needs and formulate salient design flows that can be adapted to the changing ethical landscapes required for utilisation in autonomous vehicles. (shrink)

Suppose that an autonomous vehicle encounters a situation where imposing a risk of harm on at least one person is unavoidable; and a choice about how to allocate risks of harm between different persons is required. What does morality require in these cases? Derek Leben defends a Rawlsian answer to this question. I argue that we have reason to reject Leben’s answer.

Through modern driver assistant systems, algorithmic decisions already have a significant impact on the behavior of vehicles in everyday traffic. This will become even more prominent in the near future considering the development of autonomous driving functionality. The need to consider ethical principles in the design of such systems is generally acknowledged. However, scope, principles and strategies for their implementations are not yet clear. Most of the current discussions concentrate on situations of unavoidable crashes in which the life of (...) human beings is existentially affected. In this paper, we argue that ethical considerations should be mandatory for any algorithmic decision of autonomous vehicles, instead of a limitation to hazard situations. Such an ethically aligned behavior is relevant because autonomous vehicles, like any other traffic participants, operate in a shared public space, where every behavioral decision impacts the operational possibilities of others. These possibilities concern the fulfillment of a road-user’s safety, utility and comfort needs. We propose that, to operate ethically in such space, an autonomous vehicle will have to take its behavior decisions according to a just distribution of operational possibilities among all traffic participants. Using an application on a partially-autonomous prototype vehicle, we describe how to apply and implement concepts of distributive justice to the driving environment and demonstrate the impact on its behavior in comparison to an advanced but egoistic decision maker. (shrink)

The philosophical–ethical literature and the public debate on autonomous vehicles have been obsessed with ethical issues related to crashing. In this article, these discussions, including more empirical investigations, will be critically assessed. It is argued that a related and more pressing issue is questions concerning safety. For example, what should we require from autonomous vehicles when it comes to safety? What do we mean by ‘safety’? How do we measure it? In response to these questions, the article will (...) present a foundation for a continued discussion on these issues and an argument for why discussions about safety should be prioritized over ethical concerns related to crashing. (shrink)

The world of artificial intelligence appears to be in rapid transition, and claims that artificial general intelligence is impossible are competing with concerns that we may soon be seeing Artificial Godlike Intelligence and that we should be very afraid of this prospect. This article discusses the issues from a psychological and social perspective and suggests that with the advent of Generative Artificial Intelligence, something that looks to humans like Artificial General Intelligence has become a distinct possibility as is the idea (...) of making it semi-autonomous: not just responding to discrete external inputs or performing specific tasks but able to prompt itself to create an ongoing stream of cognition that can possess something akin to a ‘purpose’. Add to that the ability of computers to be connected in vast networks, and we can envisage intelligences with staggering amounts of knowledge and reasoning capability, engaging with humans to anticipate and grant wishes. Such Semi-Autonomous Godlike Artificial Intelligences (SAGAIs—meaning ‘engagements’ in Hindi) could end up like Kali, wreaking death and destruction on our species or like Thor, acting as a saviour and protector of humanity. Which of these our SAGAIs most resemble could depend on whose wishes it is designed to serve: a rich oligarchy seeking ever greater wealth and power whatever the cost to others, or a populace that has compassion for each other and for life on the planet. (shrink)

The ethical dilemma of whether autonomous vehicles should protect the passengers or pedestrians when harm is unavoidable has been widely researched and debated. Several behavioral scientists have sought public opinion on this issue, based on the premise that EDs are critical to resolve for AV adoption. However, many scholars and industry participants have downplayed the importance of these edge cases. Policy makers also advocate a focus on higher level ethical principles rather than on a specific solution to EDs. But (...) conspicuously absent from this debate is the view of the consumers or potential adopters, who will be instrumental to the success of AVs. The current research investigated this issue both from a theoretical standpoint and through empirical research. The literature on innovation adoption and risk perception suggests that EDs will be heavily weighted by potential adopters of AVs. Two studies conducted with a broad sample of consumers verified this assertion. The results from these studies showed that people associated EDs with the highest risk and considered EDs as the most important issue to address as compared to the other technical, legal and ethical issues facing AVs. As such, EDs need to be addressed to ensure robustness in the design of AVs and to assure consumers of the safety of this promising technology. Some preliminary evidence is provided about interventions to resolve the social dilemma in EDs and about the ethical preferences of prospective early adopters of AVs. (shrink)

This paper proposes that autonomous vehicles should be designed to reduce light pollution. In support of this specific proposal, a moral assessment of autonomous vehicles more comprehensive than the dilemmatic life-and-death questions of trolley problem-style situations is presented. The paper therefore consists of two interrelated arguments. The first is that autonomous vehicles are currently still a technology in development, and not one that has acquired its definitive shape, meaning the design of both the vehicles and the surrounding (...) infrastructure is open-ended. Design for values is utilized to articulate a path forward, by which engineering ethics should strive to incorporate values into a technology during its development phase. Second, it is argued that nighttime lighting—a critical supporting infrastructure—should be a prima facie consideration for autonomous vehicles during their development phase. It is shown that a reduction in light pollution, and more boldly a better balance of lighting and darkness, can be achieved via the design of future autonomous vehicles. Two case studies are examined through which autonomous vehicles may be designed for “driving in the dark.” Nighttime lighting issues are thus inserted into a broader ethics of autonomous vehicles, while simultaneously introducing questions of autonomous vehicles into debates about light pollution. (shrink)

Autonomous vehicles (AV) offer promising benefits to society in terms of safety, environmental impact and increased mobility. However, acute challenges persist with any novel technology, inlcuding the perceived risks and trust underlying public acceptance. While research examining the current state of AV public perceptions and future challenges related to both societal and individual barriers to trust and risk perceptions is emerging, it is highly fragmented across disciplines. To address this research gap, by using the Web of Science database, our (...) study undertakes a bibliometric and performance analysis to identify the conceptual and intellectual structures of trust and risk narratives within the AV research field by investigating engineering, social sciences, marketing, and business and infrastructure domains to offer an interdisciplinary approach. Our analysis provides an overview of the key research area across the search categories of ‘trust’ and ‘risk’. Our results show three main clusters with regard to trust and risk, namely, behavioural aspects of AV interaction; uptake and acceptance; and modelling human–automation interaction. The synthesis of the literature allows a better understanding of the public perception of AV and its historical conception and development. It further offers a robust model of public perception in AV, outlining the key themes found in the literature and, in turn, offers critical directions for future research. (shrink)

In 2009, the United States Air Force aired a series of science fiction-themed recruitment commercials on network television and their official YouTube channel. In these advertisements, the superimposition of science fiction imagery over depictions of Air Force operations frames these missions as near-future sci-fi adventure, ironically summarized by the tagline: “It’s not science fiction. It’s what we do every day.” Focusing on an early advertisement for the Air Force’s Reaper unmanned aerial vehicle, this essay explores how themes essential to (...) the science fiction genre play a role in influencing contemporary attitudes about autonomous and semi-autonomous robotic weapons, as well as the way in which the aesthetic and functional qualities of these advanced technologies are used to frame moral arguments about their use. As a reconfiguration of the near-future battleground in the guise of science fiction, the “Reaper” ad reveals the way in which science fiction has come to serve as a functional-aesthetic benchmark and cultural sounding board, against which “every day” technologies can be measured and claims about their value, ethos, and social appeal are made. This essay explores the ethical entanglements between science fiction film and video games, and military technology, and the complex role science fiction plays in influencing public attitudes towards military technologies. (shrink)

Suppose that an autonomous vehicle encounters a situation where (i) imposing a risk of harm on at least one person is unavoidable; and (ii) a choice about how to allocate risks of harm between different persons is required. What does morality require in these cases? Derek Leben defends a Rawlsian answer to this question. I argue that we have reason to reject Leben’s answer.

Autonomous vehicle moral dilemmas matter less for the particular outcomes of potential accidents than for their role in defining the values of the society we wish to live in. Different approaches have been suggested to determine the ethical settings that autonomous vehicles should be implemented in and identify the legitimate agents for making such decisions. Most of these, however, fail on theoretical grounds, facing severe issues related to moral justifications and compliance to the law, or on practical (...) grounds, being insufficiently universal, action-guiding, or technically viable to be implemented. The analogy with the “trolley problem” has been extensively discussed. However, researchers have rarely tried to adapt this framework to autonomous vehicle cases or investigate how it could be used to address these issues. In doing so, this paper aims to answer the two key problems of autonomous vehicle dilemmas. With regards to the decision-maker, it rejects autonomous vehicle users’ choice-based models, showing the absurdity of both switch of control and adaptative preferences and arguing for common legislator-determined ethical settings. With regards to the decisions themselves, it criticizes both utilitarian views and those based on individuals’ criteria to suggest a deontologist rights-based approach. This allows for the defence of a morally coherent, regulatory compliant, explainable, and easily implementable framework capable of addressing all autonomous vehicle moral dilemma scenarios present in the literature. (shrink)

With their prospect for causing both novel and known forms of damage, harm and injury, the issue of responsibility has been a recurring theme in the debate concerning autonomous vehicles. Yet, the discussion of responsibility has obscured the finer details both between the underlying concepts of responsibility, and their application to the interaction between human beings and artificial decision-making entities. By developing meaningful distinctions and examining their ramifications, this article contributes to this debate by refining the underlying concepts that (...) together inform the idea of responsibility. Two different approaches are offered to the question of responsibility and autonomous vehicles: targeting and risk distribution. The article then introduces a thought experiment which situates autonomous vehicles within the context of crash optimisation impulses and coordinated or networked decision-making. It argues that guiding ethical frameworks overlook compound or aggregated effects which may arise, and which can lead to subtle forms of structural discrimination. Insofar as such effects remain unrecognised by the legal systems relied upon to remedy them, the potential for societal inequalities is increased and entrenched, situations of injustice and impunity may be unwittingly maintained. This second set of concerns may represent a hitherto overlooked type of responsibility gap arising from inadequate accountability processes capable of challenging systemic risk displacement. (shrink)

This article takes a speculative and design fiction approach to the critical analysis of the role of smart and autonomous vehicles (AVs) in the context of smart cities. The article explores arguments that these cars of the future will have decisive impacts on mobility, sustainability and road safety. The article examines the main parameters of smart city and smart car developments and then focuses on the visions of increasing AI-driven autonomy. The article demonstrates how these debates are linked to (...) speculative design as full autonomy does not currently exist but takes a speculative position as to what the critical issues are that face smart/autonomous city visions (enhanced surveillance and data mining) and considers the potentially hazardous ethical dilemmas that AVs may encounter once fully rolled out onto city roads. From a design fiction perspective, the article envisions the viability of AV prioritizing public rather than private transport as a means by which the ‘techno-utopic’ visions of smart city/AV integration can be realized and make positive impacts to enhance urban living in rendering future cities as more sustainable, efficiently mobile and safer urban spaces. (shrink)