Abstract

To assess the intelligence of machines, Alan Turing proposed a test of imitation known as the imitation game, famously known as the Turing test. To assess whether artificial intelligent (AI) systems could be moral or not, Colin Allen et al. developed a test of imitation in the context of morality, a test known as the Moral Turing Test (MTT), which I will, in this paper, call the moral imitation game. There are arguments against developing any type of MTT or moral imitation game. Rather than developing a moral imitation game, this paper proposes a criterion of imitation for AI systems in the moral scenario. To develop a criterion of imitation, I explore the notion of moral attribution in detail. Within the case of moral attribution, I introduce the subject‐ascriber distinction. The notion of moral attribution and the subject‐ascriber distinction is employed to address the following questions: (a) how is the assessment in MTT arranged?, (b) what is the role of the interrogator in the MTT?, and (c) what information is to be concealed from the interrogator? The first question deals with the aspect of assessment, the second question deals with the reordering of the role of the interrogator and the third one deals with the concealment aspect of the imitation game. After that, a criterion of imitation for AI systems is put forward. Using the subject‐ascriber distinction in moral attribution and David Lewis' Mad Pain and Martian Pain cases, it is argued that the notion of sentience is insignificant for the ascriber for moral attributions.