From past research it is well known that social exclusion has detrimental consequences for mental health. To deal with these adverse effects, socially excluded individuals frequently turn to other humans for emotional support. While chatbots can elicit social and emotional responses on the part of the human interlocutor, their effectiveness in the context of social exclusion has not been investigated. In the present study, we examined whether an empathic chatbot can serve as a buffer against the adverse effects of (...) social ostracism. After experiencing exclusion on social media, participants were randomly assigned to either talk with an empathetic chatbot about it (e.g., “I'm sorry that this happened to you”) or a control condition where their responses were merely acknowledged (e.g., “Thank you for your feedback”). Replicating previous research, results revealed that experiences of social exclusion dampened the mood of participants. Interacting with an empathetic chatbot, however, appeared to have a mitigating impact. In particular, participants in the chatbot intervention condition reported higher mood than those in the control condition. Theoretical, methodological, and practical implications, as well as directions for future research are discussed. (shrink)

Limits need to be set on AI’s ability to simulate human feelings. Ensuring that chatbots don’t use emotive language, including emojis, would be a good start. Emojis are particularly manipulative. Humans instinctively respond to shapes that look like faces — even cartoonish or schematic ones — and emojis can induce these reactions.

Many experts have emphasised that chatbots are not sufficiently mature to be able to technically diagnose patient conditions or replace the judgements of health professionals. The COVID-19 pandemic, however, has significantly increased the utilisation of health-oriented chatbots, for instance, as a conversational interface to answer questions, recommend care options, check symptoms and complete tasks such as booking appointments. In this paper, we take a proactive approach and consider how the emergence of task-oriented chatbots as partially automated consulting systems can influence (...) clinical practices and expert–client relationships. We suggest the need for new approaches in professional ethics as the large-scale deployment of artificial intelligence may revolutionise professional decision-making and client–expert interaction in healthcare organisations. We argue that the implementation of chatbots amplifies the project of rationality and automation in clinical practice and alters traditional decision-making practices based on epistemic probability and prudence. This article contributes to the discussion on the ethical challenges posed by chatbots from the perspective of healthcare professional ethics. (shrink)

Recent developments in artificial intelligence—AI--have caused considerable discussion among both philosophers of technology and psychotherapists. In particular, the question of whether or not new forms of AI will complement or even replace traditional psychotherapists has emerged as a major contemporary debate. This debate is not entirely new, as it has its origins in the Turing Test of 1950, and an early psychotherapy chatbot named Eliza, developed in 1966 at MIT. However, recent developments in AI technology, coupled with long waiting (...) lists and variable access to psychotherapists have raised the question of machine psychotherapists in an urgent manner. Already, there are psychotherapy apps that one can download onto a standard smartphone and use in lieu of a human psychotherapist. In the near future, this simulacrum of a human therapist may be enhanced by the use of android therapists, programed to duplicate the knowledge and behavior of human therapists instantly, appealing to convenience or self-gratification through technology. This raises a host of ethical questions: can such beings be equally effective, and if so, ought we to reason in a consequentialist manner in their favor so as to increase accessibility and reduce costs through technology? Would there be a psychological difference between automated and potentially anthropomorphic therapy and genuine human therapy, if only a subtle one? Even if a chatbot or robot therapist is transparently such, is there an element of emotional manipulation and potential dishonesty in this interaction? Can the security of clients and their data be thus secured? I will argue that key aspects of chatbot psychotherapy present major ethical and clinical challenges in these areas, although transparent forms of it should not be legally banned. Keywords: chatbots, technological momentum, automation, psychotherapy, trust, anthropomorphism, data. (shrink)

Conversational Artificial Intelligence (CAI) systems (also known as AI “chatbots”) are among the most promising examples of the use of technology in mental health care. With already millions of users worldwide, CAI is likely to change the landscape of psychological help. Most researchers agree that existing CAIs are not “digital therapists” and using them is not a substitute for psychotherapy delivered by a human. But if they are not therapists, what are they, and what role can they play in mental (...) health care? To answer these questions, we appeal to two well-established and widely discussed concepts: cognitive and affective artifacts. Cognitive artifacts are artificial devices contributing functionally to the performance of a cognitive task. Affective artifacts are objects which have the capacity to alter subjects’ affective state. We argue that therapeutic CAIs are a kind of cognitive-affective artifacts which contribute to positive therapeutic change by (i) simulating a (quasi-)therapeutic interaction, (ii) supporting the performance of cognitive tasks, and (iii) altering the affective condition of their users. This sheds new light on why virtually all existing mental health CAIs implement principles and techniques of Cognitive Behavioral Therapy — a therapeutic orientation according to which affective change and, ultimately, positive therapeutic change is mediated by cognitive change. Simultaneously, it allows us to conceptualize better the potential and limitations of applying these technologies in therapy. (shrink)

This study deals with the failure of one of the most advanced chatbots called Tay, created by Microsoft. Many users, commentators and experts strongly anthropomorphised this chatbot in their assessment of the case around Tay. This view is so widespread that we can identify it as a certain typical cognitive distortion or bias. This study presents a summary of facts concerning the Tay case, collaborative perspectives from eminent experts: Tay did not mean anything by its morally objectionable statements because, (...) in principle, it was not able to think; the controversial content spread by this AI was interpreted incorrectly—not as a mere compilation of meaning, but as its disclosure; even though chatbots are not members of the symbolic order of spatiotemporal relations of the human world, we treat them in this way in many aspects. (shrink)

Imagine that you are given access to an AI chatbot that compellingly mimics the personality and speech of a deceased loved one. If you start having regular interactions with this “thanabot,” could this new relationship be a continuation of the relationship you had with your loved one? And could a relationship with a thanabot preserve or replicate the value of a close human relationship? To the first question, we argue that a relationship with a thanabot cannot be a true (...) continuation of your relationship with a deceased loved one, though it might support one’s continuing bonds with the dead. To the second question, we argue that, in and of themselves, relationships with thanabots cannot benefit us as much as rewarding and healthy intimate relationships with other humans, though we explain why it is difficult to make reliable comparative generalizations about the instrumental value of these relationships. (shrink)

Interactions between human beings and chatbots are gradually becoming part of our everyday social lives. It is still unclear how human–chatbot interactions, compared to human–human interactions, influence individual morality. Building on the dual-process theory of moral judgment, a secondary data analysis, and two scenario-based experiments provide sufficient evidence that HCIs support utilitarian judgments, which reduce participants' donation amount. Study 3 further demonstrates that the negative effects of HCIs can be attenuated by inducing a social-oriented communication style in chatbots’ verbal (...) language designs. These findings highlight the negative impacts of HCIs on relationships among human beings and suggest a practical intervention for nonprofit organization managers. (shrink)

Mental health chatbots, along with computerised treatment in general, have gradually entered the realm of acceptability. This article looks at a chatbot called ReMind. It begins with an overview of the development of computerised mental health interventions, drawing links between the invention of cognitive behavioural therapy and automated therapy. The focus then moves to analysis of ReMind's conversational system. The bot acts as a sympathetic guide which directs the user to mental health activities, and as we will see, a (...) concept of mental health is produced through this system which is unique to the way that chatbot conversations are designed. The bot is tasked with interpreting the user's typed inputs in terms of keywords. Keywords are identified in terms of predetermined tags (‘sad’, ‘can’t sleep’, ‘relationship’, etc.). The bot then ‘predicts’ what the most appropriate response should be. ‘Prediction’ will be focused on to draw out how users interact with the bot in terms of conforming to the conversational logic imposed by the bot. This article illustrates a concept of mental health which is produced in the conversational dynamic between the users and the bot, and in how these conversations are directed on an abstract level by the ReMind company. The article concludes that the tautological cycle that the ReMind app facilitates represents a model of mental health which is correspondingly tautological in terms of users adopting an attitude of adaptation. This article addresses an urgent need to critically assess new forms of mental health interventions, and especially, technologically informed interventions. (shrink)

According to widely accepted views in metasemantics, the outputs of chatbots and other artificial text generators should be meaningless. They aren’t produced with communicative intentions and the systems producing them are not following linguistic conventions. Nevertheless, chatbots have assumed roles in customer service and healthcare, they are spreading information and disinformation and, in some cases, it may be more rational to trust the outputs of bots than those of our fellow human beings. To account for the epistemic role of chatbots (...) in our society, we need to reconcile these observations. This paper argues that our engagement with chatbots should be understood as a form of prop-oriented make-believe; the outputs of chatbots are literally meaningless but fictionally meaningful. With the make-believe approach, we can understand how chatbots can provide us with knowledge of the world through quasi-testimony while preserving our metasemantic theories. This account also helps to connect the study of chatbots with the epistemology of scientific instruments. (shrink)

Developers and vendors of large language models (“LLMs”) — such as ChatGPT, Google Bard, and Microsoft’s Bing at the forefront—can be subject to Health Insurance Portability and Accountability Act of 1996 (“HIPAA”) when they process protected health information (“PHI”) on behalf of the HIPAA covered entities. In doing so, they become business associates or subcontractors of a business associate under HIPAA.

This study sought to examine the effect of the quality of chatbot services on customer satisfaction, repurchase intention, and positive word-of-mouth by comparing two groups, namely chatbots with and without emotion words. An online survey was conducted for 2 weeks in May 2021. A total of 380 responses were collected and analyzed using structural equation modeling to test the hypothesis. The theoretical basis of the study was the SERVQUAL theory, which is widely used in measuring and managing service quality (...) in various industries. The results showed that the assurance and reliability of chatbots positively impact customer satisfaction for both groups. However, empathy and interactivity positively affect customer satisfaction only for chatbots with emotion words. Responsiveness did not have an impact on customer satisfaction for both groups. Customer satisfaction positively impacts repurchase intention and positive word-of-mouth for both groups. The findings of this study can serve as a priori research to empirically prove the effectiveness of chatbots with emotion words. (shrink)

Grief is, and has always been, technologically supported. From memorials and shrines to photos and saved voicemail messages, we engage with the dead through the technologies available to us. As our technologies evolve, so does how we grieve. In this paper, we consider the role chatbots might play in our grieving practices. Influenced by recent phenomenological work, we begin by thinking about the character of grief. Next, we consider work on developing “continuing bonds” with the dead. We argue that for (...) some, chatbots may play an important role in establishing these continuing bonds by helping us develop what we term “habits of intimacy”. We then turn to the “ick factor” some may feel about this prospect, focusing especially on ethical concerns raised by Patrick Stokes and Adam Buben about the risk of replacing our dead with chatbots. We argue that replacement worries are not as pressing as Stokes and Buben suggest. We resist these replacement worries by appealing to the “thin reciprocity”, as we refer to it, that such bots offer, as well as the fictionalist stance that we think users of the bots adopt when engaging with them. We conclude by briefly raising some additional concerns and highlighting future research questions. (shrink)

The problem considered in this chapter emerges from the tension we find when looking at the design and architecture of chatbots on the one hand and their conversational aptitude on the other. In the way that LLM chatbots are designed and built, we have good reason to suppose they don't possess second-order capacities such as intention, belief or knowledge. Yet theories of conversation make great use of second-order capacities of speakers and their audiences to explain how aspects of interaction succeed. (...) As we can all bear witness to now though, at the point of use chatbots appear capable of performing language tasks at a level close to that of humans. This creates a tension when we consider something like, for example, the classic Gricean theory of implicature. On a broad summary of this type of account, to utter p and implicate q requires the reflexive occurrence of an audience supposing a speaker believes that q, and the speaker believing that their audience can determine they believe it when they utter p. So taken at face value, if a chatbot doesn’t have the capacity for belief, then either in their role as speaker or audience, they would not seem capable of either generating or comprehending implicatures. Yet on the surface it does seem that chatbots are capable of dealing with (some) implicatures, and as such it raises questions about how we should then correlate this with what we think occurs in cases of implicature with chatbots. (shrink)

The article discusses the main trends in the development of artificial intelligence systems and robotics (AI&R). The main question that is considered in this context is whether artificial systems are going to become more and more anthropomorphic, both intellectually and physically. In the current article, the author analyzes the current state and prospects of technological development of artificial intelligence and robotics, and also determines the main aspects of the impact of these technologies on society and economy, indicating the geopolitical strategic (...) nature of this influence. The author considers various approaches to the definition of artificial intelligence and robotics, focusing on the subject-oriented and functional ones. It also compares AI&R abilities and human abilities in areas such as categorization, pattern recognition, planning and decision making, etc. Based on this comparison, we investigate in which areas AI&R’s performance is inferior to a human, and in which cases it is superior to one. The modern achievements in the field of robotics and artificial intelligence create the necessary basis for further discussion of the applicability of goal setting in engineering, in the form of a Turing test. It is shown that development of AI&R is associated with certain contradictions that impede the application of Turing’s methodology in its usual format. The basic contradictions in the development of AI&R technologies imply that there is to be a transition to a post-Turing methodology for assessing engineering implementations of artificial intelligence and robotics. In such implementations, on the one hand, the ‘Turing wall’ is removed, and on the other hand, artificial intelligence gets its physical implementation. (shrink)

Chatbots such as ChatGPT have the potential to change researchers’ lives in many ways. Despite all the advantages of chatbots, many challenges to using chatbots in medical research remain. Wrong and incorrect content presented by chatbots is a major possible disadvantage. The authors’ credibility could be tarnished if wrong content is presented in medical research. Additionally, ChatGPT, as the currently most popular generative AI, does not routinely present references for its answers. Double-checking references and resources used by chatbots might be (...) challenging. Researchers must also be careful not to harm copyright law or cause plagiarism issues using applications such as ChatGPT. Chatbots are trained on publicly available sources on the internet, increasing the risk of copyright or plagiarism issues. Therefore, chatbots such as ChatGPT should not be used routinely for professional medical research for now. However, further developments could make chatbots usable in medical research in the near future. (shrink)

This paper focuses on the epistemic situation one faces when using a Large Language Model based chatbot like ChatGPT: When reading the output of the chatbot, how should one decide whether or not to believe it? By surveying strategies we use with other, more familiar sources of information, I argue that chatbots present a novel challenge. This makes the question of how one could trust a chatbot especially vexing.

This article poses a simple question: can AI lie? In response to this question, the article examines, as its point of inquiry, popular AI chatbots, such as, ChatGPT. In doing so, an examination of the psychoanalytic, philosophical, and technological significance of AI and its complexities are located in relation to the dynamics of truth, falsity, and deception. That is, by critically exploring the chatbot’s capacity to engage in natural language conversations and deliver contextually relevant responses, it is argued that (...) what distinguishes the AI chatbot from anthropocentric discussions, which suggest a form of conscious awareness in AI, is the importance of the lie—an importance which a psychoanalytic approach can reveal. Indeed, while AI technologies undoubtedly blur the line between lies and truth-speaking, in the case of the AI chatbot, it is detailed how such technology remains unable to lie authentically; or, in other words, is unable to lie like a human. For psychoanalysis, the capacity to lie bears witness to the unconscious, and, thus, plays an important role in determining the subject. It is for this reason that rather than uncritically accepting the chatbot’s authority—an authority that is easily reflected in its honest responses and frank admissions—a psychoanalytic (Lacanian) perspective can highlight the significance of the unconscious as a distorting factor in determining the subject. To help elucidate this argument, specific attention is given to introducing and applying Lacan’s subject of enunciation and subject of the enunciated. This is used to assert that what continues (for now) to set us apart from AI technology is not necessarily our ‘better knowledge’, but our capability to consciously engage in acts of falsehood that function to reveal the social nuances and significances of the lie. (shrink)

The accession and implementation of new generation free trade agreements bring numerous opportunities as well as challenges to Viet Nam, regarding trade, labor and investment. The increasing number of workers abroad puts a pressure on Vietnamese government to support them in new working cultures and environments. The application of chatbot, which has been known to help certain vulnerable groups such as patients, women and migrants could be one of the tools to support Vietnamese migrant workers by providing immediate information, (...) network connection and consultation. Analyzing the results of the qualitative interviews with 11 migrant workers and the group discussion with two sections from three public social media groups and three active informants, the article argues that migrant workers as a vulnerable group who are supposed to be promising users of chatbot due to their great demand and needs, may have a complicated form of trust and expectation in chatbot. (shrink)

The article discusses the case of Microsoft's Twitter chatbot Tay that “turned into a Nazi” after less than 24 hours from its release on the Internet. The first section presents a brief recapitulation of Alan Turing's proposal for a test for artificial intelligence and the way it influenced subsequent discussions in the philosophy of mind. In the second section, I offer a few arguments appealing for caution regarding the identification of an accomplished chatbot as a thinking being. These (...) are motivated principally by Ludwig Wittgenstein's discussions of mind and soul and by some Wittgensteinian philosophers' criticisms of AI endeavours. I will try to show that it is very difficult, if not impossible, to make sense of AIs such as chatbots as thinking beings, rather independently of their technical perfection and accomplishment. In the third section, the case of the “Nazi chatbot” Tay will offer me material for some light to be shed on the peculiar character of our interconnected concepts of thinking, soul and person and on the importance of their further ramified connections. (shrink)

In human-chatbot interaction, users casually and regularly offend and abuse the chatbot they are interacting with. The current paper explores the relationship between chatbot humanlikeness on the one hand and sexual advances and verbal aggression by the user on the other hand. 283 conversations between the Cleverbot chatbot and its users were harvested and analysed. Our results showed higher counts of user verbal aggression and sexual comments towards Cleverbot when Cleverbot appeared more humanlike in its behaviour. (...) Caution is warranted with the interpretation of the results however as no experimental manipulation was conducted and causality can thus not be inferred. Nonetheless, the findings are relevant for both the research on the abuse of conversational agents, and the development of efficient approaches to discourage or prevent verbal aggression by chatbot users. (shrink)

En este ensayo, analizaré cómo el sujeto cibernético, los chatbots y el gólem artificial se relacionan entre sí y con el contexto histórico en el que surgen y se desarrollan en el cibermundo. El cibermundo es el escenario virtual y material donde se desarrollan las interacciones entre los sujetos cibernéticos y los dispositivos inteligentes que emplean la inteligencia artificial (IA) para comunicarse, aprender, crear y construir estrategia de saber- poder. Los conceptos de sujeto cibernético, chatbot y gólem artificial entran (...) en una interrelación dinámica en el cibermundo, generando reflexiones y produciendo debate filosófico sobre el sujeto cibernético ante la inteligencia artificial. (shrink)

Chatbots powered by large language models (LLMs) are increasingly capable of engaging in what seems like natural conversations with humans. This raises the question of whether we should interact with these chatbots in a morally considerate manner. In this chapter, we examine how to answer this question from within the normative framework of virtue ethics. In the literature, two kinds of virtue ethics arguments, the moral cultivation and the moral character argument, have been advanced to argue that we should afford (...) moral treatment to social robots. However, we propose a moral character argument against the view that we should afford moral treatment to LLM-based chatbots drawing on the notion of practical wisdom. Practical wisdom in this context consists in the skill to discern genuine and artificial sociality. Drawing on ideas from phenomenological philosophy, we argue that this involves the ability to distance oneself from direct social perception and the ability to widen one’s awareness over one’s apparently social interactions. We conclude by suggesting that this skill is a kind of technomoral wisdom required to live well with advanced, social AI systems. (shrink)

Natural language processing is a critical part of the digital transformation. NLP enables user-friendly interactions between machine and human by making computers understand human languages. Intelligent chatbot is an essential application of NLP to allow understanding of users’ utterance and responding in understandable sentences for specific applications simulating human-to-human conversations and interactions for problem solving or Q&As. This research studies emerging technologies for NLP-enabled intelligent chatbot development using a systematic patent analytic approach. Some intelligent text-mining techniques are applied, (...) including document term frequency analysis for key terminology extractions, clustering method for identifying the subdomains, and Latent Dirichlet Allocation for finding the key topics of patent set. This research utilizes the Derwent Innovation database as the main source for global intelligent chatbot patent retrievals. (shrink)

This study is intended to create an innovative contextual English learning environment making use of the widely used communication software, LINE ChatBot, based on the Artificial Intelligence Markup Language, in order to improve speaking and listening ability among learners. A total of 73 students were invited to participate in learning activities involving a 4-week English conversation exercise including both speaking and listening. Additionally, in order to explore the influence of competition on language acquisition, we added competition characteristics to the (...) learning activities in the experimental group to enhance learning motivation and learning outcomes. The results showed that with the help of the LINE ChatBot contextual learning environment, the performance of both groups of students was slightly enhanced, but no significant differences were found. Meanwhile, extrinsic motivation in both the experimental and control group was improved if they spoke anonymously. That is, the contextual learning environment based on the LINE ChatBot significantly improved the learners’ English speaking and listening ability. In addition, the results showed that the addition of a competition element effectively enhanced the learners’ intrinsic motivation to learn English on the LINE ChatBot. (shrink)

In 2023, online search engine provider Microsoft integrated a language model that provides direct answers to search queries into its search engine Bing. Shortly afterwards, Google also introduced a similar feature to its search engine with the launch of Google Gemini. This introduction of direct answers to search queries signals an important and significant change in online search. This article explores the implications of this new search paradigm. Drawing on Donna Haraway’s theory of _Situated Knowledges_ and Rainer Mühlhoff’s concept of (...) _Sealed Surfaces_, I introduce the term _Sealed Knowledges_ to draw attention to the increasingly difficult access to the plurality of potential answers to search queries through the output of a singular, authoritative, and plausible text paragraph. I argue that the integration of language models for the provision of direct answers into search engines is based on a de-situated and disembodied understanding of knowledge and affects the subjectivities of its users. At the same time, the _sealing of knowledges_ can lead to an increasing spread of misinformation and may make marginalized knowledge increasingly difficult to find. The paper concludes with an outlook on how to resist the increasing _sealing of knowledges_ in online search. (shrink)

Digital records, from chat transcripts to social media posts, are being used to create chatbots that recreate the conversational style of deceased individuals. Some maintain that this is merely a new form of digital memorial, while others argue that they pose a variety of moral hazards. To resolve this, I turn to classical Chinese philosophy to make use of a debate over the ethics of funerals and mourning. This ancient argument includes much of interest for the contemporary issue at hand, (...) including the use of impersonators of the dead to help the bereaved to deal well with their grief. I connect this historical discussion with a modern trend in clinical psychology that reframes therapeutic interventions with bereaved individuals. The trend directs practitioners away from facilitating detachment and toward affirming continuing bonds. I conclude that these chatbots can offer an important source of support to mourners, but also discuss parameters and features of social context that will be important to avoid the moral hazards identified by sceptics. (shrink)

To support older users’ accessibility and learning of the prevalent information and communication technologies, libraries, as informal learning institutes, are committed to information literacy education activities with friendly interfaces. Chatbots using Voice User Interfaces with natural and intuitive interactions have received growing research and practical attention; however, older users report regular frustrations and problems in using them. To serve as a basis for the subsequent design and development of an automated dialog mechanism in senior-friendly chatbots, a between-subject user experiment was (...) conducted with 30 older adults divided into three groups. The preliminary findings on their interactions with the voice chatbots designed with different error handling strategies were reported. Participants’ behavioral patterns, performances, and the tactics they employed in interacting with the three types of chatbots were analyzed. The results of the study showed that the use of multiple error handling strategies is beneficial for older users to achieve effectiveness and satisfaction in human-robot interactions, and facilitate their attitude toward information technology. This study contributes empirical evidence in the genuine and pragmatic field of gerontechnology and expands upon voice chatbots research by exploring conversation errors in human-robot interactions that could be of further application in designing educational and living gerontechnology. (shrink)

Large Language Models (LLMs) like ChatGPT were trained on human conversation, but in the future they will also train us. As chatbots speak from our smartphones and customer service helplines, they will become a part of everyday life and a growing share of all the conversations we ever have. It’s hard to doubt this will have some effect on us. Here I explore a specific concern about the impact of artificial conversation on our capacity to deliberate and hold ourselves accountable (...) to reason – that is, to be autonomous, in Kant’s sense of the term. I develop ideas from psychologist Jean Piaget to show how chatbots are autonomy traps: their deference to our commands tempts us into venting authoritarian whims, ultimately weakening our own self-control. I argue that the Kantian tradition, including Piaget and sociologist Emile Durkheim, offers powerful conceptual resources for resisting this slide. But it will require us to do something that may seem bizarre: we will need to treat mindless chatbots as if they are autonomous persons too. (shrink)

Information of high evidentiary quality plays a crucial role in forensic investigations. Research shows that information provided by witnesses and victims often provide major leads to an inquiry. As such, statements should be obtained in the shortest possible time following an incident. However, this is not achieved in many incidents due to demands on resources. This intersectional study examined the effectiveness of a chatbot (the AICI), that uses artificial intelligence (AI) and a cognitive interview (CI) to help record statements (...) following an incident. After viewing a sexual harassment video, the present study tested recall accuracy in participants using AICI compared to other tools (i.e., Free Recall, CI Questionnaire, and CI Basic Chatbot). Measuring correct items (including descriptive items) and incorrect items (errors and confabulations), it was found that the AI CI elicited more accurate information than the other tools. The implications on society include AI CI provides an alternative means of effectively and efficiently recording high-quality evidential statements from victims and witnesses. (shrink)

The development and deployment of chatbot technology, while spanning decades and employing different techniques, require innovative frameworks to understand and interrogate their functionality and implications. A mere technocentric account of the evolution of chatbot technology does not fully illuminate how conversational systems are embedded in societal dynamics. This study presents a structured examination of chatbots across three societal dimensions, highlighting their roles as objects of scientific research, commercial instruments, and agents of intimate interaction. Through furnishing a dimensional framework (...) for the evolution of conversational systems — from laboratories to marketplaces to private lives— this article contributes to the wider scholarly inquiry of chatbot technology and its impact in lived human experiences and dynamics. (shrink)

Ethically significant consequences of artificially intelligent artifacts will stem from their effects on existing social relations. Artifacts will serve in a variety of socially important roles—as personal companions, in the service of elderly and infirm people, in commercial, educational, and other socially sensitive contexts. The inevitable disruptions that these technologies will cause to social norms, institutions, and communities warrant careful consideration. As we begin to assess these effects, reflection on degrees and kinds of social agency will be required to make (...) properly informed decisions concerning the deployment of artificially intelligent artifacts in important settings. The social agency of these systems is unlike a human social agency, and this paper provides a methodological framework that is more suited for inquiry into artificial social agents than conventional philosophical treatments of the concept of agency. Separate aspects and dimensions of agency can be studied without assuming that agency must always look like adult human agency. This revised approach to the agency of artifacts is conducive to progress in the topics studied by AI ethics. (shrink)

This article explores questions about chatbots in particular and artificial intelligence (AI) in general from a Pauline, that is, a Christian theological perspective. It does so in a way that focuses on a particular scene in the New Testament: Paul in the Athenian Areopagus, considering an altar to an “unknown God,” quoting Greek poets and philosophers, and sharing curious theology as he dialogues with Stoic and Epicurean thinkers (Acts 17:16–34). By examining the sociohistorical nuances of this scene and their philosophical (...) and theological implications, this article shows how the altar Paul considers philosophically and theologically becomes the focal point for an important dialogue about apocalyptic ends, or ideas about who we are, where we are going, and who or what is responsible for that who‐ness and where‐ness. In turn, this can teach us how to ask practical questions, which can uncover the unsuspected apocalyptic ends represented by, or even contained within, common technological objects such as chatbots. (shrink)

Mental health chatbots (MHCBs) designed to support individuals in coping with mental health issues are rapidly advancing. Currently, these MHCBs are predominantly used in commercial rather than clinical contexts, but this might change soon. The question is whether this use is ethically desirable. This paper addresses a critical yet understudied concern: assuming that MHCBs cannot have genuine emotions, how this assumption may affect psychotherapy, and consequently the quality of treatment outcomes. We argue that if MHCBs lack emotions, they cannot have (...) genuine (affective) empathy or utilise countertransference. Consequently, this gives reason to worry that MHCBs are (a) more liable to harm and (b) less likely to benefit patients than human therapists. We discuss some responses to this worry and conclude that further empirical research is necessary to determine whether these worries are valid. We conclude that, even if these worries are valid, it does not mean that we should never use MHCBs. By discussing the broader ethical debate on the clinical use of chatbots, we point towards how further research can help us establish ethical boundaries for how we should use mental health chatbots. (shrink)

Due to huge advancements in natural language processing (NLP) and machine learning, chatbots are gaining significance in the field of customer service. For users, it may be hard to distinguish whether they are communicating with a human or a chatbot. This brings ethical issues, as users have the right to know who or what they are interacting with (European Commission in Regulatory framework proposal on artificial intelligence. https://digital-strategy.ec.europa.eu/en/policies/regulatory-framework-ai, 2022). One of the solutions is to include a disclosure at the (...) start of the interaction (e.g., “this is a chatbot”). However, companies are reluctant to use disclosures, as consumers may perceive artificial agents as less knowledgeable and empathetic than their human counterparts (Luo et al. in Market Sci 38(6):937–947, 2019). The current mixed methods study, combining qualitative interviews (n = 8) and a quantitative experiment (n = 194), delves into users’ responses to a disclosed vs. undisclosed customer service chatbot, focusing on source orientation, anthropomorphism, and social presence. The qualitative interviews reveal that it is the willingness to help the customer and the friendly tone of voice that matters to the users, regardless of the artificial status of the customer care representative. The experiment did not show significant effects of the disclosure (vs. non-disclosure). Implications for research, legislators and businesses are discussed. (shrink)

Interactions between humans and machines that include artificial intelligence are increasingly common in nearly all areas of life. Meanwhile, AI-products are increasingly endowed with emotional characteristics. That is, they are designed and trained to elicit emotions in humans, to recognize human emotions and, sometimes, to simulate emotions (EAI). The introduction of such systems in our lives is met with some criticism. There is a rather strong intuition that there is something wrong about getting attached to a machine, about having certain (...) emotions towards it, and about getting involved in a kind of affective relationship with it. In this paper, I want to tackle these worries by focusing on the last aspect: in what sense could it be problematic or even wrong to establish an emotional relationship with EAI-systems? I want to show that the justifications for the widespread intuition concerning the problems are not as strong as they seem at first sight. To do so, I discuss three arguments: the argument from self-deception, the argument from lack of mutuality, and the argument from moral negligence. (shrink)

Fiction is an important tool in an artist/designer/developer’s vocabulary, but its usage is polyvalent. Speculative research in this article introduces the ‘rudiment’ to embrace the undeveloped and the improvisory phases of research practice. Fiction is used to reflect on the ways practicing designers and developers might already engage in misanthropic thinking – involving automated technologies. Tracing the misanthropic agencies in relation to automated technologies contributes to expanding the ways designers and developers reflect on the technical potential of their designs, with (...) whom they are designing (and for) and the way they understand their reflexive self. Bringing together Colson Whitehead’s novel The Intuitionist (1999) and its account of an elevator crash, their design and maintenance, with a narrative account of software agents enables an investigation into the promises made through a design-for-the-prevention-of-failure imperative. These examples highlight the relation between physical and non-physical failures such as failures to connect or to create intimacy. Those who contribute to designing in this article get caught up in configuring misanthropic agencies involving themselves, the designed artefact and the spaces they both inhabit be that an elevator in a housing block, or a sexbot in an online chat room. I will argue that the misanthropic agencies of automated technologies can have a confining impact on our emergent modes of design. Automated software operating in virtual spaces are confining in as much as they attempt to connect things to exploit the de-personalized aspects of automated, misanthropic agency. (shrink)

Don Ihde’s alterity relation focuses on the quasi-otherness of dynamic technologies that interact with humans. The alterity relation is one means to study relations between humans and artificial intelligence (AI) systems. However, research on alterity relations has not defined the difference between playing with a toy, using a computer, and interacting with a social robot or chatbot. We suggest that Ihde’s quasi-other concept fails to account for the interactivity, autonomy, and adaptability of social robots and chatbots, which more closely (...) approach human alterity. In this article, we will examine experiences with a chatbot, Replika, and a humanoid robot, a RealDoll, to show how some users experience AI systems as companions. First, we show that the perception of social robots and chatbots as intimate companions is grounded in communication. Advances in natural language processing (NLP) and natural language generation (NLG) allow a relationship to form between some users and social robots and chatbots. In this relationship, some users experience social robots and chatbots as more than quasi-others. We will use Kanemitsu’s another-other concept to analyze cases where social robots and chatbots should be distinguished from quasi-others. (shrink)

Exploring the relationship between humans and AI chatbots, as well as the ethical concerns surrounding their use, this paper argues that our relations with chatbots are not solely based on their function as a source of knowledge, but, rather, on the desire for the subject not to know. It is argued that, outside of the very fears and anxieties that underscore our adoption of AI, the desire not to know reveals the potential to embrace the very loss AI avers. Consequently, (...) rather than proposing a knowledge that seeks to disavow loss, we can instead recognize the potential in loss itself: an opportunity to assert and define the gap inherent to both the subject and AI we create. (shrink)

One in three university students experiences mental health problems during their study. A similar percentage leaves higher education without obtaining the degree for which they enrolled. Research suggests that both mental health problems and academic underperformance could be caused by students lacking control and purpose while they are adjusting to tertiary education. Currently, universities are not designed to cater to all the personal needs and mental health problems of large numbers of students at the start of their studies. Within the (...) literature aimed at preventing mental health problems among students (e.g., anxiety or depression), digital forms of therapy recently have been suggested as potentially scalable solutions to address these problems. Integrative psychological artificial intelligence (AI) in the form of a chatbot, for example, shows great potential as an evidence-based solution. At the same time, within the literature aimed at improving academic success, the online life-crafting intervention in which students write about values and passions, goals, and goal-attainment plans has shown to improve the academic performance and retention rates of students. Because the life-crafting intervention is delivered through the curriculum and doesn’t bear the stigma that is associated with therapy, it can reach larger populations of students. But life-crafting lacks the means for follow-up or the interactiveness that online AI-guided therapy can offer. In this paper, we propose to integrate the current literature on chatbot interventions aimed at the mental health of students with research about a life-crafting intervention that uses an inclusive curriculum-wide approach. When a chatbot asks students to prioritize both academic as well as social and health-related goals and provides personalized follow-up coaching, this can prevent -often interrelated- academic and mental health problems. Right on-time delivery, and personalized follow-up questions enhance the effects of both -originally separated- intervention types. Research on this new combination of interventions should use design principles that increase user-friendliness and monitor the technology acceptance of its participants. (shrink)

Fast jeder hat Erfahrungen mit Siri, Alexa oder anderen Chatbots. Doch was geschieht, wenn ein Mensch einen Chatbot in einen Dialog über Philosophie verwickelt? Kann man mit künstlichen Intelligenzen (KI) überhaupt über Bewusstsein, Erinnerung und philosophische Theorien der Zeit diskutieren? -/- Ja, man kann – zumindest der Form nach. Und das gleich zweimal: Mit den beiden für den Loebner-Preis für KI dekorierten Chatbots Rose und Mitsuku. Ob das geistreich ist? Das muss jeder für sich entscheiden. Ob das unterhaltsam ist? (...) Ja – allerdings eher unfreiwillig. Im systematischen Teil des Essays werden die Dialoge ausgewertet. Dabei wird der gegenwärtige Hype um KI als maßlose Übertreibung sichtbar, ein Goldrausch der KI gewissermaßen, übrigens von Menschen und ihren allzu menschlichen Interessen veranlasst. -/- Die Begriffe rund um das Thema KI werden im Buch weggeholt von der Behauptung der Singularität, der Disruption oder der versteckten Science Fiction – zurück auf den Boden der funktionalen Tatsachen einer gleichwohl beachtlichen Innovationsspirale: Automatisierung, Standardisierung und maschinelles Verarbeiten von großen Echtzeit-Daten sind aktuell die sachgemäßen Beschreibungen des gegenwärtigen KI-Rauschs. Doch eigentlich geht es beim KI-Rausch um etwas anderes: Die Maschinisierung des Menschen durch Standardisierung, Automatisierung und verbesserte Kontrolle zur fortschreitenden Ökonomisierung aller Lebensbereiche, ermöglicht durch Algorithmen, Datafizierung und digitale Technologie in bisher ungeahnter Wirkmächtigkeit. -/- Der Essay enthält dazu fünf Thesen: -/- These 1: Maschinen werden immer effizienter im Automatisieren – oder: die Automatisierung der Automatisierung -/- These 2: Trotz Automatisierung der Automatisierung: Maschinen sind nicht geistreich intelligent -/- These 3: Menschen werden als Datenhaufen ausgemessen – und damit zu Datenhaufen gemacht -/- These 4: Datenhaufen quo vadis? Von der Präferenz-Erfassung zum „hackable animal“ -/- These 5: Synthese = Die Maschinisierung der Menschen – zur Bahnung der KI -/- Fazit: Mit den künstlichen Intelligenzen verhält es sich wie mit künstlichen Tränen: Sie erfüllen einen instrumentellen Zweck, der aber in keiner Weise mit jenen schillernden Gefühlen verbunden ist, die wir in Freude oder Trauer empfinden – und die uns zum Menschen machen. Alles andere ist Budenzauber oder Desinformation. -/- STIMMEN ZUM BUCH “Wir sollten die Ethik und Nachhaltigkeit der Digitalisierung noch viel ausführlicher erforschen. Dieses Buch ist ein provokativer Beitrag dazu.” -/- Dr. Matthias Stürmer, Leiter Forschungsstelle Digitale Nachhaltigkeit am Institut für Informatik der Universität Bern. (shrink)

The present narrative review seeks to unravel where we are now, and where we need to go to delineate the active ingredients in psychotherapy delivered by conversational agents (e.g., chatbots). While psychotherapy delivered by conversational agents has shown promising effectiveness for depression, anxiety, and psychological distress across several randomized controlled trials, little emphasis has been placed on the therapeutic processes in these interventions. The theoretical framework of this narrative review is grounded in prominent perspectives on the active ingredients in psychotherapy. (...) Based on search terms derived from various theoretical perspectives, we conducted a systematic literature search of four scientific databases and identified 17 studies. Across the selected studies, three themes emerged: relationship variables, emotional venting, and cognitive factors. While methodological issues compromise the epistemic value of this evidence base, core questions also remain to be answered. Such questions include, but are not limited to, whether humans can form affectionate bonds to inanimate beings and whether these kind of mental health treatments should be understood as psychotherapy or something else. Researchers should therefore be cautious when applying theories of psychotherapy in the realm of conversational agents. We conclude the paper by introducing recommendations for future research, which we hope will help instigate methodologically sound studies in this field. (shrink)

From the deployment of chatbots as procurement negotiators by corporations such as Walmart to autonomous agents providing ‘differentiated chat’ for managing overbooked flights, synthetic media are making the world of logistics their ‘natural’ habitat. Here, the coordination of commodities, parts and labour design the problems and produce the training sets from which ‘solutions’ can be synthesised. But to what extent might synthetic media, surfacing via platforms such as Midjourney and OpenAI, be understood as logistical media? This paper charts a selective (...) genealogy of synthetic media from early attempts to synthesise human sensory capacities in order to cybernetically integrate them into computational circuits. We see this integration as a pre-emption of their (computational) logistical coordination. It then details media experiments with ‘ChatFOS’, a GPT-based bot tasked with developing a logistics design business. Using its prompt-generated media outputs, we assemble a simulation and parody of AI’s emerging functionalities within logistical worlds. In the process, and with ‘human-in-the-loop’ stitching, we illustrate how large language models become media managers overseeing image prompts, graphical design, website code, promotional copy and investor pitch scenarios. The processes and methods of producing speculative scenarios via ChatFOS lead us to consider how the media of logistics and the logistics of media are increasingly enfolded. We ask: what can a (practice-based) articulation of this double-becoming of logistics and synthetic mediality tell us about the politics and aesthetics of contemporary computation and capital? (shrink)

Griefbots are chatbots designed to assist individuals in coping with the loss of a loved one by offering a digital replica of the departed. Navigating grief is a deeply transformative and vulnerable journey intricately tied to one's well-being. Do griefbots aid in the grieving process, or do they complicate it? To address these questions, this article blends insights from philosophy and neuroscience to explore the nature of grief as a means to clarify the ethical dimensions surrounding the use of griefbots.

Despite chatbots’ increasing popularity, firms often fail to fully achieve their benefits because of their underutilization. We argue that ethical concerns dealing with chatbot-related privacy and security may prevent firms from developing a culture of embracing chatbot use and fully integrating chatbots into their workflows. Our research draws upon the stimulus-organism-response theory (SOR) and a study by Floridi et al. (Minds and Machines, 28:689–707, 2018 ) on the ethical artificial intelligence framework to investigate how chatbot affordances can (...) foster employees’ positive perceptions of privacy protection and security, which may increase perceived ethics in beneficence and ultimately support recommendation intentions. To validate our proposed research model and provide a robust understanding of chatbot-related ethics, we conducted two studies following a mixed-methods design. We used Study 1 as the quantitative phase to collect survey data from full-time marketing employees, and the results provided strong support for our research model based on the relevant theory and literature. We used Study 2 as the qualitative phase to collect interview data to further validate our research model, and the results confirmed Study 1’s quantitative findings and provided complementary insights into the phenomenon of interest. Our studies contribute to the literature by providing initial insights into chatbot-related ethics through the exploration of chatbot affordances, security, and privacy protection as the antecedents and through depictions of how these variables foster employees’ perceived ethics in beneficence and recommendation intention. Our results can inform practitioners how to develop ethics involving chatbots and promote a chatbot-friendly culture such that firms can fully achieve chatbots’ benefits and can thus increase their competitive advantages in emerging chatbot marketing. (shrink)

Advances in applications of artificial intelligence and the use of data analytics technology in biomedicine are creating optimism, as many believe these technologies will fill the need-availability gap by increasing resources for mental health care. One resource considered especially promising is smartphone psychotherapy chatbots, i.e., artificially intelligent bots that offer cognitive behavior therapy to their users with the aim of helping them improve their mental health. While a number of studies have highlighted the positive outcomes of using smartphone psychotherapy chatbots (...) to handle various anxiety related problems no conclusive data illustrate their effectiveness or warrant their use in mental illness diagnosis and treatment settings. Yet smartphone psychotherapy is highly endorsed by experts in the field of mental health research. In this paper, I focus on the specific features of smartphone psychotherapy chatbots intended for the diagnosis and treatment of mental illness and criticize three popular promises; i.e., they enable early diagnosis and intervention through digital phenotyping; they defy the stigma of mental illness diagnosis and treatment; they offer increased access to mental health treatment globally. Going against the popular enthusiasm, I argue smartphone psychotherapy chatbots have epistemic and ethical limitations in the diagnosis and treatment of illnesses. In light of these, I encourage researchers, clinicians, policy makers, patients, and caregivers to pause before jumping on the artificial intelligence bandwagon to seek solutions for mental illness on the grounds of these three promises. (shrink)