Background:Stress can frequently occur in the driving context. Its cognitive effects can be deleterious and lead to uncomfortable or risky situations. While stress detection in this context is well developed, regulation using dedicated advanced driver-assistance systems (ADAS) is still emergent.Objectives:This systematic review focuses on stress regulation strategies that can be qualified as “subtle” or “mindless”: the technology employed to perform regulation does not interfere with an ongoing task. The review goal is 2-fold: establishing the state of the (...) art on such technological implementation in the driving context and identifying complementary technologies relying on subtle regulation that could be applied in driving.Methods:A systematic review was conducted using search operators previously identified through a concept analysis. The patents and scientific studies selected provide an overview of actual and potential mindless technology implementations. These are then analyzed from a scientific perspective. A classification of results was performed according to the different stages of emotion regulation proposed by the Gross model.Results:A total of 47 publications were retrieved, including 21 patents and 26 studies. Six of the studies investigated mindless stress regulation in the driving context. Patents implemented strategies mostly linked to attentional deployment, while studies tended to investigate response modulation strategies.Conclusions:This review allowed us to identify several ADAS relying on mindless computing technologies to reduce stress and better understand the underlying mechanisms allowing stress reduction. Further studies are necessary to better grasp the effect of mindless technologies on driving safety. However, we have established the feasibility of their implementation as ADAS and proposed directions for future research in this field. (shrink)

The interdisciplinary research area Cognitive Interaction Technology (CIT) aims to understand and support interactions between human users and other elements of socio-technical systems. Important reasons for the new interest in understanding CIT in sport psychology are the impressive development of cognitive robotics and advanced technologies such as virtual or augmented reality systems, cognitive glasses or neurotechnology settings. The present article outlines this area of research, addresses ethical issues, and presents an empirical study in the context (...) of a new measurement and assessment system for training in karate. Recent advances in the field of cognitive assistance systems enabled largely automatized assessments of individual mental representation structures for action sequences, such as choreographed movement patterns in dance or martial arts. Empirical investigations with karate practitioners of different skill levels demonstrate that advanced software-based survey and algorithmic analysis procedures based on cognitive models generate individualized performance predictions for a movement sequence from theKanku-dai kata(a pre-defined karate movement sequence), which correlated significantly not only with formal expertise (kyu/danrank) but also with the actual likelihood of mistakes in action execution. This information could prospectively be used to define individual training goals for deliberate practice and incorporated into cognitive interaction technology to provide appropriate feedback. We argue that the development of cognitive interaction systems for sport should explicitly take ethical issues into consideration and present a particular developed engineering approach. The potential benefits of such an assistance system for intermediate and advanced practitioners include more effective and flexible practice, as well as supportive effects, and more flexible training schedules. Furthermore, we argue that researchers from the field of sport psychology can benefit from advances in technological systems that enhance the understanding of mental and motor control in skilled voluntary action. (shrink)

The number of people with dementia is increasing worldwide. At the same time, family and professional caregivers’ resources are limited. A promising approach to relieve these carers’ burden and assist people with dementia is assistive technology. In order to be useful and accepted, such technologies need to respect the values and needs of their intended users. We applied the value sensitive design approach to identify values and needs of patients with dementia and family and professional caregivers in respect to assistive (...) technologies to assist people with dementia in institutionalized care. Based on semi-structured interviews of residents/patients with cognitive impairment, relatives, and healthcare professionals (10 each), we identified 44 values summarized by 18 core values. From these values, we created a values’ network to demonstrate the interplay between the values. The core of this network was caring and empathy as most strongly interacting value. Furthermore, we found 36 needs for assistance belonging to the four action fields of activity, care, management/administration, and nursing. Based on these values and needs for assistance, we created possible use cases for assistive technologies in each of the identified four action fields. All these use cases already are technologically feasible today but are not currently being used in healthcare facilities. This underlines the need for development of value-based technologies to ensure not only technological feasibility but also acceptance and implementation of assistive technologies. Our results help balance conflicting values and provide concrete suggestions for how engineers and designers can incorporate values into assistive technologies. (shrink)

Recent times have seen increasing interest in conversational assistants (e.g., Amazon Alexa) designed to help users in their daily tasks. In military settings, it is critical to design assistants that are, simultaneously, helpful and able to minimize the user’s cognitive load. Here we show that embodiment plays a key role in achieving that goal. We present an experiment where participants engaged in the desert survival task in augmented reality. Participants were paired with a voice assistant, an embodied assistant, or (...) no assistant. The assistants made suggestions verbally throughout the task, whereas the embodied assistant further used gestures and emotion to communicate with the user. Our results indicate that both assistant conditions led to higher performance over the no assistant condition, but the embodied assistant achieved this with less cognitive burden on the decision maker than the non-embodied assistant. We discuss implications for the design of intelligent collaborative systems for the warfighter. (shrink)

This study examined the effects of computer-assisted cognitive rehabilitation in a group of 16 brain-damaged patients. Therapeutic effectiveness was assessed by improvement on computer tasks, the results of neuropsychological tests and quality of life ratings. Participants suffered from mild to moderate attention and memory problems or aphasia. The procedure involved baseline assessment, a 15-week course of therapy conducted twice a week and posttest. Neuropsychological tests assessing attention, memory and language problems and quality of life ratings were administered twice: in (...) pre- and posttests. Twelve healthy controls were also examined twice using the same battery of neuropsychological tests. The RehaCom program and the Polish computer therapy program for aphasics called Afa-System were used for rehabilitation. The computer-assisted rehabilitation tasks were selected individually for each patient. The results showed significant improvement on computer-assisted tasks in all braindamaged subjects. However, none or very little improvement was observed on neuropsychological tests and quality of life ratings. The results of the study confirm the importance of using different types of measures to estimate the effectiveness of computer-assisted neuropsychological rehabilitation as well as the necessity of applying various kinds of therapy to improve cognitive, emotional and social functioning in brain-damaged patients. (shrink)

The use of cognitive systems like pattern recognition or video tracking technology in security applications is becoming ever more common. The paper considers cases in which the cognitive systems are meant to assist human tasks by providing information, but the final decision is left to the human. All these systems and their various applications have a common feature: an intrinsic difference in how a situation or an event is assessed by a human being and a (...) cognitive system. This difference, which here is named “the model gap,” is analyzed pertaining to its epistemic role and its ethical consequences. The main results are as follows: (1) The model gap is not a problem, which might be solved by future research, but the central feature of cognitive systems. (2) The model gap appears on two levels: the aspects of the world, which are evaluated, and the way they are processed. This leads to changes in central concepts. While differences on the first level often are the very reason for the deployment of cognitive systems, the latter is hard to notice and often goes unreflected. (3) Such a missing reflection is ethically problematic because the human is meant to give the final judgment. It is particularly problematic in security applications where it might lead to a conflation of descriptive and normative concepts. (4) The idea of the human operator having the last word is based on an assumption of independent judgment. This assumption is flawed for two reasons: The cognitive system and the human operators form a “hybrid system” the components of which cannot be assessed independently; and additional modes of judgment might pose new ethical problems. (shrink)

The prevailing discourse around AI ethics lacks the language and formalism necessary to capture the diverse ethical concerns that emerge when AI systems interact with individuals. Drawing on Sen and Nussbaum’s capability approach, we present a framework formalizing a network of ethical concepts and entitlements necessary for AI systems to confer meaningful benefit or assistance to stakeholders. Such systems enhance stakeholders’ ability to advance their life plans and well-being while upholding their fundamental rights. We characterize two (...) necessary conditions for morally permissible interactions between AI systems and those impacted by their functioning, and two sufficient conditions for realizing the ideal of meaningful benefit. We then contrast this ideal with several salient failure modes, namely, forms of social interactions that constitute unjustified paternalism, coercion, deception, exploitation and domination. The proliferation of incidents involving AI in high-stakes domains underscores the gravity of these issues and the imperative to take an ethics-led approach to AI systems from their inception. (shrink)

Interactive adaptive systems increasingly become part of our everyday life. Which factors could shape this development and under which conditions will interactions with technical systems be deemed socially appropriate? The "FActors of Social Appropriateness" (FASA) Model presented in this Open Access-book provides a structured approach to our understanding of social appropriateness in human-technology interaction. The FASA Model serves to inform design choices for sociosensitive and socioactive artificial assistants.

Resumen: El presente trabajo analiza si los Sistemas de apoyo a la decisión (DSSs) y otros asistentes para su uso, como las Reflection machines o los Personal Assistants that Learn (PAL), contribuyen de hecho a una mejora cognitiva, como habitualmente se tiende a asumir. Es decir, se examina si su potencial para expandir e impulsar la acción de las facultades cognoscitivas se ve efectivamente actualizado y, en consecuencia, si sirven para reafirmar el sentido capacitante de la IA y la extensión (...) de la agencia del sujeto a través de ella. Para ello, se pone de manifiesto que el diseño y aplicación de estos sistemas están mediados por una comprensión del conocimiento que actúa a modo de marco que limita sus posibilidades de mejorar las capacidades cognoscitivas humanas. Se analizan las condiciones en que la mejora cognitiva es posible a través del uso de estos sistemas, que remiten a una aproximación integradora que no tiene en cuenta solo el factor tecnológico, sino que repara en cómo, en su uso, intervienen factores gnoseológicos, así como psicológicos y sociológicos, que median en la capacidad efectiva de estos sistemas de ampliar las facultades de conocimiento, y de los que las tecnologías se sirven para ejercer su influencia. Abstract: The present article questions whether Decision Support Systems (DSSs) and other assistants for their use, such as Reflection machines or Personal Assistants that Learn (PAL), do in fact contribute to cognitive enhancement, as it is usually taken for granted. In other words, it is analysed whether their potential to effectively expand or augment cognitive capacities is actualised and, therefore, if the capabilities and the agency of the person appear in fact extended through artificial intelligence. For that purpose, it is highlighted that the design and implementation of AI systems are dependent on a certain understanding of human knowledge that acts as a framework that limits their actual capacity to enhance the cognitive faculties of the mind. The conditions under which this cognitive enhancement is possible through these systems are analysed and require an integrative approach that not only takes technology into account but realises that, in its use, gnoseological, as well as psychological and sociological factors are involved and mediate in the actual capacity of these systems to extend cognitive functions. These factors are also crucial for these technologies to exert their influence. (shrink)

Cognitive technology is an umbrella term sometimes used to designate the realm of technologies that assist, augment or simulate cognitive processes or that can be used for the achievement of cognitive aims. This technological macro-domain encompasses both devices that directly interface the human brain as well as external systems that use artificial intelligence to simulate or assist (aspects of) human cognition. As they hold the promise of assisting and augmenting human cognitive capabilities both individually and (...) collectively, cognitive technologies could produce, in the next decades, a significant effect on human cultural evolution. At the same time, due to their dual-use potential, they are vulnerable to being coopted by State and non-State actors for non-benign purposes (e.g. cyberterrorism, cyberwarfare and mass surveillance) or in manners that violate democratic values and principles. Therefore, it is the responsibility of technology governance bodies to align the future of cognitive technology with democratic principles such as individual freedom, avoidance of centralized, equality of opportunity and open development. This paper provides a preliminary description of an approach to the democratization of cognitive technologies based on six normative ethical principles: avoidance of centralized control, openness, transparency, inclusiveness, user-centeredness and convergence. This approach is designed to universalize and evenly distribute the potential benefits of cognitive technology and mitigate the risk that such emerging technological trend could be coopted by State or non-State actors in ways that are inconsistent with the principles of liberal democracy or detrimental to individuals and groups. (shrink)

Classic studies in human sensorimotor control use simplified tasks to uncover fundamental control strategies employed by the nervous system. Such simple tasks are critical for isolating specific features of motor, sensory, or cognitive processes, and for inferring causality between these features and observed behavioral changes. However, it remains unclear how these theories translate to complex sensorimotor tasks or to natural behaviors. Part of the difficulty in performing such experiments has been the lack of appropriate tools for measuring complex motor (...) skills in real-world contexts. Robot-assisted surgery (RAS) provides an opportunity to overcome these challenges by enabling unobtrusive measurements of user behavior. In addition, a continuum of tasks with varying complexity – from simple tasks such as those in classic studies to highly complex tasks such as a surgical procedure – can be studied using RAS platforms. Finally, RAS includes a diverse participant population of inexperienced users all the way to expert surgeons. In this perspective, we illustrate how the characteristics of RAS systems make them compelling platforms to extend many theories in human neuroscience, as well as, to develop new theories altogether. (shrink)

This study proposed a children’s digital art ability training system with artificial intelligence-assisted learning, which was designed to achieve the goal of improving children’s drawing ability. AI technology was introduced for outline recognition, hue color matching, and color ratio calculation to machine train students’ cognition of chromatics, and smart glasses were used to view actual augmented reality paintings to enhance the effectiveness of improving elementary school students’ imagination and painting performance through the diversified stimulation of colors. This study adopted the (...) quasi-experimental research method and designs the pre-test and post-test for different groups. The research subjects are the Grade 4 students of an elementary school in Taitung City, Taiwan. The test tools included an imagination test and an evaluation of painting performance ability. The test results of a total of 30 students before and after the experiment included the experimental group that received the children’s digital art ability training system with AI-assisted learning and 30 students in the control group that had not received the teaching were analyzed by covariance. These results were supplemented by the description and interpretation of student feedback, teachers’ reflection notes, and other qualitative data to understand the performance of the students in the experimental group in terms of imagination and painting performance. (shrink)

We propose an AI-assisted design concept exploration tool, the “Character Space Construction”. Concept designers explore and articulate the target product aesthetics and semantics in language, which is expressed using “Design Concept Phrases”, that is, compound adjective phrases, and contrasting terms that convey what are not their target design concepts. Designers often utilize this dichotomy technique to communicate the nature of their aesthetic and semantic design concepts with stakeholders, especially in an early design development phase. The CSC assists this designers' (...) class='Hi'>cognitive activity by constructing a “Character Space”, which is a semantic quadrant system, in a structured manner. A CS created by designers with the assistance of the CSC enables them to discern and explain their design concepts in contrast with opposing terms. These terms in a CS are retrieved and combined in the CSC by using a knowledge graph. The CSC presents terms and phrases as lists of candidates to users from which users will choose in order to define the target design concept, which is then visualized in a CS. The participants in our experiment, who were in the “arts and design” profession, were given two conditions under which to create DCPs and explain them. One group created and explained the DCPs with the assistance of the proposed CSC, and the other did the same task without this assistance, given the freedom to use any publicly available web search tools instead. The result showed that the group assisted by the CSC indicated their tasks were supported significantly better, especially in exploration, as measured by the Creativity Support Index. (shrink)

Personal AI assistants are now nearly ubiquitous. Every leading smartphone operating system comes with a personal AI assistant that promises to help you with basic cognitive tasks: searching, planning, messaging, scheduling and so on. Usage of such devices is effectively a form of algorithmic outsourcing: getting a smart algorithm to do something on your behalf. Many have expressed concerns about this algorithmic outsourcing. They claim that it is dehumanising, leads to cognitive degeneration, and robs us of our freedom (...) and autonomy. Some people have a more subtle view, arguing that it is problematic in those cases where its use may degrade important interpersonal virtues. In this article, I assess these objections to the use of AI assistants. I will argue that the ethics of their use is complex. There are no quick fixes or knockdown objections to the practice, but there are some legitimate concerns. By carefully analysing and evaluating the objections that have been lodged to date, we can begin to articulate an ethics of personal AI use that navigates those concerns. In the process, we can locate some paradoxes in our thinking about outsourcing and technological dependence, and we can think more clearly about what it means to live a good life in the age of smart machines. (shrink)

Where does the cognitive system begin and end? Intracranialists maintain that the cognitive system is entirely identifiable with the biological central nervous system. Transcranialists, on the other hand, suggest that the cognitive system can extend beyond the biological CNS. In the second division of Supersizing the Mind, Clark defends the transcranial account against various objections. Of interest for this paper is Clark’s response to what he calls “asymmetry arguments.”Asymmetry arguments can be summarized as follows: subtract the props (...) and aids, and the organism may create replacements. But subtract the organism, and all cognitive activity ceases. Although I am sympathetic to Clark’s overall project, I find his response to the asymmetry arguments inadequate in light of his responses to other objections. For this reason, I maintain that Clark’s response requires revision. By adopting a process metaphysics and appealing to mereological dependencies, I believe that Clark can provide a substantive response to asymmetry arguments that is consistent with his overall theory. This paper unfolds as follows: after summarizing Clark’s response to the asymmetry objection in, I will argue that his response is unsuccessful in. My argument hinges on the claim that Clark does not take into account the full intent of Rupert’s asymmetry argument. In I modify Clark’s response by appealing to mereology and the asymmetrical dependencies found therein. I conclude in that this modification provides Clark with an adequate response to the asymmetry argument and is consistent with his overall transcranialist account. The further question of whether this account assists Clark in responding to other intracranialist objections is beyond the scope of this paper. (shrink)

This target article considers the relation of fluid cognitive functioning to general intelligence. A neurobiological model differentiating working memory/executive function cognitive processes of the prefrontal cortex from aspects of psychometrically defined general intelligence is presented. Work examining the rise in mean intelligence-test performance between normative cohorts, the neuropsychology and neuroscience of cognitive function in typically and atypically developing human populations, and stress, brain development, and corticolimbic connectivity in human and nonhuman animal models is reviewed and found to (...) provide evidence of mechanisms through which early experience affects the development of an aspect of cognition closely related to, but distinct from, general intelligence. Particular emphasis is placed on the role of emotion in fluid cognition and on research indicating fluid cognitive deficits associated with early hippocampal pathology and with dysregulation of the hypothalamic-pituitary-adrenal axis stress-response system. Findings are seen to be consistent with the idea of an independent fluid cognitive construct and to assist with the interpretation of findings from the study of early compensatory education for children facing psychosocial adversity and from behavior genetic research on intelligence. It is concluded that ongoing development of neurobiologically grounded measures of fluid cognitive skills appropriate for young children will play a key role in understanding early mental development and the adaptive success to which it is related, particularly for young children facing social and economic disadvantage. Specifically, in the evaluation of the efficacy of compensatory education efforts such as Head Start and the readiness for school of children from diverse backgrounds, it is important to distinguish fluid cognition from psychometrically defined general intelligence. (Published Online April 5 2006) Key Words: cognition; cognition-emotion reciprocity; developmental disorders; emotion; fluid cognition; Flynn effect; general intelligence; limbic system; neuroscience; phenylketonuria; prefrontal cortex; psychometrics; schizophrenia. (shrink)

Among the many applications of artificial intelligence (AI), virtual assistants are one of the tools most likely to grow in the future. The development of these systems may play an increasingly important role in many facets of our lives. Therefore, given their potential importance and present and future weight, it is worthwhile to analyze what kind of challenges they entail. In this chapter, we will provide an overview of the ethical aspects of artificial virtual assistants. First, we provide a (...) conceptual clarification of the term ‘virtual assistant’, including different types of interfaces and recommender systems. Second, we address three ethical issues related to the deployment of these systems: their effects on human agency and autonomy and the subsequent cognitive dependence they would generate; the human obsolescence that may cause a generalized extension of the dependence problem; and the invasions of privacy that virtual assistants may cause. Finally, we outline the debates about the use of virtual assistants to improve human moral decisions and some areas in which these systems can be applied. (shrink)

Identifying the physiological processes in the central nervous system that underlie our conscious experiences has been at the forefront of cognitive neuroscience. While the principles of classical physics were long found to be unaccommodating for a causally effective consciousness, the inherent indeterminism of quantum physics, together with its characteristic dichotomy between quantum states and quantum observables, provides a fertile ground for the physical modeling of consciousness. Here, we utilize the Schrödinger equation, together with the Planck-Einstein relation between energy and (...) frequency, in order to determine the appropriate quantum dynamical timescale of conscious processes. Furthermore, with the help of a simple two-qubit toy model we illustrate the importance of non-zero interaction Hamiltonian for the generation of quantum entanglement and manifestation of observable correlations between different measurement outcomes. Employing a quantitative measure of entanglement based on Schmidt decomposition, we show that quantum evolution governed only by internal Hamiltonians for the individual quantum subsystems preserves quantum coherence of separable initial quantum states, but eliminates the possibility of any interaction and quantum entanglement. The presence of non-zero interaction Hamiltonian, however, allows for decoherence of the individual quantum subsystems along with their mutual interaction and quantum entanglement. The presented results show that quantum coherence of individual subsystems cannot be used for cognitive binding because it is a physical mechanism that leads to separability and non-interaction. In contrast, quantum interactions with their associated decoherence of individual subsystems are instrumental for dynamical changes in the quantum entanglement of the composite quantum state vector and manifested correlations of different observable outcomes. Thus, fast decoherence timescales could assist cognitive binding through quantum entanglement across extensive neural networks in the brain cortex. (shrink)

The Internet has been identified in human enhancement scholarship as a powerful cognitive enhancement technology. It offers instant access to almost any type of information, along with the ability to share that information with others. The aim of this paper is to critically assess the enhancement potential of the Internet. We argue that unconditional access to information does not lead to cognitive enhancement. The Internet is not a simple, uniform technology, either in its composition, or in its use. (...) We will look into why the Internet as an informational resource currently fails to enhance cognition. We analyze some of the phenomena that emerge from vast, continual fluxes of information–information overload, misinformation and persuasive design—and show how they could negatively impact users’ cognition. Methods for mitigating these negative impacts are then advanced: individual empowerment, better collaborative systems for sorting and categorizing information, and the use of artificial intelligence assistants that could guide users through the informational space of today’s Internet. (shrink)

Among the many applications of artificial intelligence (AI), virtual assistants are one of the tools most likely to grow in the future. The development of these systems may play an increasingly important role in many facets of our lives. Therefore, given their potential importance and present and future weight, it is worthwhile to analyze what kind of challenges they entail. In this chapter, we will provide an overview of the ethical aspects of artificial virtual assistants. First, we provide a (...) conceptual clarification of the term ‘virtual assistant’, including different types of interfaces and recommender systems. Second, we address three ethical issues related to the deployment of these systems: their effects on human agency and autonomy and the subsequent cognitive dependence they would generate; the human obsolescence that may cause a generalized extension of the dependence problem; and the invasions of privacy that virtual assistants may cause. Finally, we outline the debates about the use of virtual assistants to improve human moral decisions and some areas in which these systems can be applied. (shrink)

The design of collaborative robotics, such as driver-assisted operations, engineer a potential automation of decision-making predicated on unobtrusive data gathering of human users. This form of ‘somatic surveillance’ increasingly relies on behavioural biometrics and sensory algorithms to verify the physiology of bodies in cabin interiors. Such processes secure cyber-physical space, but also register user capabilities for control that yield data as insured risk. In this technical re-formation of human–machine interactions for control and communication ‘a dissonance of attribution’ :7684, 2019. https://doi.org/10.1073/pnas.1805770115) (...) is created between perceptions of phenomena, materials and decision-making. This reconfigures relations not only between humans and machines, objects and subjects, but possibly disrupts attributive functions in the social system of Law. What it requires is shifting a legal accountability for action from a sovereignty of the human to a new materialist account based on a ‘cognitive assemblage’ between physiological data, computation and algorithmic sensing. This paper investigates the function of law as a guidance system to acknowledge this account of sensory and algorithmic computation as autonomous ‘sensing agents’ that may be accountable in situations of risk. This assemblage of robotic computation and sensory determination requires a clearer legal differentiation across the current static terminologies of person, property, liability and rights that maintain strict separations of object from subject. To neglect this, we argue, law will solely impute attributions of error to humans despite evidence of operation via mutual control. (shrink)

The Emergic Cognitive Model (ECM) is a unified computational model of visual filling-in based on the Emergic Network architecture. The Emergic Network was designed to help realize systems undergoing continuous change. In this thesis, eight different filling-in phenomena are demonstrated under a regime of continuous eye movement (and under static eye conditions as well). -/- ECM indirectly demonstrates the power of unification inherent with Emergic Networks when cognition is decomposed according to finer-grained functions supporting change. These can interact (...) to raise additional emergent behaviours via cognitive re-use, hence the Emergic prefix throughout. Nevertheless, the model is robust and parameter free. Differential re-use occurs in the nature of model interaction with a particular testing paradigm. -/- ECM has a novel decomposition due to the requirements of handling motion and of supporting unified modelling via finer functional grains. The breadth of phenomenal behaviour covered is largely to lend credence to our novel decomposition. -/- The Emergic Network architecture is a hybrid between classical connectionism and classical computationalism that facilitates the construction of unified cognitive models. It helps cutting up of functionalism into finer-grains distributed over space (by harnessing massive recurrence) and over time (by harnessing continuous change), yet simplifies by using standard computer code to focus on the interaction of information flows. Thus while the structure of the network looks neurocentric, the dynamics are best understood in flowcentric terms. Surprisingly, dynamic system analysis (as usually understood) is not involved. An Emergic Network is engineered much like straightforward software or hardware systems that deal with continuously varying inputs. Ultimately, this thesis addresses the problem of reduction and induction over complex systems, and the Emergic Network architecture is merely a tool to assist in this epistemic endeavour. -/- ECM is strictly a sensory model and apart from perception, yet it is informed by phenomenology. It addresses the attribution problem of how much of a phenomenon is best explained at a sensory level of analysis, rather than at a perceptual one. As the causal information flows are stable under eye movement, we hypothesize that they are the locus of consciousness, howsoever it is ultimately realized. (shrink)

Abstract:This paper considers novel ethical issues pertaining to near-future artificial intelligence (AI) systems that seek to support, maintain, or enhance the capabilities of older adults as they age and experience cognitive decline. In particular, we focus on smart assistants (SAs) that would seek to provide proactive assistance and mediate social interactions between users and other members of their social or support networks. Such systems would potentially have significant utility for users and their caregivers if they could (...) reduce the cognitive load for tasks that help older adults maintain their autonomy and independence. However, proactively supporting even simple tasks, such as providing the user with a summary of a meeting or a conversation, would require a future SA to engage with ethical aspects of human interactions which computational systems currently have difficulty identifying, tracking, and navigating. If SAs fail to perceive ethically relevant aspects of social interactions, the resulting deficit in moral discernment would threaten important aspects of user autonomy and well-being. After describing the dynamic that generates these ethical challenges, we note how simple strategies for prompting user oversight of such systems might also undermine their utility. We conclude by considering how near-future SAs could exacerbate current worries about privacy, commodification of users, trust calibration and injustice. (shrink)

To effectively improve the efficiency of international service design talent training and make it more in line with society's needs, we analyze the current status of international service design talent training and its professional training focus. Based on the above problems, from the perspective of cognitive psychology, artificial intelligence and human–computer interaction technology are used to construct the international service design talent training mode of the HCI intelligent service robot. This mode can be used to solve the existing teaching (...) problems by using novel means to ensure the quality of teaching. Finally, through the actual analysis of teaching cases, the effectiveness of the proposed talent training mode is verified. The HCI system is based on knowledge of cognitive psychology. According to the characteristics and functions of an educational robot, the robot is combined with traditional teaching activities, and the robot-assisted talent training mode is designed. Robot-assisted talent training is a feasible training method that can improve the efficiency of talent training. Students have confidence in their learning skills before the course, and the confidence is further strengthened after the end of the course. After the course, the students have a stronger sense of cooperation. This study can provide theoretical ideas for the research of international service talent training mode. (shrink)

BackgroundAs the population of the United States ages, chronic diseases increase and treatment options become technologically more complicated. As such, patients’ autonomy, or the right of patients to accept or refuse a medical treatment, may become a more pressing and complicated issue. This autonomy rests upon a patient’s capacity to make a decision. As more older, cognitively and functionally impaired individuals enter healthcare systems, quality assessments of decision-making capacity must be made. These assessments should be done in a time-efficient (...) manner at a patient’s bedside by the patient’s own physician. Thus, a clinically practical tool to assist in decision-making capacity assessments could help guide physicians in making more accurate judgments.ObjectivesTo create a clinically relevant Bedside Capacity Assessment Tool (BCAT) to help physicians make timely and accurate clinical assessments of a patient’s decision-making capacity for a specific decision.SettingThe Department of Medicine, Division of Geriatrics and Palliative Medicine, Zucker School of Medicine at Hofstra/northwell.ParticipantsGeriatric medicine fellows, palliative medicine fellows, and internal medicine residents (n = 30).MeasurementsSubjects used the BCAT to assess the decision-making capacity of patients described in 10 written, clinically complex capacity assessment vignettes. Subjects’ conclusions were compared to those of experts.ResultsThe subjects’ and experts’ assessments of capacity had a 76.1 percent rate of agreement, with a range of 50 percent to 100 percent. With removal of three complex outlier vignettes, the agreement rate reached 83.2 percent.ConclusionThe strong correlation between the two groups—one of physicians in training utilizing the BCAT and the other of specialists in this area—suggests that the BCAT may be a useful adjunct for clinicians who assess decision-making capacity in routine practice. The range indicates that further refinement and testing of this tool is necessary. The potential exists for this tool to improve capacity assessment skills for physicians in clinical practice. (shrink)

In conditions of post-pandemic reality, the creation of optimal psychological and pedagogical conditions for the formation of future specialists, raising the level of their professional training, socialization and adaptation to work in the work collective requires appropriate psychological support, the development of cognitive and psychological support technologies for the constructive implementation of practical social psychological assistance in the pedagogical process, as well as the use of modern cognitive-psychological approaches by teachers, the development of psychological recommendations on the (...) style of pedagogical impact and the like.The article highlights the important socio-psychological conditions for preparing a future teacher for socio-pedagogical activity in the context of post-pandemic realities. The necessity of using cognitive psychology technologies in the process of forming professionally speaking competencies of future psychologists and their speech culture in the process of professional speech training is substantiated. The technologies and conditions for the organization of the pedagogical process for the preparation of future practical psychologists who have undergone changes as a result of recent events related to the implementation of the educational process in a remote mode are described. The structure of the seminar on the basics of speech competence of a psychologist is presented as a result of using a dialogical approach in the system of professional training at a university.In our opinion, the materials in this article will be of interest to educators, practical psychologists, and social educators of the vocational education system, since they will help not only better understand the psychological characteristics of the professional and personal development of future specialists, but also constructively solve the urgent problems of their professional training. (shrink)

The social and cultural model of disability has challenged the historically powerful perception of disability as a deficiency. Disability is no longer conceived of solely in terms of an individual lack of capacities but also considered as a structural effect of disabling social institutions and normalizing thinking. The UN Convention on the Rights of Persons with Disabilities (CRPD) from 2006 marks a decisive step towards the recognition of humans with (cognitive) disabilities as legal subjects who are entitled to enjoy (...) all human rights on equal terms with others. A central claim of the CRPD refers to full political participation of persons with (cognitive) disabilities. This paper argues for strengthening the political participation of persons with severe cognitive disabilities. The normative starting point is the claim that they are our equals, both morally and socially. In spelling out this status equality for the realm of the political, I focus on what political equality and inclusivity means concerning franchise. I will argue that the disenfranchisement of persons with cognitive disabilities, as practiced in many countries, cannot be justified. Furthermore, enfranchising persons with cognitive disabilities is deemed a central expression of their recognition as equals. Thus, it marks a crucial moment of emancipatory transformation towards a more inclusive political system. In cases where severely cognitive disabled persons cannot exercise the right to vote themselves, forms of assisted voting and supported decision-making must be available. (shrink)

Research on fairness in machine learning (ML) has been largely focusing on individual and group fairness. With the adoption of ML-based technologies as assistive technology in complex societal transformations or crisis situations on a global scale these existing definitions fail to account for algorithmic fairness transnationally. We propose to complement existing perspectives on algorithmic fairness with a notion of transnational algorithmic fairness and take first steps towards an analytical framework. We exemplify the relevance of a transnational fairness assessment in a (...) case study on a disaster response system using images from online social media. In the presented case, ML systems are used as a support tool in categorizing and classifying images from social media after a disaster event as an almost instantly available source of information for coordinating disaster response. We present an empirical analysis assessing the transnational fairness of the application’s outputs-based on national socio-demographic development indicators as potentially discriminatory attributes. In doing so, the paper combines interdisciplinary perspectives from data analytics, ML, digital media studies and media sociology in order to address fairness beyond the technical system. The case study investigated reflects an embedded perspective of peoples’ everyday media use and social media platforms as the producers of sociality and processing data-with relevance far beyond the case of algorithmic fairness in disaster scenarios. Especially in light of the concentration of artificial intelligence (AI) development in the Global North and a perceived hegemonic constellation, we argue that transnational fairness offers a perspective on global injustices in relation to AI development and application that has the potential to substantiate discussions by identifying gaps in data and technology. These analyses ultimately will enable researchers and policy makers to derive actionable insights that could alleviate existing problems with fair use of AI technology and mitigate risks associated with future developments. (shrink)

This work investigates which conditions lead to co-driver discomfort aside from classical motion sickness, what characterizes uncomfortable situations, and why these conditions have a negative effect. The automobile is called a “passenger vehicle” as its main purpose is the transportation of people. However, passengers in the car are rarely considered in research concerning driving discomfort. The few studies in this area focus on driver discomfort, automated vehicles, or driver assistant systems. An earlier public survey indicated that discomfort is also (...) a relevant problem for co-drivers. In this paper, these results are confirmed and extended through an online questionnaire with N = 119 participants and a detailed follow-up interview study with N = 24 participants was conducted. The results of the online questionnaire show that co-driver discomfort is a widespread problem. The interviews indicate that the driving style is one factor contributing to co-driver discomfort, in particular close following or fast driving. In those situations, participants experienced a feeling of being exposed, which additionally contributed to their discomfort. Uncomfortable situations were also perceived as safety critical. A model for possible cognitive origins of discomfort in co-drivers, extending theories from the areas of stress and self-regulation, is developed based on the results. Co-driver discomfort is a common problem, highlighting the relevance of further research on supporting co-drivers. The reported correlations and the proposed model can help to explain the origin of this discomfort. The results provide a foundation for the future design of interventions like human machine interfaces aiming at reducing co-driver discomfort. (shrink)

Web-based learning resources provide learners with hyperspace where they can navigate in a self-directed way to learn the contents included in the Web pages. The navigation involves making a sequence of the pages visited, which is called navigation path. However, learners often fail in making the navigation path due to a cognitive overload, which is caused by diverse cognitive efforts at comprehending the contents in Web pages, and monitoring the navigation process such as planning and reflection of navigation (...) path. In the self-directed learning, in particular, it is difficult for learners to maintain the navigation monitoring. Focusing on navigation planning, this paper addresses the issue of how to facilitate learners' navigation monitoring to promote their learning in hyperspace provided by Web-based learning resources. Our approach to this issue is to provide learners with a space, in which they can see through the learning resources to plan a navigation path, apart from hyperspace. In this paper, we also demonstrate an assistant system for the navigation planning, which is composed of hyperspace map, page previewer, and path previewer. These facilities give learners an overview of Web pages and navigation path to help them make a navigation path plan without visiting Web pages in hyperspace. This paper also describes a case study with the assistant system. The results indicate that the system facilitates navigation particularly in a more complicated hyperspace. (shrink)

Assistive technology is widely used in contemporary special needs education. Our interest is in the extent to which we can conceive of certain uses of AT in this educational context as a form of extended cognition. It is argued that what is critical to answering this question is that the relationship between the student and the AT is more than just that of subject-and-instrument, but instead incorporates a fluidity and spontaneity that puts it on a functional par with their use (...) of the student’s biological cognitive traits. It is claimed that AT use in special needs education offers an especially plausible case of extended cognition for just this reason. It is further maintained that understanding AT in this fashion has some important philosophical and practical ramifications, including how we should conceive of mainstream education, given that this is increasingly conducted within highly technologically-embedded environments. (shrink)

Computational Creativity, Concept Invention, and General Intelligence in their own right all are flourishing research disciplines producing surprising and captivating results that continuously influence and change our view on where the limits of intelligent machines lie, each day pushing the boundaries a bit further. By 2014, all three fields also have left their marks on everyday life – machine-composed music has been performed in concert halls, automated theorem provers are accepted tools in enterprises’ R&D departments, and cognitive architectures are (...) being integrated in pilot assistance systems for next generation airplanes. Still, although the corresponding aims and goals are clearly similar (as are the common methods and approaches), the developments in each of these areas have happened mostly individually within the respective community and without closer relationships to the goings-on in the other two disciplines. In order to overcome this gap and to provide a common platform for interaction and exchange between the different directions, the International Workshops on “Computational Creativity, Concept Invention, and General Intelligence” (C3GI) have been started. At ECAI-2012 and IJCAI-2013, the first and second edition of C3GI each gathered researchers from all three fields, presenting recent developments and results from their research and in dialogue and joint debates bridging the disciplinary boundaries. The chapters contained in this book are based on expanded versions of accepted contributions to the workshops and additional selected contributions by renowned researchers in the relevant fields. Individually, they give an account of the state-of-the-art in their respective area, discussing both, theoretical approaches as well as implemented systems. When taken together and looked at from an integrative perspective, the book in its totality offers a starting point for a (re)integration of Computational Creativity, Concept Invention, and General Intelligence, making visible common lines of work and theoretical underpinnings, and pointing at chances and opportunities arising from the interplay of the three fields. (shrink)

Context: In this empirical and conceptual paper on the historical, philosophical, and epistemological backgrounds of second-order cybernetics, the emergence of a significant pedagogical component to Heinz von Foerster’s work during the last years of the Biological Computer Laboratory is placed against the backdrop of social and intellectual movements on the American landscape. Problem: Previous discussion in this regard has focused largely on the student radicalism of the later 1960s. A wider-angled view of the American intellectual counterculture is needed. However, this (...) historical nexus is complicated and more often dismissed than brought into clear focus. Method: This essay assembles a historical sequence of archival materials for critical analysis, linked to a conceptual argument eliciting from those materials the second-order cybernetic concepts of observation, recursion, and paradox. Results: In this period, von Foerster found the “positive of the negative” in the social and intellectual unrest of that moment and cultivated those insights for the broader constitution of a new cognitive orientation. Implications: As a successful student of his own continuing course on heuristics, von Foerster left the academic mainstream to ally his constructivist epistemology with the systems counterculture. (shrink)

Although artificial intelligence has been given an unprecedented amount of attention in both the public and academic domains in the last few years, its convergence with other transformative technologies like cloud computing, robotics, and augmented/virtual reality is predicted to exacerbate its impacts on society. The adoption and integration of these technologies within industry and manufacturing spaces is a fundamental part of what is called Industry 4.0, or the Fourth Industrial Revolution. The impacts of this paradigm shift on the human operators (...) who continue to work alongside and symbiotically with these technologies in the industry bring with it novel ethical issues. Therefore, how to design these technologies for human values becomes the critical area of intervention. This paper takes up the case study of robotic AI-based assistance systems to explore the potential value implications that emerge due to current design practices and use. The design methodology known as Value Sensitive Design (VSD) is proposed as a sufficient starting point for designing these technologies for human values to address these issues. (shrink)

The automobile is a tool like no other. There is much excitement and enthusiasm for new and emerging transportation tools such as vehicle automation and driver assistance systems. Although there are high hopes for these technologies, there are many unknowns including the extent to which these new transportation tools can realistically and reliably improve driver safety and affect the subjective driving experience. This paper explores these questions in the context of evaluating collision warning systems on the behavior (...) and perceptions of drivers with different amounts of experience and places the results in the greater context of tool use and skilled learning focusing on the adoption and utilization of mental models. (shrink)

Ethical decision making involves complex emotional, cognitive, social, and philosophical challenges. Even if someone wants to be ethical, he or she may not have clearly articulated what that means, or know how to go about making a decision consistent with his or her values. Information technology may be able to help. A decision support system could offer individuals and groups some guidance, assisting them in making a decision that reflects their underlying values. The first step towards a design science (...) of ethical decision support is to develop a theoretical base on which first-generation systems can be built. This paper brings together work in cognitive, social and moral psychology, information systems, and philosophy relevant to ethical decision making. Attributes of a system that would support ethical decision making are described. (shrink)

Aurama is a system designed to provide peace of mind and a sense of connectedness to adults who care for elderly parents living alone. Aurama monitors the elders at home using unobtrusive sensor technology and collects data about sleeping patterns, weight trends, cognitive abilities and presence at home. The system provides an unobtrusive ambient information display that presents the status of the elder and lets its users inspect long-term data about the well-being of the elder interactively. Aurama was designed (...) iteratively with substantial user involvement through interviews, prototype evaluation, focus groups and lab tests. The final prototype was evaluated in two field trials each involving an elder and their adult children. The input of users throughout the design process and during these tests demonstrates clearly the potential of awareness systems to support the target user group to obtain peace of mind and feel connected. Furthermore, the users indicate a clear need for information on long-term trends relating to the well-being of aging parents, in contrast to the current emphasis in this field of research on providing instantaneous status information about daily activities and context. (shrink)

One of the major issues for user assistance systems consists of “providing help at an appropriate level”. In this paper we analyze the problem of modeling task experience — a prerequisite for provisioning adequate help. In contrast to level-based approaches we propose an ontology-based model, which allows fine-grained modeling of task experience using the concepts of the task domain as granules. The model is semantic in the sense that it allows to take advantage of the relations between concepts (...) to provide novel semantic services and interactions. We present the SACHS (Semantic Annotations for a Controlling Help System, a semantic help system for a spreadsheet-based financial controlling system) software as an exemplary application of the proposed task experience model. (shrink)

The effect of recent experience on current behavior has been studied extensively in simple laboratory tasks. We explore the nature of sequential effects in the more naturalistic setting of automobile driving. Driving is a safety-critical task in which delayed response times may have severe consequences. Using a realistic driving simulator, we find significant sequential effects in pedal-press response times that depend on the history of recent stimuli and responses. Response times are slowed up to 100 ms in particular cases, a (...) delay that has dangerous practical consequences. Further, we observe a significant number of history-related pedal misapplications, which have recently been noted as a cause for concern in the automotive safety community. By anticipating these consequences of sequential context, driver assistance systems could mitigate the effects of performance degradations and thus critically improve driver safety. (shrink)

This paper focuses on the relation of heuristic search and level of intelligence in cognitive computation systems. The paper begins with a review of the fundamental properties of a cognitive computation system, which is defined generally as a control system that generates goal-directed actions in response to environmental inputs and constraints. An important property of cognitive computations is the need to process local cues in symbol structures to access and integrate distal knowledge to generate a response. (...) To deal with uncertainties involved in this local-to-distal processing, the system needs to perform heuristic search to locate and integrate the right set of distal structures. The level of intelligence of the system depends critically on the efficiency of the heuristic search process. It is argued that, for a bounded rationality system, the level of intelligence does not depend on how much search it needs to do to accomplish a task. Rather, the level of intelligence depends on how much search it does not need to do to achieve the same level of performance. Examples were discussed to illustrate this idea. The first two examples show how machines that play games like tic-tac-toe and chess rely heavily on the efficiency of the heuristic search algorithm to achieve better performance, demonstrating the relation of heuristic search and intelligence in a bounded rationality system. The second example shows how humans adapt to different information ecologies to perform information search on the Internet and how their performance improves over time, demonstrating how heuristic search can be improved in an adaptive rationality system. The two examples demonstrate how better search control knowledge and representations of task environment can improve the efficiency of heuristic search, thereby improving the intelligence of the system. (shrink)

transparency as a user interface property that enables giving appropriate help. We explicate this notion in document player applications found in office suites, for example. Moreover, we show how semantic transparency can be strengthened when the underlying software is complemented by a semantic ally system. The approach consists in illustrating existing software semantically. We present some semantic extensions of office applications as examples. We also deaction task. scribe how the semantic transparency approach allows the..

The rapid development of natural language processing in the last three decades has drastically changed the way professional translators do their work. Nowadays most of them use computer-assisted translation or translation memory tools whose evolution has been overshadowed by the much more sensational development of machine translation systems, with which TM tools are sometimes confused. These two language technologies now interact in mutually enhancing ways, and their increasing role in human translation has become a subject of behavioral studies. Philosophers (...) and linguists, however, have been slow in coming to grips with these important developments. The present paper seeks to fill in this lacuna. I focus on the semantic aspects of the highly distributed human–computer interaction in the CAT process which presents an interesting case of an extended cognitive system involving a human translator, a TM tool, an MT engine, and sometimes other human translators or editors. Considered as a whole, such a system is engaged in representing the linguistic meaning of the source document in the target language. But the roles played by its various components, natural as well as artificial, are far from trivial, and the division of linguistic labor between them throws new light on the familiar notions that were initially inspired by rather different phenomena in the philosophy of language, mind, and cognitive science. (shrink)

This study explores the way that belief systems, interactions with social or experimental environments, and skills at the “control” level in decision‐making shape people's behavior as they solve problems. It is argued that problem‐solvers' beliefs (not necessarily consciously held) about what is useful in mathematics may determine the set of “cognitive resources” at their disposal as they do mathematics. Such beliefs may, for example, render inaccessible to them large bodies of information that are stored in long‐term memory and (...) that are easily retrieved in other circumstances. In other cases, individuals' reactions to an experimental setting (fear of failure, or the desire to “look mathematical” while being videotaped) may induce behavior that is almost pathological—and at the same time, so consistent that it can be modeled. In general, such “environmental” factors establish the context within which individuals access and utilize the information potentially at their disposal.Protocols illustrating these points are presented and discussed. A model based on an axiomatization of students' beliefs about plane geometry is outlined, and is shown to correspond closely to their problem‐solving performance. A framework is offered for analyzing problem‐solving performance at three qualitatively different levels: access to cognitive resources stored in LTM, executive or control decision‐making, and belief systems. (shrink)

ABSTRACTA cognitive autopoietic system is a dynamic, self-generating, organized and self-organizing thing which self-regulates with respect to an external medium. The present model of the effect of stress on a cognitive autopoietic system captures the notion of how a priori cognitive structures, combined with external sensations, constitute the basis for the development of cognitive structures and their architecture. The ESCA model integrates the fact that the mind–environment relation has a twofold effect: on one hand, it enables (...) self-regulation of mind, but on the other hand, it poses a potential perturbation on the same, which may result in the breakdown of the self-regulation of mind. The architecture of the CS developed on the basis of the ESCA model is consistent with the manifestations of the effect of stress on mind behavior at different levels. The ESCA model predicts that the faculty to concatenate... (shrink)

I argue against the claim of certain functionalists, like Jerry Fodor, that theories of psychological states ought to abstract from the physiology of the systems that exhibit such states. Taking seriously Darwin’s claim that living organisms struggle to survive, and that their “mental powers” are adaptations that assist them in this struggle, I argue that not only emotions but also paradigm cognitive states like beliefs are intimately bound up with the physiology of the organism and its efforts to (...) maintain its own well-being. I defend the definitional aspirations of functionalism but reject its attempt at ontological neutrality. (shrink)

It is a matter of fact that Europe is facing more and more crucial challenges regarding health and social care due to the demographic change and the current economic context. The recent COVID-19 pandemic has stressed this situation even further, thus highlighting the need for taking action. Active and Assisted Living technologies come as a viable approach to help facing these challenges, thanks to the high potential they have in enabling remote care and support. Broadly speaking, AAL can be referred (...) to as the use of innovative and advanced Information and Communication Technologies to create supportive, inclusive and empowering applications and environments that enable older, impaired or frail people to live independently and stay active longer in society. AAL capitalizes on the growing pervasiveness and effectiveness of sensing and computing facilities to supply the persons in need with smart assistance, by responding to their necessities of autonomy, independence, comfort, security and safety. The application scenarios addressed by AAL are complex, due to the inherent heterogeneity of the end-user population, their living arrangements, and their physical conditions or impairment. Despite aiming at diverse goals, AAL systems should share some common characteristics. They are designed to provide support in daily life in an invisible, unobtrusive and user-friendly manner. Moreover, they are conceived to be intelligent, to be able to learn and adapt to the requirements and requests of the assisted people, and to synchronise with their specific needs. Nevertheless, to ensure the uptake of AAL in society, potential users must be willing to use AAL applications and to integrate them in their daily environments and lives. In this respect, video- and audio-based AAL applications have several advantages, in terms of unobtrusiveness and information richness. Indeed, cameras and microphones are far less obtrusive with respect to the hindrance other wearable sensors may cause to one’s activities. In addition, a single camera placed in a room can record most of the activities performed in the room, thus replacing many other non-visual sensors. Currently, video-based applications are effective in recognising and monitoring the activities, the movements, and the overall conditions of the assisted individuals as well as to assess their vital parameters. Similarly, audio sensors have the potential to become one of the most important modalities for interaction with AAL systems, as they can have a large range of sensing, do not require physical presence at a particular location and are physically intangible. Moreover, relevant information about individuals’ activities and health status can derive from processing audio signals. Nevertheless, as the other side of the coin, cameras and microphones are often perceived as the most intrusive technologies from the viewpoint of the privacy of the monitored individuals. This is due to the richness of the information these technologies convey and the intimate setting where they may be deployed. Solutions able to ensure privacy preservation by context and by design, as well as to ensure high legal and ethical standards are in high demand. After the review of the current state of play and the discussion in GoodBrother, we may claim that the first solutions in this direction are starting to appear in the literature. A multidisciplinary debate among experts and stakeholders is paving the way towards AAL ensuring ergonomics, usability, acceptance and privacy preservation. The DIANA, PAAL, and VisuAAL projects are examples of this fresh approach. This report provides the reader with a review of the most recent advances in audio- and video-based monitoring technologies for AAL. It has been drafted as a collective effort of WG3 to supply an introduction to AAL, its evolution over time and its main functional and technological underpinnings. In this respect, the report contributes to the field with the outline of a new generation of ethical-aware AAL technologies and a proposal for a novel comprehensive taxonomy of AAL systems and applications. Moreover, the report allows non-technical readers to gather an overview of the main components of an AAL system and how these function and interact with the end-users. The report illustrates the state of the art of the most successful AAL applications and functions based on audio and video data, namely lifelogging and self-monitoring, remote monitoring of vital signs, emotional state recognition, food intake monitoring, activity and behaviour recognition, activity and personal assistance, gesture recognition, fall detection and prevention, mobility assessment and frailty recognition, and cognitive and motor rehabilitation. For these application scenarios, the report illustrates the state of play in terms of scientific advances, available products and research project. The open challenges are also highlighted. The report ends with an overview of the challenges, the hindrances and the opportunities posed by the uptake in real world settings of AAL technologies. In this respect, the report illustrates the current procedural and technological approaches to cope with acceptability, usability and trust in the AAL technology, by surveying strategies and approaches to co-design, to privacy preservation in video and audio data, to transparency and explainability in data processing, and to data transmission and communication. User acceptance and ethical considerations are also debated. Finally, the potentials coming from the silver economy are overviewed. (shrink)