The present study focuses on the situation in which mind-reading machines will be connected, initially through the incorporation of weak AI, and then in conjunction to strong AI, an aspect that, ongoing, will no longer have a simple medical role, as is the case at present, but one of surveillance and monitoring of individuals—an aspect that is heading us towards a future techno-panoptic singularity. Thus, the general objective of this paper raises the problem of the ontological stability of human nature (...) which, within the limits of the technological singularity of mind-reading machines, leads to the loss of autonomy and a reduction in freedom when it comes to human thoughts. In this paradigm, the hypothesis of a future era of technological singularity is prefigured to be a cumulation of factors in which artificial intelligence holds a dominant position in relation to the human agent, in a techno-panoptic system of human supervision, in the form of a new world order of manifestation/imposition of power—that of a “singleton.” The theoretical objective analyzes the phenomenon of “deterritorrialization” of the Foucauldian panoptic mechanism —which is based on the “biopolitical” system of “biopower”—and its “reterritorialization” in the “territory” of the techno-panoptic singularity, where the scenario of a strong AI “singleton”, represents the alienation of the Being into a hard technological determinism. (shrink)

21st Century society could be defined with the term of 4thIndustrial Revolution (4IR), which means various kinds of technology are amalgamated with ICT technology. Since a little bit ago, Genetics, Nanotechnology, Artificial Intelligence and Robotics are changing people’s everyday life. These technologies are accelerating another form of digital convergence to Information Technology and that affects future of human being, especially morality and human nature. The speed and ability of technological development excesses human understanding and it challenges human existences. (...) In the discussion on Artificial Intelligence, Strong AI and Super AI are in the center of the issues for fear that those technologies could be threaten the nature of human being, e.g. humanity or morality which makes the real identity of human nature. With these discussions, corresponding measures of the Ethics Education is closely connected with philosophical perspectives on technological singularity and artificial intelligence. In the Age of technology, the direction of Education should aim at enhancing and supporting morality and forming desirable character for the purpose of recovery and building up the human nature, which controls the direction of the development of the technology. (shrink)

Recent progress in artificial intelligence (AI) has drawn attention to the technology’s transformative potential, including what some see as its prospects for causing large-scale harm. We review two influential arguments purporting to show how AI could pose catastrophic risks. The first argument — the Problem of Power-Seeking — claims that, under certain assumptions, advanced AI systems are likely to engage in dangerous power-seeking behavior in pursuit of their goals. We review reasons for thinking that AI systems might seek (...) power, that they might obtain it, that this could lead to catastrophe, and that we might build and deploy such systems anyway. The second argument claims that the development of human-level AI will unlock rapid further progress, culminating in AI systems far more capable than any human — this is the Singularity Hypothesis. Power-seeking behavior on the part of such systems might be particularly dangerous. We discuss a variety of objections to both arguments and conclude by assessing the state of the debate. (shrink)

Artificial intelligence (AI) and robotics are digital technologies that will have significant impact on the development of humanity in the near future. They have raised fundamental questions about what we should do with these systems, what the systems themselves should do, what risks they involve, and how we can control these. - After the Introduction to the field (§1), the main themes (§2) of this article are: Ethical issues that arise with AI systems as objects, i.e., tools made (...) and used by humans. This includes issues of privacy (§2.1) and manipulation (§2.2), opacity (§2.3) and bias (§2.4), human-robot interaction (§2.5), employment (§2.6), and the effects of autonomy (§2.7). Then AI systems as subjects, i.e., ethics for the AI systems themselves in machine ethics (§2.8) and artificial moral agency (§2.9). Finally, the problem of a possible future AI superintelligence leading to a “singularity” (§2.10). We close with a remark on the vision of AI (§3). - For each section within these themes, we provide a general explanation of the ethical issues, outline existing positions and arguments, then analyse how these play out with current technologies and finally, what policy consequences may be drawn. (shrink)

There is, in some quarters, concern about high–level machine intelligence and superintelligent AI coming up in a few decades, bringing with it significant risks for humanity. In other quarters, these issues are ignored or considered science fiction. We wanted to clarify what the distribution of opinions actually is, what probability the best experts currently assign to high–level machine intelligence coming up within a particular time–frame, which risks they see with that development, and how fast they see these developing. (...) We thus designed a brief questionnaire and distributed it to four groups of experts in 2012/2013. The median estimate of respondents was for a one in two chance that high-level machine intelligence will be developed around 2040-2050, rising to a nine in ten chance by 2075. Experts expect that systems will move on to superintelligence in less than 30 years thereafter. They estimate the chance is about one in three that this development turns out to be ‘bad’ or ‘extremely bad’ for humanity. (shrink)

Artificial intelligence (AI) is a digital technology that will be of major importance for the development of humanity in the near future. AI has raised fundamental questions about what we should do with such systems, what the systems themselves should do, what risks they involve and how we can control these. - After the background to the field (1), this article introduces the main debates (2), first on ethical issues that arise with AI systems as objects, i.e. tools (...) made and used by humans; here, the main sections are privacy (2.1), manipulation (2.2), opacity (2.3), bias (2.4), autonomy & responsibility (2.6) and the singularity (2.7). Then we look at AI systems as subjects, i.e. when ethics is for the AI systems themselves in machine ethics (2.8.) and artificial moral agency (2.9). Finally we look at future developments and the concept of AI (3). For each section within these themes, we provide a general explanation of the ethical issues, we outline existing positions and arguments, then we analyse how this plays out with current technologies and finally what policy conse-quences may be drawn. (shrink)

In the mid‐twentieth century, theorists began seriously forecasting possibilities for artificial intelligence (AI). As related research gathered momentum and resources, the topic made impressions on public discourse. One effect was increasingly pointed emphasis on AI in popular narratives. Although considerably earlier thematic examples may be located, we can observe swelling and generally pessimistic threads of speculation in science fiction of the 1950s and 1960s. This discussion identifies some pertinent science fiction texts from that period, alongside public discussion arising (...) from contemporary research. One consistent theme is human receptiveness to the numinous , and the capacity to ascribe personality and even divinity to sufficiently impressive manifestations, even artificial ones. Science fiction has long contemplated such reactions, prefiguring today's anticipations of AIs that might abruptly develop themselves beyond any possible human comprehension or control. This body of exploratory projections is a useful resource for the engineers and philosophers currently grappling with realistic prospects for Western humanity's shifting conception of itself. (shrink)

This is the editorial for a special volume of JETAI, featuring papers by Omohundro, Armstrong/Sotala/O’Heigeartaigh, T Goertzel, Brundage, Yampolskiy, B. Goertzel, Potapov/Rodinov, Kornai and Sandberg. - If the general intelligence of artificial systems were to surpass that of humans significantly, this would constitute a significant risk for humanity – so even if we estimate the probability of this event to be fairly low, it is necessary to think about it now. We need to estimate what progress we can (...) expect, what the impact of superintelligent machines might be, how we might design safe and controllable systems, and whether there are directions of research that should best be avoided or strengthened. (shrink)

The existential risk posed by ubiquitous artificial intelligence (AI) is a subject of frequent discussion with descriptions of the prospect of misuse, the fear of mass destruction, and the singularity. In this paper I address an under-explored category of existential risk posed by AI, namely emotional risk. Values are a main source of emotions. By challenging some of our most essential values, AI systems are therefore likely to expose us to emotional risks such as loss of care and (...) loss of meaning. Part one presents a study of a leading bank in Germany where an AI system was implemented to replace humans in decision-making processes. Part two explains why humans actively make use of values to make decisions. Part three shows the connection between values and emotions. Part four relates parts two and three to the bank study by giving concrete examples of how the employees saw their roles as workers, and how the relationships to their customers changed emotionally after the AI system was implemented to make decisions. (shrink)

I survey four categories of factors that might give a digital mind, such as an upload or an artificial general intelligence, an advantage over humans. Hardware advantages include greater serial speeds and greater parallel speeds. Self-improvement advantages include improvement of algorithms, design of new mental modules, and modification of motivational system. Co-operative advantages include copyability, perfect co-operation, improved communication, and transfer of skills. Human handicaps include computational limitations and faulty heuristics, human-centric biases, and socially motivated cognition. The shape (...) of hardware growth curves, as well as the ease of modifying minds, are found to have a major impact on how quickly a digital mind may take advantage of these factors. (shrink)

Technology is part of all life forms. This does not mean that all technology is beneficial for life. Technological evolution in the human sphere holds promises to attain the status of singularity. This identifies the so-called Fourth Industrial Revolution. What is at stake includes the emergence of intelligent and conscious super computers and robots, conscious materialism, the possibility of human immortality and the emergence of the trans-human. In the ambit of a new artificial environment in which humans will live, (...) the question of being must be addressed again. How will all of this affect the question of being human and new conceptions of ‘self’? To what extent will the possibility of techno-religion replace traditional religions with its promise of eradicating poverty, illness and death? This article focuses on these and related issues to identify possibilities of a new artificially envisaged lifestyle. (shrink)

Papers from the conference on AI Risk (published in JETAI), supplemented by additional work. --- If the intelligence of artificial systems were to surpass that of humans, humanity would face significant risks. The time has come to consider these issues, and this consideration must include progress in artificial intelligence (AI) as much as insights from AI theory. -- Featuring contributions from leading experts and thinkers in artificial intelligence, Risks of Artificial Intelligence is (...) the first volume of collected chapters dedicated to examining the risks of AI. The book evaluates predictions of the future of AI, proposes ways to ensure that AI systems will be beneficial to humans, and then critically evaluates such proposals. 1 Vincent C. Müller, Editorial: Risks of Artificial Intelligence - 2 Steve Omohundro, Autonomous Technology and the Greater Human Good - 3 Stuart Armstrong, Kaj Sotala and Sean O’Heigeartaigh, The Errors, Insights and Lessons of Famous AI Predictions - and What they Mean for the Future - 4 Ted Goertzel, The Path to More General Artificial Intelligence - 5 Miles Brundage, Limitations and Risks of Machine Ethics - 6 Roman Yampolskiy, Utility Function Security in Artificially Intelligent Agents - 7 Ben Goertzel, GOLEM: Toward an AGI Meta-Architecture Enabling Both Goal Preservation and Radical Self-Improvement - 8 Alexey Potapov and Sergey Rodionov, Universal Empathy and Ethical Bias for Artificial General Intelligence - 9 András Kornai, Bounding the Impact of AGI - 10 Anders Sandberg, Ethics and Impact of Brain Emulations 11 Daniel Dewey, Long-Term Strategies for Ending Existential Risk from Fast Takeoff - 12 Mark Bishop, The Singularity, or How I Learned to Stop Worrying and Love AI -. (shrink)

Is it time for politics and political theory to face the challenge of artificial intelligence (AI)? It seems to be the case that political theory constantly lags behind technological developments. With rapid developments in the field of AI, a common estimate is that technological singularity will probably happen in the next 50 to 200 years. Even regardless of the time frame, the very possibility of superhumanly smart AIs poses serious political questions and calls for some serious political decisions. (...) Luckily, some scenarios are already provided by science fiction. The most common trope is that of a hostile AI taking over and destroying/enslaving humanity. Yet there is another path—AI takes over and makes itself a ruler (openly or behind the scenes), but rules in the genuine best interest of humanity. Such a turn of events, as described in Neal Asher’s Polity novels, may be an improvement compared to present political arrangements. It will, however, probably rob us of politics as such. (shrink)

If the intelligence of artificial systems were to surpass that of humans significantly, this would constitute a significant risk for humanity. Time has come to consider these issues, and this consideration must include progress in AI as much as insights from the theory of AI. The papers in this volume try to make cautious headway in setting the problem, evaluating predictions on the future of AI, proposing ways to ensure that AI systems will be beneficial to humans – (...) and critically evaluating such proposals. (shrink)

The study of rare diseases has long been an area of challenge for medical researchers, with agonizingly slow movement towards improved understanding of pathophysiology and treatments compared with more common illnesses. The push towards evidence-based medicine (EBM), which prioritizes certain types of evidence over others, poses a particular issue when mapped onto rare diseases, which may not be feasibly investigated using the methodologies endorsed by EBM, due to a number of constraints. While other trial designs have been suggested to overcome (...) these limitations (with varying success), perhaps the most recent and enthusiastically adopted is the application of artificial intelligence to rare disease data. This paper critically examines the pitfalls of EBM (and its trial design offshoots) as it pertains to rare diseases, exploring the current landscape of AI as a potential solution to these challenges. This discussion is also taken a step further, providing philosophical commentary on the weaknesses and dangers of AI algorithms applied to rare disease research. While not proposing a singular solution, this article does provide a thoughtful reminder that no ‘one-size-fits-all’ approach exists in the complex world of rare diseases. We must balance cautious optimism with critical evaluation of new research paradigms and technology, while at the same time not neglecting the ever-important aspect of patient values and preferences, which may be challenging to incorporate into computer-driven models. (shrink)

Smart city discourses often invoke the Panopticon, a disciplinary architecture designed by Jeremy Bentham and popularly theorized by Michel Foucault, as a model for understanding the social impact of AI technologies. This framing focuses attention almost exclusively on the negative ramifications of Urban AI, correlating ubiquitous surveillance, centralization, and data consolidation with AI development, and positioning technologies themselves as the driving factor shaping privacy, sociality, equity, access, and autonomy in the city. This paper describes an alternative diagram for Urban AI—the (...) Polyopticon: a distributed, polyvalent, multi-modal network of synthetic intelligences. It posits that fourth industrial revolution technologies change the political, social, and psychodynamic relationships of sentience and witness in the city, shifting the effects of watching and watched beyond the exclusive domain of top-down surveillance and discipline. The Polyopticon poses a more expansive and ambivalent spectrum of possibilities for Urban AI scenarios, one that undermines the totalizing, singular, and cerebral notion of intelligence that so often characterizes Urban AI and smart city critiques. (shrink)

The article delves into the conceptual frameworks surrounding artificial intelligence (AI) by juxtaposing it with natural intelligence and delineating the correlated notions. It enumerates the issues propelling the discourse on the explored topics. The author proposes a bifurcation between two polar concepts of artificial intelligence. The first is dubbed “imitative,” where AI is perceived in relation to natural intelligence as its technical recreation, capable of not only emulating but significantly outstripping its natural counterpart. A (...) prerequisite for embodying this concept is understanding natural intelligence; three approaches are examined: (a) acknowledging the lack of a precise understanding of natural intelligence, (b) exploring it from a biological perspective, and (c) analyzing it from a psychological perspective. The author articulates their own interpretation of natural intelligence, portraying it as a multifaceted amalgam of cultural, historical, social, and anthropological elements. From this vantage point, natural intelligence emerges not merely as a natural formation (thereby, discussions about the laws governing its function and evolution are warranted), but also as an “extra-natural” formation, its existence dictated by randomness and uniqueness, meaning natural intelligence evolves in a “singular” manner. In the context of comparing natural and artificial intelligence, the discussion encompasses several issues: the feasibility of the control of natural intelligence processes, the structure of neural networks, the superiority of computer programs in chess, the use of neural networks to write academic papers, and so forth. The conclusion posits that given artificial intelligence, despite its complexity, remains a technical invention orchestrated and brought to fruition by humans as a tool; society, if inclined to bestow AI with autonomy for tackling specific tasks, ought to do so prudently to prevent self-detriment and retain the ability to curtail or utterly revoke such autonomy. (shrink)

This chapter provides a rich philosophical discussion of superintelligence, a widely discussed piece that has encouraged philosophers of mind to take transhumanism, mind uploading, and the singularity more seriously. It starts with the argument for a singularity: is there good reason to believe that there will be an intelligence explosion? Next, the chapter considers how to negotiate the singularity: if it is possible that there will be a singularity, how can we maximize the chances of a good outcome? Finally, (...) it considers the place of humans in a post‐singularity world, with special attention to questions about uploading: can an uploaded human be conscious, and will uploading preserve personal identity? The chapter also analyzes whether there are certain constraints on design of artificial intelligence (AI) and AI+ that we might impose, in order to increase the chances of a good outcome. (shrink)

Machine learning, and more broadly artificial intelligence (AI), is a fascinating technology and can be considered as the closest approximation to the Cartesian “thinking thing” that humans have ever created. Just as the industrial revolution required a new ethos, the age of intelligent machines will create its own, challenging the established moral, economic, and political presuppositions. This paper discusses the relationship between AI and society; it presents several thought experiments to explore the complexity of the relationship and highlights (...) the insufficiency of the current normative paradigm in addressing technological expansion. I argue that many of the externalities, such as security risks, loss of privacy, and economic instability will result from trying to fit the emerging technologies into the existing frame of efficiency and utility, by redefining the notions of human value, identity, autonomy, purity, and truth, among others. The age of the intelligent machine is elevating alienation to new levels, treating the individual as mere patterns in data—its primary commodity. I further argue that while the possibility of unintended consequences, due to the potential misuse of AI is ever present, the intelligent machine per se is unlikely to engage in a zero-sum game for power on its own initiative. I question whether singularity is at all attainable and argue that technology will forever remain a proxy for human interests. I conclude by posing questions for charting the path forward. Through this analysis, I aim to provide a more nuanced understanding of the complex relationship between the AI and humans. (shrink)

Obsession toward technology has a long background of parallel evolution between humans and machines. This obsession became irrevocable when AI began to be a part of our daily lives. However, this AI integration became a subject of controversy when the fear of AI advancement in acquiring consciousness crept among mankind. Artificial consciousness is a long-debated topic in the field of artificial intelligence and neuroscience which has many ethical challenges and threats in society ranging from daily chores to (...) Mars missions. This paper deals with the impact of AI-based science fiction films in society. This study aims to investigate the fascinating AI concept of artificial consciousness in light of posthuman terminology, technological singularity and superintelligence by analyzing the set of science fiction films to project the actual difference between science fictional AI and operational AI. Further, this paper explores the theoretical possibilities of artificial consciousness through a range of neuroscientific theories that are related to AI development. These theories are built toward prospective artificial consciousness in AI. This study discloses the posthuman fallacies that are built around the fear of AI acquiring artificial consciousness and its outcome. (shrink)

Special Issue “Risks of artificial general intelligence”, Journal of Experimental and Theoretical Artificial Intelligence, 26/3 (2014), ed. Vincent C. Müller. http://www.tandfonline.com/toc/teta20/26/3# - Risks of general artificial intelligence, Vincent C. Müller, pages 297-301 - Autonomous technology and the greater human good - Steve Omohundro - pages 303-315 - - - The errors, insights and lessons of famous AI predictions – and what they mean for the future - Stuart Armstrong, Kaj Sotala & Seán S. Ó (...) hÉigeartaigh - pages 317-342 - - - The path to more general artificial intelligence - Ted Goertzel - pages 343-354 - - - Limitations and risks of machine ethics - Miles Brundage - pages 355-372 - - - Utility function security in artificially intelligent agents - Roman V. Yampolskiy - pages 373-389 - - - GOLEM: towards an AGI meta-architecture enabling both goal preservation and radical self-improvement - Ben Goertzel - pages 391-403 - - - Universal empathy and ethical bias for artificial general intelligence - Alexey Potapov & Sergey Rodionov - pages 405-416 - - - Bounding the impact of AGI - András Kornai - pages 417-438 - - - Ethics of brain emulations - Anders Sandberg - pages 439-457. (shrink)

A short article criticising two churches: those who believe in the Singularity (AIzilla) and those who believe that computers "cannot do x" (AItheist).

Recent findings about the capabilities of smart animals such as corvids or octopi and novel types of artificial intelligence, from social robots to cognitive assistants, are provoking the demand for new answers for meaningful comparison with other kinds of intelligence. This book fills this need by proposing a universal theory of intelligence which is based on causal learning as the central theme of intelligence. The goal is not just to describe, but mainly to explain queries (...) like why one kind of intelligence is more intelligent than another, whatsoever the intelligence. Shiny terms like "strong AI," "superintelligence," "singularity" or "artificial general intelligence" that have been coined by a Babylonian confusion of tongues are clarified on the way. (shrink)

In nearly ninety A-Z entries, Transcendence provides a multilayered look at the accelerating advances in artificial intelligence, cognitive science, genomics, information technology, nanotechnology, neuroscience, space exploration, synthetic biology, robotics, and virtual worlds that are making transhumanism a reality. Entries range from Cloning and Cyborg Feminism to Designer Babies and Memory-Editing Drugs. In addition, the book notes historical predecessors and personalities, both in mythology and history--ranging from Timothy Leary to Ray Kurzweil. It also introduces the culture around transhumanism, covering (...) all the geeky obsessions of the transhumanist movement"--Page 4 of cover. (shrink)

In general, existential threats are those that may potentially result in the extinction of the entire human species, if not significantly endanger its living population. Among the said threats include, but not limited to, pandemics and the impacts of a technological singularity. As regards pandemics, significant work has already been done on how to mitigate, if not prevent, the aftereffects of this type of disaster. For one, certain problem areas on how to properly manage pandemic responses have already been identified, (...) like the following: (a) not being able to learn from previous experiences, (b) the inability to act on warning signals, and (c) the failure to reach a global consensus on a problem (i.e., in a timely manner). In terms of a singularity, however, it may be said that further research is still needed, specifically on how to aptly respond to its projected negative outcomes. In this paper, by treating the three problem areas noted above as preliminary assessment measures of a country’s capacity to coordinate a national response to large-scale disasters, we examine the readiness of the Philippines in preparing for an intelligence explosion. By citing certain instances of how the said country, specifically its national government, faced the coronavirus disease 2019 pandemic, it puts forward the idea that the likely Philippine disaster response towards a singularity needs to be worked on, appealing for a more comprehensive assessment of such for a more informed response plan. (shrink)

Ray Kurzweil and others have posited that the confluence of nanotechnology, artificial intelligence, robotics, and genetic engineering will soon produce posthuman beings that will far surpass us in power and intelligence. Just as black holes constitute a ldquo;singularityrdquo; from which no information can escape, posthumans will constitute a ldquo;singularity:rdquo; whose aims and capacities lie beyond our ken. I argue that technological posthumanists, whether wittingly or unwittingly, draw upon the long-standing Christian discourse of ldquo;theosis,rdquo; according to which humans (...) are capable of being God or god-like. From St. Paul and Luther to Hegel and Kurzweil, the idea of human self-deification plays a prominent role. Hegel in particular emphasizes that God becomes wholly actualized only in the process by which humanity achieves absolute consciousness. Kurzweil agrees that God becomes fully actual only through historical processes that illuminate and thus transform the entire universe. The difference is that for Kurzweil and many other posthumanists, our offspringmdash;the posthumansmdash;will carry out this extraordinary process. What will happen to Home sapiens in the meantime is a daunting question. (shrink)

The singularity hypothesis is a radical hypothesis about the future of artificial intelligence on which self-improving artificial agents will quickly become orders of magnitude more intelligent than the average human. Despite the ambitiousness of its claims, the singularity hypothesis has been defended at length by leading philosophers and artificial intelligence researchers. In this paper, I argue that the singularity hypothesis rests on scientifically implausible growth assumptions. I show how leading philosophical defenses of the singularity hypothesis (...) (Chalmers 2010, Bostrom 2014) fail to overcome the case for skepticism. I conclude by drawing out philosophical implications of this discussion for our understanding of consciousness, personal identity, digital minds, existential risk, and ethical longtermism. GPI Working Paper No . 19-2022. (shrink)

What happens when machines become more intelligent than humans? One view is that this event will be followed by an explosion to ever-greater levels of intelligence, as each generation of machines creates more intelligent machines in turn. This intelligence explosion is now often known as the “singularity”. The basic argument here was set out by the statistician I.J. Good in his 1965 article “Speculations Concerning the First Ultraintelligent Machine”: Let an ultraintelligent machine be defined as a machine that (...) can far surpass all the intellectual activities of any man however clever. Since the design of machines is one of these intellectual activities, an ultraintelligent machine could design even better machines; there would then unquestionably be an “intelligence explosion”, and the intelligence of man would be left far behind. Thus the first ultraintelligent machine is the last invention that man need ever make. The key idea is that a machine that is more intelligent than humans will be better than humans at designing machines. So it will be capable of designing a machine more intelligent than the most intelligent machine that humans can design. So if it is itself designed by humans, it will be capable of designing a machine more intelligent than itself. By similar reasoning, this next machine will also be capable of designing a machine more intelligent than itself. If every machine in turn does what it is capable of, we should expect a sequence of ever more intelligent machines. This intelligence explosion is sometimes combined with another idea, which we might call the “speed explosion”. The argument for a speed explosion starts from the familiar observation that computer processing speed doubles at regular intervals. Suppose that speed doubles every two years and will do so indefinitely. Now suppose that we have human-level artificial intelligence 1 designing new processors. Then faster processing will lead to faster designers and an ever-faster design cycle, leading to a limit point soon afterwards. The argument for a speed explosion was set out by the artificial intelligence researcher Ray Solomonoff in his 1985 article “The Time Scale of Artificial Intelligence”.1 Eliezer Yudkowsky gives a succinct version of the argument in his 1996 article “Staring at the Singularity”: “Computing speed doubles every two subjective years of work.. (shrink)

This article interrogates the challenge artificial general intelligence (AGI) poses to religion and human societies, in general. More specifically, it seeks to respond to “Singularity”—when machines reach a level of intelligence that would put into question the privileged position humanity enjoys as imago Dei . Employing the Bemba notion of mystico‐relationality in dialogue with the concepts of the “created co‐creator” and Christ the Key, it argues for the possibility of AI participating in imago Dei . The findings (...) show that imaging is a fluid, participatory activity that aims at likeness, but also social harmony. It also argues that God is the only original creator, humans are created creators, and that every aspect of visible existence, including AI, is inherently divine imaging. However, strong imaging is only attainable based on the only One and True Image—Christ, whose union of the material and the divine means that all creation can image, excluding nothing, even AI. (shrink)

This special interactive interdisciplinary issue of JCS on the singularity and the future relationship of humanity and AI is the first of two issues centered on David Chalmers’ 2010 JCS article ‘The Singularity, a Philosophical Analysis’. These issues include more than 20 solicited commentaries to which Chalmers responds. To quote Chalmers: -/- "One might think that the singularity would be of great interest to Academic philosophers, cognitive scientists, and artificial intelligence researchers. In practice, this has not been the (...) case. Good was an eminent academic, but his article was largely unappreciated at the time. The subsequent discussion of the singularity has largely taken place in non-academic circles, including Internet forums, popular media and books, and workshops organized by the independent Singularity Institute. Perhaps the highly speculative flavour of the singularity idea has been responsible for academic resistance to it. I think this resistance is a shame, as the singularity idea is clearly an important one. The argument for a singularity is one that we should take seriously. And the questions surrounding the singularity are of enormous practical and philosophical concern". -/- It is fair to say that Chalmers is the first to provide a detailed comprehensive philosophical analysis of the idea of the singularity that brings into focus not only questions about the nature of intelligence and the prospects for an intelligence explosion but also important philosophical questions about consciousness, identity and the relationship between facts and values. (shrink)

Artificial intelligence algorithms, fueled by continuous technological development and increased computing power, have proven effective across a variety of tasks. Concurrently, quantum computers have shown promise in solving problems beyond the reach of classical computers. These advancements have contributed to a misconception that quantum computers enable hypercomputation, sparking speculation about quantum supremacy leading to an intelligence explosion and the creation of superintelligent agents. We challenge this notion, arguing that current evidence does not support the idea that quantum (...) technologies enable hypercomputation. Fundamental limitations on information storage within finite spaces and the accessibility of information from quantum states constrain quantum computers from surpassing the Turing computing barrier. While quantum technologies may offer exponential speed-ups in specific computing cases, there is insufficient evidence to suggest that focusing solely on quantum-related problems will lead to technological singularity and the emergence of superintelligence. Subsequently, there is no premise suggesting that general intelligence depends on quantum effects or that accelerating existing algorithms through quantum means will replicate true intelligence. We propose that if superintelligence is to be achieved, it will not be solely through quantum technologies. Instead, the attainment of superintelligence remains a conceptual challenge that humanity has yet to overcome, with quantum technologies showing no clear path toward its resolution. (shrink)

The technological singularity is popularly envisioned as a point in time when (a) an explosion of growth in artificial intelligence (AI) leads to machines becoming smarter than humans in every capacity, even gaining consciousness in the process; or (b) humans become so integrated with AI that we could no longer be called human in the traditional sense. This article argues that the technological singularity does not represent a point in time but a process in the ongoing construction of (...) a collective consciousness. Innovations from the earliest graphic representations to the present reduced the time it took to transmit information, reducing the cognitive space between individuals. The steady pace of innovations ultimately led to the communications satellite, fast-tracking this collective consciousness. The development of AI in the late 1960s has been the latest innovation in this process, increasing the speed of information while allowing individuals to shape events as they happen. (shrink)

This paper focuses on the research field of machine ethics and how it relates to a technological singularity—a hypothesized, futuristic event where artificial machines will have greater-than-human-level intelligence. One problem related to the singularity centers on the issue of whether human values and norms would survive such an event. To somehow ensure this, a number of artificial intelligence researchers have opted to focus on the development of artificial moral agents, which refers to machines capable of (...) moral reasoning, judgment, and decision-making. To date, different frameworks on how to arrive at these agents have been put forward. However, there seems to be no hard consensus as to which framework would likely yield a positive result. With the body of work that they have contributed in the study of moral agency, philosophers may contribute to the growing literature on artificial moral agency. While doing so, they could also think about how the said concept could affect other important philosophical concepts. (shrink)

This volume contains a selection of authoritative essays exploring the central questions raised by the conjectured technological singularity. In informed yet jargon-free contributions written by active research scientists, philosophers and sociologists, it goes beyond philosophical discussion to provide a detailed account of the risks that the singularity poses to human society and, perhaps most usefully, the possible actions that society and technologists can take to manage the journey to any singularity in a way that ensures a positive rather than a (...) negative impact on society. The discussions provide perspectives that cover technological, political and business issues. The aim is to bring clarity and rigor to the debate in a way that will inform and stimulate both experts and interested general readers. (shrink)

More intellectual modesty, but also conceptual clarity is urgently needed in AI, perhaps more than in many other disciplines. AI research has been coined by hypes and hubris since its early beginnings in the 1950s. For instance, the Nobel laureate Herbert Simon predicted after his participation in the Dartmouth workshop that “machines will be capable, within 20 years, of doing any work that a man can do”. And expectations are in some circles still high to overblown today. This paper addresses (...) the demand for conceptual clarity and introduces precise definitions of “strong AI”, “superintelligence”, the “technological singularity”, and “artificial general intelligence” which ground in the work by the computer scientist Judea Pearl and the psychologist Howard Gardner. These clarifications allow us to embed famous arguments from the philosophy of AI in a more analytic context. (shrink)

This essay reviews different definitions and models of technological singularity. The models range from conceptual sketches to detailed endogenous growth models, as well as attempts to fit empirical data to quantitative models.

The problem of the ontological limit of Artificial Intelligence and transhumanism in contrast with the ontology of Homo sapiens is discussed. Beyond the so-called exogenous or endogenous integration, the scenario of a technological singularity seems to materialize in entities that synthesize biology and technology, for example, by means of a download or transbiomorphosis that translates the neural networks of our mind into the memory of a computer. This is a hybridization that warns us about the advent of new (...) species that could leave Homo sapiens behind. If the human/machine synthesis is the limit desired by the transhumanist program, this limit seems to have crossed, in turn, the very ontological limit of the human, on which science, philosophy and religion had so far more or less agreed –each presenting their own cards. (shrink)

Singularity has been a concern of the developers of cybernetics and artificial intelligence (AI) since the pioneering writings of such thinkers as Norbert Weiner. Yet many accept the inevitability of systems of AI surpassing human control and are optimistic that machine intelligence will harmonize human life with our environment. This essay examines this optimism against a reading of two poets: Richard Brautigan and Friedrich Hölderlin. Through these readings, it will attempt to show that the eclipse of nature (...) by human beings can be used to examine the eclipse of the human being by machine intelligence. Thus, what is missing in machine intelligence is a dimension related to the experience of pain and joy that reconnect us to reflect on what has been severed or lost in the movement of humanity through history. This demonstrates that the very categories of optimism and pessimism concerning the future of AI points to the value of life, one that can never be encoded into our machines. (shrink)

The concept of “technological singularity”, while controversial, is typically applied to predict the next explosion of intelligence related to advances in computers and artificial intelligence. A potential “rise of machines” has been explored at length by Ray Kurzweil, Vernor Vinge, and many other scholars and futuristic enthusiasts. This study focuses on the fundamentals of the concept of technological singularity to understand the technological evolution of humankind based on the four main characteristics that constitute this concept. When this (...) method is applied to a historical view, it is possible to isolate four technologies worthy of being called “singularities”. In fact, these technologies have formed the basis of human evolution by drastically changing our interaction with the environment, changing how we understand our place in the universe, changing our social behaviour and organizational structure, boosting human intelligence and explaining demographic explosions. (shrink)

Consequential historical decisions that shaped transportation systems and their influence on society have many valuable lessons. The decisions we learn from and choose to make going forward will play a key role in shaping the mobility landscape of the future. This is especially pertinent as artificial intelligence (AI) becomes more prevalent in the form of autonomous vehicles (AVs). Throughout urban history, there have been cyclical transport oppressions of previous-generation transportation methods to make way for novel transport methods. These (...) cyclical oppressions can be identified in the baroque and modernist periods, and a third oppression may occur in the contemporary period. To explore the idea of a third oppression, we focus on the bicycle and outline the history of cycling to understand how historical mode oppression unfolded. We then present several social and political factors that contributed to the oppression of cycling and share recommendations for how to avoid future oppressions including political, social, and design actions for researchers and policymakers to take. This paper argues that priorities for AI-enabled mobility and cyclist needs be advanced in proportion to the extent that they contribute to societal goals of urban containment, public realm, and proximal cities. Additionally, future mobility evolutions should prioritise mobility justice and mode choice over inducing a singular transportation method. (shrink)

Mundus vult decipi, ergo decipiatur—the world wants to be deceived, so let it be deceived.Artificial intelligence has been a deceiving discipline: AI addresses those tasks that, if performed by humans, would require intelligence, but have been solved without featuring any genuine intelligence. This delusion has come, in return, with algorithmic techniques that can reliably solve many of these tasks, from game playing to pattern recognition. AI applications are a success.However, AI has not solved “what makes [us] (...) clever, the puzzle of intelligence”. Those that expect that this book brings the answer will have their hopes deceived. This book is about what does not make us clever, a restatement of Fodor’s “The mind doesn’t work that way” . Partridge swings between condescending scepticism and bitter negativism with most of what AI has become, and reaches fierce disparagement of the technological singularity visionaries.The main message of the book is that science is stil .. (shrink)

According to the singularity hypothesis, rapid and accelerating technological progress will in due course lead to the creation of a human-level artificial intelligence capable of designing a successor artificial intelligence of significantly greater cognitive prowess, and this will inaugurate a series of increasingly super-intelligent machines. But how much sense can we make of the idea of a being whose cognitive architecture is qualitatively superior to our own? This article argues that one fundamental limitation of human cognitive (...) architecture is an inbuilt commitment to a metaphysical division between subject and object, a commitment that could be overcome in an artificial intelligence lacking our biological heritage. (shrink)

Many writers who have discussed the Singularity have treated it not only as the inevitable outcome of advancements in cybernetic technology, but also as natural consequence of broader patterns in the development of human knowledge, or of human history itself. In this paper I examine these claims in light of Karl Popper’s famous philosophical critique of historicism. I argue that, because the Singularity is regarded as both a product of human ingenuity and a reflection of the permanent limitations of our (...) rational capacities, speculation about its likelihood occupies an interesting border zone between what Popper referred to as “technological prediction” and what he lambasted as “prophecy.” I go on to examine representations of a post-singularity world in the novels of Iain M. Banks, as well as in Bruce Sterling’s short story “The Beautiful and the Sublime.” These narratives demonstrate how trying to imagine what human life might be like in the presence of intellectually superior AIs requires a more aggressively skeptical attitude toward the human capacity to understand our own history than even Popper was prepared to allow for. (shrink)

The present paper criticizes Chalmers's discussion of the Singularity, viewed as the emergence of a superhuman intelligence via the self-amplifying development of artificial intelligence. The situated and embodied view of cognition rejects the notion that intelligence could arise in a closed 'brain-in-a-vat' system, because intelligence is rooted in a high-bandwidth, sensory-motor interaction with the outside world. Instead, it is proposed that superhuman intelligence can emerge only in a distributed fashion, in the form of a (...) self-organizing network of humans, computers, and other technologies: the 'Global Brain'. (shrink)

Artificial intelligence in all its developments is advancing faster than the capacity of institutions and organizations to offer legal, but also deontological responses: assuming the ethical implications of the new digital scenarios where technology learns from human routines to personalize content is fundamental from the academic, politicy and business spheres. This paper offers an interpretative framework of the evolution of smart speakers and voice assistants as tools for information singularization in parallel to the study of the European framework (...) for the creation of an ethics of ai. The results show an effort by institutions to respond to an unstoppable progress and demonstrate that ai cannot be addressed by legal regulation alone but is above all a matter of ethical preference. (shrink)

The book by Max Tegmark draws attention to the dangers and benefits that await humanity as a result of the Artificial Intelligence (AI) technologies development. Cosmologist and astrophysicist Tegmark, realizing the impossibility to predict the AI development, offers exciting scenarios of civilization development options for tens, thousands, millions and billions of years. The analysis of the opposite scenarios is aimed at the idea formation that the consequences of creating a general AI, superior to the human level, will be (...) more significant than from all other achievements of civilization. Tegmark is one of the founders and leaders of the “Beneficial AGI” movement, he presents the results of the discussion of the issues he raises with leading experts in the field of AI. Tegmark concludes his book with a call to optimism: “My book urge you to think about what future you would like, and not what future scares you, this way we can find goals for which it’s worth working”. (shrink)

The potential for Large Language Models (LLMs) to attain technological singularity—the point at which artificial intelligence (AI) surpasses human intellect and autonomously improves itself—is a critical concern in AI research. This paper explores the feasibility of current LLMs achieving singularity by examining the philosophical and practical requirements for such a development. We begin with a historical overview of AI and intelligence amplification, tracing the evolution of LLMs from their origins to state-of-the-art models. We then proposes a theoretical (...) framework to assess whether existing LLM technologies could satisfy the conditions for singularity, with a focus on Recursive Self-Improvement (RSI) and autonomous code generation. We integrate key component technologies, such as Reinforcement Learning from Human Feedback (RLHF) and Direct Preference Optimization (DPO), into our analysis, illustrating how these could enable LLMs to independently enhance their reasoning and problem-solving capabilities. By mapping out a potential singularity model lifecycle and examining the dynamics of exponential growth models, we elucidate the conditions under which LLMs might self-replicate and rapidly escalate their intelligence. We conclude with a discussion of the ethical and safety implications of such developments, underscoring the need for responsible and controlled advancement in AI research to mitigate existential risks. Our work aims to contribute to the ongoing dialogue on the future of AI and the critical importance of proactive measures to ensure its beneficial development. (shrink)