We propose developing AIs whose only final goal is being shut down. We argue that this approach to AI safety has three benefits: (i) it could potentially be implemented in reinforcement learning, (ii) it avoids some dangerous instrumental convergence dynamics, and (iii) it creates trip wires for monitoring dangerous capabilities. We also argue that the proposal can overcome a key challenge raised by Soares et al. (2015), that shutdown-seeking AIs will manipulate humans into shutting them down. We conclude by comparing (...) our approach with Soares et al.'s corrigibility framework. (shrink)

With the rise of the system approach in World War II, US-engineers developed new design techniques to manage complex socio-technical systems, especially military ones. One of these new methods was the use of block diagrams which should guarantee a rational design process without eliminating the traditional visual habitus of the engineering community. This text argues that the block diagram, as a new visual design method, was embedded in the process of establishing a new engineering science, called system engineering. Furthermore, the (...) block diagram symbolized the changed role of technical experts in the Cold War era, who were regarded as competent problem solvers and as a community that could protect the national security by developing complex military technology. Two images, that were parts of advertisments in theScientific American, shall be used to demonstrate the block diagram’s function in the public sphere as a symbol that represents a new technocratic interpretation of modernity. (shrink)

This paper presents a direction for narrative ethics based on ethical ideas found in the works of Michel Foucault. Narrative ethics is understood here at the meta-level of cultural discourse to see how the moral subject is constituted by the discursive practices that structure the contemporary debate on reproductive technologies. At this level it becomes meta-narrative-ethics. After a theoretical discussion, this paper uses two literary narratives representing the polarized views in the debate to show how the moral subject may be (...) compelled to relate to its self. Ethics is redefined as Foucauldian rapport à soi, and ethical analysis, at this meta-level, shows how the moral self is intimately connected to cultural discourse. (shrink)

Foreword by Oliver Sacks Kurt Goldstein (1878-1965) was already an established neuropsychologist when he emigrated from Germany to the United States in the 1930s. This book, his magnum opus and widely regarded as a modern classic in psychology and biology, grew out of his dissatisfaction with traditional natural science techniques for analyzing living beings. It offers a broad introduction to the sources and ranges of application of the "holistic" or "organismic" research program that has since become a standard part (...) of biological thought. Goldstein was especially concerned with the breakdown of organization and the failure of central controls that take place in catastrophic responses to situations such as physical or mental illness. But he was equally attuned to the amazing powers of the organism to readjust to such catastrophic losses, if only by withdrawal to a more limited range that it could manage by a redistribution of its reduced energies, thus reclaiming as much wholeness as new circumstances allowed. Goldstein's theses in The Organism have had an important impact on philosophical and psychological thought throughout the twentieth century, as evidenced in the work of Maurice Merleau-Ponty, Georges Canguilhem, Ernst Cassirer, and Ludwig Binswanger. (shrink)

I will contrast the two main approaches to the foundations of statistical mechanics: the individualist approach and the ensemblist approach. I will indicate the virtues of each, and argue that the conflict between them is perhaps not as great as often imagined.

[Correction Notice: An erratum for this article was reported in Vol 109 of Psychological Review. Due to circumstances that were beyond the control of the authors, the studies reported in "Models of Ecological Rationality: The Recognition Heuristic," by Daniel G. Goldstein and Gerd Gigerenzer overlap with studies reported in "The Recognition Heuristic: How Ignorance Makes Us Smart," by the same authors and with studies reported in "Inference From Ignorance: The Recognition Heuristic". In addition, Figure 3 in the Psychological Review (...) article was originally published in the book chapter and should have carried a note saying that it was used by permission of Oxford University Press.] One view of heuristics is that they are imperfect versions of optimal statistical procedures considered too complicated for ordinary minds to carry out. In contrast, the authors consider heuristics to be adaptive strategies that evolved in tandem with fundamental psychological mechanisms. The recognition heuristic, arguably the most frugal of all heuristics, makes inferences from patterns of missing knowledge. This heuristic exploits a fundamental adaptation of many organisms: the vast, sensitive, and reliable capacity for recognition. The authors specify the conditions under which the recognition heuristic is successful and when it leads to the counter-intuitive less-is-more effect in which less knowledge is better than more for making accurate inferences. (shrink)

This paper examines the question of whether Large Language Models (LLMs) like ChatGPT possess minds, focusing specifically on whether they have a genuine folk psychology encompassing beliefs, desires, and intentions. We approach this question by investigating two key aspects: internal representations and dispositions to act. First, we survey various philosophical theories of representation, including informational, causal, structural, and teleosemantic accounts, arguing that LLMs satisfy key conditions proposed by each. We draw on recent interpretability research in machine learning to support these (...) claims. Second, we explore whether LLMs exhibit robust dispositions to perform actions, a necessary component of folk psychology. We consider two prominent philosophical traditions, interpretationism and representationalism, to assess LLM action dispositions. While we find evidence suggesting LLMs may satisfy some criteria for having a mind, particularly in game-theoretic environments, we conclude that the data remains inconclusive. Additionally, we reply to several skeptical challenges to LLM folk psychology, including issues of sensory grounding, the "stochastic parrots" argument, and concerns about memorization. Our paper has three main upshots. First, LLMs do have robust internal representations. Second, there is an open question to answer about whether LLMs have robust action dispositions. Third, existing skeptical challenges to LLM representation do not survive philosophical scrutiny. (shrink)

Under what conditions would an artificially intelligent system have wellbeing? Despite its clear bearing on the ethics of human interactions with artificial systems, this question has received little direct attention. Because all major theories of wellbeing hold that an individual’s welfare level is partially determined by their mental life, we begin by considering whether artificial systems have mental states. We show that a wide range of theories of mental states, when combined with leading theories of wellbeing, predict that certain existing (...) artificial systems have wellbeing. Along the way, we argue that there are good reasons to believe that artificial systems can have wellbeing even if they are not phenomenally conscious. While we do not claim to demonstrate conclusively that AI systems have wellbeing, we argue that there is a significant probability that some AI systems have or will soon have wellbeing, and that this should lead us to reassess our relationship with the intelligent systems we create. (shrink)

It is generally assumed that existing artificial systems are not phenomenally conscious, and that the construction of phenomenally conscious artificial systems would require significant technological progress if it is possible at all. We challenge this assumption by arguing that if Global Workspace Theory (GWT) — a leading scientific theory of phenomenal consciousness — is correct, then instances of one widely implemented AI architecture, the artificial language agent, might easily be made phenomenally conscious if they are not already. Along the way, (...) we articulate an explicit methodology for thinking about how to apply scientific theories of consciousness to artificial systems and employ this methodology to arrive at a set of necessary and sufficient conditions for phenomenal consciousness according to GWT. (shrink)

Bohmian mechanics, which is also called the de Broglie-Bohm theory, the pilot-wave model, and the causal interpretation of quantum mechanics, is a version of quantum theory discovered by Louis de Broglie in 1927 and rediscovered by David Bohm in 1952. It is the simplest example of what is often called a hidden variables interpretation of quantum mechanics. In Bohmian mechanics a system of particles is described in part by its wave function, evolving, as usual, according to Schrödinger's equation. However, the (...) wave function provides only a partial description of the system. This description is completed by the specification of the actual positions of the particles. The latter evolve according to the.. (shrink)

Recent advances in natural language processing have given rise to a new kind of AI architecture: the language agent. By repeatedly calling an LLM to perform a variety of cognitive tasks, language agents are able to function autonomously to pursue goals specified in natural language and stored in a human-readable format. Because of their architecture, language agents exhibit behavior that is predictable according to the laws of folk psychology: they function as though they have desires and beliefs, and then make (...) and update plans to pursue their desires given their beliefs. We argue that the rise of language agents significantly reduces the probability of an existential catastrophe due to loss of control over an AGI. This is because the probability of such an existential catastrophe is proportional to the difficulty of aligning AGI systems, and language agents significantly reduce that difficulty. In particular, language agents help to resolve three important issues related to aligning AIs: reward misspecification, goal misgeneralization, and uninterpretability. (shrink)

In this paper I argue that there is a preface paradox for intention. The preface paradox for intention shows that intentions do not obey an agglomeration norm, requiring one to intend conjunctions of whatever else one intends. But what norms do intentions obey? I will argue that intentions come in degrees. These partial intentions are governed by the norms of the probability calculus. First, I will give a dispositional theory of partial intention, on which degrees of intention are the degrees (...) to which one possesses the dispositions characteristic of full intention. I will use this dispositional theory to defend probabilism about intention. Next, I will offer a more general argument for probabilism about intention. To do so, I will generalize recent decision theoretic arguments for probabilism from the case of belief to the case of intention. (shrink)

In lieu of an abstract, here is a brief excerpt of the content:Bibliography of Resources by and about André E. Hellegers*Compiled by Doris Mueller Goldstein (bio)This bibliography is derived from the holdings of the National Reference Center for Bioethics Literature and the BIOETHICSLINE© database (both of which are at the Kennedy Institute of Ethics and supported by the National Library of Medicine); the archives of Lauinger Library, Georgetown University; the Medline databases of the National Library of Medicine; the WorldCat (...) database of OCLC, Dublin, Ohio, and selected Internet sites.Primarily comprised of writings by Dr. Hellegers, the list also includes interviews and media programs in which he participated, as well as writings about him that were written following his death. The arrangement within each section is by date. The 231 authored pieces reflect the transition from Dr. Hellegers’s early career as a researcher in fetal physiology at Johns Hopkins Medical School, where he published his first research report at the age of 29, to the early years of the Kennedy Institute, where he produced so many provocative columns on bioethical issues that influenced the growth of the field.Due to the diversity of sources and the 40-year time span covered, there are some variations in bibliographic style. Time and availability constraints precluded verifying all of the citations with the original documents. Any additions or corrections should be submitted to the compiler.Works Authored by André E. HellegersNo Date Ethical Issues in Sterilization of the Retarded. Unpublished paper.1956Vitamin B12 Serum Level and Pregnancy. American Journal of Clinical Nutrition 4: 440+, 1956. [With Bacon F. Chow and Kunio Okuda] [End Page 89]1957Vitamin B12 Absorption in Pregnancy and in the Newborn. American Journal of Clinical Nutrition 5: 327+, 1957. [With Bacon F. Chow, Robert E. L. Nesbitt, Kunio Okuda, and David W. Smith]1958The Effects of Acute Hypoxia on the Osmotic Pressure of the Plasma. Quarterly Journal of Experimental Physiology 43: 197+, 1958. [With Donald H. Barron, Frederick C. Battaglia, and Giacomo Meschia]Studies on the Absorption of Vitamin B12 in Human Pregnancy with Especial Reference to the Effect of D-Sorbitol. American Journal of Obstetrics and Gynecology 76: 91+, 1958. [With Bacon F. Chow, Harry Prystowsky, and Vernon Wong]1959The Alveolar PCO2 and PO2 in Pregnant and Nonpregnant Women at Altitude. Proceedings of the Society for Clinical Investigation 38: 1010+, 1959. [With Donald Barron, William Huckabee, Giacomo Meschia, James Metcalfe, and Harry Prystowsky]A Comparison of the Oxygen Dissociation Curves of the Bloods of Maternal and Fetal Goats at Various pHs. Quarterly Journal of Experimental Physiology 44: 215–21, July 1959. [With Donald Barron, Giacomo Meschia, Harry Prystowsky, and A. Stark Wolkoff]Fetal Blood Studies. XII. On the Relationship Between the Position of the Oxygen Dissociation Curve of Human Fetal Blood and Adult Fetal Hemoglobin. American Journal of Obstetrics and Gynecology 77: 585+, 1959. [With Paul D. Bruns, Julian Cotter, and Harry Prystowsky]Fetal Blood Studies. XIV. A Comparative Study of the Oxygen Dissociation Curve of Nonpregnant, Pregnant and Fetal Human Blood. American Journal of Obstetrics and Gynecology 78: 489–93, September 1959. [With Paul D. Bruns and Harry Prystowsky]Fetal Blood Studies. XVI. On the Changes in Total Osmotic Pressure and Sodium and Potassium Concentration of Amniotic Fluid During the Course of Human Gestation. Surgery, Gynecology and Obstetrics 109: 509–12, October 1959. [With Frederick Battaglia, Paul D. Bruns, Harry Prystowsky, and Clayton Smisson]Further Observations on the Metabolism of Vitamin B12 in Human Pregnancy. American Journal of Obstetrics and Gynecology 77: 1+, 1959. [With Bacon F. Chow, Harry Prystowsky, Bruno Ranke, and Elma Ranke]The Oxygen Dissociation Curves of the Bloods of Adult and Fetal Llamas. Federation Proceedings 18, 1959. [With Donald Barron, William Huckabee, Giacomo Meschia, James Metcalfe, and Harry Prystowsky] [End Page 90]Transfer of Oxygen Across the Sheep Placenta at High Altitude. Federation Proceedings 18, 1959. [With Donald Barron, William Huckabee, Giacomo Meschia, and Harry Prystowsky]Uterine Blood Flow and Metabolism in Pregnant Sheep at High Altitude. Federation Proceedings 18, 1959. [With Donald Barron, William Huckabee, Giacomo Meschia, James Metcalfe, and Harry Prystowsky]Uterine Blood Flow and Metabolism in Unanesthetized Pregnant Sheep. Federation Proceedings 18, 1959. [With Donald Barron, William Huckabee, Giacomo... (shrink)

Laurence Goldstein gives a straightforward and lively account of some of the central themes of Wittgenstein's writings on meaning, mind, and mathematics.

Contextology is the science of the dynamics of the conversational context. Contextology formulates laws governing how the shared information states of interlocutors evolve in response to assertion. More precisely, the contextologist attempts to construct a function which, when provided with just a conversation’s pre-update context and the content of an assertion, delivers that conversation’s post-update context. Most contextologists have assumed that the function governing the evolution of the context is simple: the post-update context is just the pre-update context intersected with (...) the content of the assertion. We argue that this assumption is wrong: not only is it false, it is also incoherent given standard contextological assumptions. Moreover, it is impossible in principle to revise it to correctly describe the dynamics of context. We conclude that there can be no science of Contextology. The laws governing the evolution of the context in response to assertion must make essential reference to the private information states of interlocutors. (shrink)

This paper develops an information-sensitive theory of the semantics and probability of conditionals and statements involving epistemic modals. The theory validates a number of principles linking probability and modality, including the principle that the probability of a conditional If A, then C equals the probability of C, updated with A. The theory avoids so-called triviality results, which are standardly taken to show that principles of this sort cannot be validated. To achieve this, we deny that rational agents update their credences (...) via conditionalization. We offer a new rule of update, Hyperconditionalization, which agrees with Conditionalization whenever nonmodal statements are at stake but differs for modal and conditional sentences. (shrink)

In the last quarter of the nineteenth century, Ludwig Boltzmann explained how irreversible macroscopic laws, in particular the second law of thermodynamics, originate in the time-reversible laws of microscopic physics. Boltzmann’s analysis, the essence of which I shall review here, is basically correct. The most famous criticisms of Boltzmann’s later work on the subject have little merit. Most twentieth century innovations – such as the identification of the state of a physical system with a probability distribution on its phase space, (...) of its thermodynamic entropy with the Gibbs entropy of , and the invocation of the notions of ergodicity and mixing for the justification of the foundations of statistical mechanics – are thoroughly misguided. (shrink)

Recent research has identified a tension between the Safety principle that knowledge is belief without risk of error, and the Closure principle that knowledge is preserved by competent deduction. Timothy Williamson reconciles Safety and Closure by proposing that when an agent deduces a conclusion from some premises, the agent’s method for believing the conclusion includes their method for believing each premise. We argue that this theory is untenable because it implies problematically easy epistemic access to one’s methods. Several possible solutions (...) are explored and rejected. (shrink)

Recent philosophical literature on epistemic harms has paid little attention to the difference between deliberate and non-deliberate harms. In this paper, I analyze the “Curare Case,” a case from the 1940’s in which patient testimony was disregarded by physicians. This case has been described as an instance of epistemic injustice. I problematize this description, arguing instead that the case shows an instance of “epistemic disadvantage.” I propose epistemic disadvantage indicates when harms result from warranted asymmetric relations that justifiably exclude individuals (...) from hermeneutical participation. Epistemic disadvantage categorizes harms that result from justifiable exclusions, are non-deliberate, and result from poor epistemic environments. This analysis brings out a meaningful difference between accidental and deliberate harms in communicative exchanges. (shrink)

Bohmian mechanics is arguably the most naively obvious embedding imaginable of Schr¨ odinger’s equation into a completely coherent physical theory. It describes a world in which particles move in a highly non-Newtonian sort of way, one which may at first appear to have little to do with the spectrum of predictions of quantum mechanics. It turns out, however, that as a consequence of the defining dynamical equations of Bohmian mechanics, when a system has wave function ψ its configuration is typically (...) random, with probability density ρ given by |ψ|2, the quantum equilibrium distribution. It also turns out that the entire quantum formalism, operators as observables and all the rest, naturally emerges in Bohmian mechanics from the analysis of “measurements.” This analysis reveals the status of operators as observables in the description of quantum phenomena, and facilitates a clear view of the range of applicability of the usual quantum mechanical formulas. (shrink)

This paper explores the principle that knowledge is fragile, in that whenever S knows that S doesn’t know that S knows that p, S thereby fails to know p. Fragility is motivated by the infelicity of dubious assertions, utterances which assert p while acknowledging higher-order ignorance whether p. Fragility is interestingly weaker than KK, the principle that if S knows p, then S knows that S knows p. Existing theories of knowledge which deny KK by accepting a Margin for Error (...) principle can be conservatively extended with Fragility. (shrink)

The renewed interest in the foundations of quantum statistical mechanics in recent years has led us to study John von Neumann’s 1929 article on the quantum ergodic theorem. We have found this almost forgotten article, which until now has been available only in German, to be a treasure chest, and to be much misunderstood. In it, von Neumann studied the long-time behavior of macroscopic quantum systems. While one of the two theorems announced in his title, the one he calls the (...) “quantum H-theorem,” is actually a much weaker statement than Boltzmann’s classical H-theorem, the other theorem, which he calls the “quantum ergodic theorem,” is a beautiful and very non-trivial result. It expresses a fact we call “normal typicality” and can be summarized as follows: For a “typical” finite family of commuting macroscopic observables, every initial wave function ψ0 from a micro-canonical energy shell so evolves that for most times t in the long run, the joint probability distribution of these observables obtained from ψ is close to.. (shrink)

In [3] John S. Bell proposed how to associate particle trajectories with a lattice quantum field theory, yielding what can be regarded as a |Ψ|2-distributed Markov process on the appropriate configuration space. A similar process can be defined in the continuum, for more or less any regularized quantum field theory; such processes we call Bell-type quantum field theories. We describe methods for explicitly constructing these processes. These concern, in addition to the definition of the Markov processes, the efficient calculation of (...) jump rates, how to obtain the process from the processes corresponding to the free and interaction Hamiltonian alone, and how to obtain the free process from the free Hamiltonian or, alternatively, from the one-particle process by a construction analogous to “second quantization.” As an example, we consider the process for a second quantized Dirac field in an external electromagnetic field. (shrink)

A syntactically correct number-specification may fail to specify any number due to underspecification. For similar reasons, although each sentence in the Yablo sequence is syntactically perfect, none yields a statement with any truth-value. As is true of all members of the Liar family, the sentences in the Yablo sequence are so constructed that the specification of their truth-conditions is vacuous; the Yablo sentences fail to yield statements. The ‘revenge’ problem is easily defused. The solution to the semantical paradoxes offered here (...) revives the mediaeval cassatio approach, one that largely disappeared due to its incomprehending rejection by influential contemporary writers such as William Shyreswood and Thomas Bradwardine. The diagnosis readily extends to the set-theoretic paradoxes. (shrink)

Book Information Nature's Purposes: Analyses of Function and Design in Biology. Edited by Allen Colin, Bekoff Mark and Lauder George. MIT Press. Cambridge. 1998. Pp. vi + 597. Paperback, US$31.50.

Quality and service improvement (QSI) research employs a broad range of methods to enhance the efficiency of healthcare delivery. QSI research differs from traditional healthcare research and poses unique ethical questions. Since QSI research aims to generate knowledge to enhance quality improvement efforts, should it be considered research for regulatory purposes? Is review by a research ethics committee required? Should healthcare providers be considered research participants? If participation in QSI research entails no more than minimal risk, is consent required? The (...) lack of consensus on answers to these questions highlights the need for ethical guidance. Three distinct approaches to classifying QSI research in accordance with existing ethical principles and regulations can be found in the literature. In the first approach, QSI research is viewed as distinct from other types of healthcare research and does not require regulation. In the second approach, QSI research falls within regulatory guidelines but is exempt from research ethics committee review. In the third approach, QSI research is deemed to be part of the learning healthcare system and, as such, is subject to a different set of ethical principles entirely. In this paper, we critically assess each of these views. While none of these approaches is entirely satisfactory, we argue that use of the ethical principles governing research provides the best means of addressing the numerous questions posed by QSI research. (shrink)

Is it possible not to have a sense of the historical? I remember how surprised I was when I first saw the Church of the Holy Sepulchre in Jerusalem, and how I had no doubt that the people who lived and worked around it surely must not have such a sense. I now suppose that I could be mistaken about that, and that perhaps what I saw was owing to their not drawing the distinction between the holy and the profane (...) the way we do. Nevertheless, I shall proceed in the direction of my original thought in order to move my discussion along the lines I wish it to take. What I saw when I first saw that church was that it was not set off from the everyday life and work of the people who lived and worked in its vicinity. Shopping stalls were virtually up against its walls, and while it was a place of great importance—both with respect to its holiness and its history—it was in no way separated from the mundane existence which was all around it. Surely, I thought, if the accounts recorded in the Gospels took place not in the Middle East but in what is now the western world—Paris, London or New York—the almost complete interaction of historical site and everyday life would not be what would be witnessed by someone coming upon the Church in its western location. One supposes that it would be separated from the world of everyday—no doubt by a fence of some sort—and rather than be open to anyone who wishes to enter, it is hard to doubt that there would be a booth at the entrance and a charge for admission. That the Church of the Holy Sepulchre, built on the reported site of Jesus’ burial, could be so much a part of the everyday world can only be, I thought to myself, because the people who live and work around it simply lack a sense of history. (shrink)

Issu d’une thèse de doctorat, ce passionnant ouvrage propose une comparaison approfondie de deux participantes aux débats savants du milieu du XVIIe siècle, Margaret Cavendish (1623-1673) et Anne Conway (1631-1679). L’enquête, comme l’auteur le souligne, respecte les conventions du théâtre classique : unité de temps (les années 1650-1680), de lieu (l’Angleterre), et surtout d’action, puisque les deux femmes, par leurs conversations et leurs écrits, ont contribué à la promotion d’une philosoph...

LLMs have dramatically improved in capabilities in recent years. This raises the question of whether LLMs could become genuine agents with beliefs and desires. This paper demonstrates an in principle limit to LLM agency, based on their architecture. LLMs are next word predictors: given a string of text, they calculate the probability that various words can come next. LLMs produce outputs that reflect these probabilities. I show that next word predictors are exploitable. If LLMs are prompted to make probabilistic predictions (...) about the world, these predictions are guaranteed to be incoherent, and so Dutch bookable. If LLMs are prompted to make choices over actions, their preferences are guaranteed to be intransitive, and so money pumpable. In short, the problem is that selecting an action based on its potential value is structurally different then selecting the description of an action that is most likely given a prompt: probability cannot be forced into the shape of expected value. The in principle exploitability of LLMs raises doubts about how agential they can become. This exploitability also offers an opportunity for humanity to safely control such AI systems. (shrink)

We discuss the content and significance of John von Neumann’s quantum ergodic theorem (QET) of 1929, a strong result arising from the mere mathematical structure of quantum mechanics. The QET is a precise formulation of what we call normal typicality, i.e., the statement that, for typical large systems, every initial wave function ψ0 from an energy shell is “normal”: it evolves in such a way that |ψt ψt| is, for most t, macroscopically equivalent to the micro-canonical density matrix. The QET (...) has been mostly forgotten after it was criticized as a dynamically vacuous statement in several papers in the 1950s. However, we point out that this criticism does not apply to the actual QET, a correct statement of which does not appear in these papers, but to a different (indeed weaker) statement. Furthermore, we formulate a stronger statement of normal typicality, based on the observation that the bound on the deviations from the average specified by von Neumann is unnecessarily coarse and a much tighter (and more relevant) bound actually follows from his proof. (shrink)

From the acclaimed writer and thinker--whose award-winning books include both fiction and non-fiction--a dazzlingly original plunge into the drama of philosophy, revealing its hidden but essential role in today's debates on love, religion, politics, and science. Imagine that Plato came to life in the 21st century and set out on a multi-city speaking tour: How would he handle a host on Fox News who challenges him on religion and morality? How would he mediate a debate on the best way to (...) raise a child between a Freudian psychoanalyst and a Tiger Mom? How would he answer a neuroscientist who, about to scan Plato's brain, argues that all his philosophical problems can be solved by our new technologies? What would he make of Google, and the idea that knowledge can be crowdsourced rather than reasoned out by experts? With a philosopher's depth and a novelist's imagination, Rebecca Newberger Goldstein probes the deepest issues confronting us--from sexuality and child-rearing to morality and the meaning of life--by allowing us to eavesdrop on Plato as he encounters the modern world. By reviving the Platonic art of the dialogue for the 21st century, she demonstrates that the questions he first posed continue to confound and enlarge us. (shrink)

We consider an isolated, macroscopic quantum system. Let H be a microcanonical “energy shell,” i.e., a subspace of the system’s Hilbert space spanned by the (finitely) many energy eigenstates with energies between E and E + δE. The thermal equilibrium macro-state at energy E corresponds to a subspace Heq of H such that dim Heq/ dim H is close to 1. We say that a system with state vector ψ H is in thermal equilibrium if ψ is “close” to Heq. (...) We show that for “typical” Hamiltonians with given eigenvalues, all initial state vectors ψ0 evolve in such a way that ψt is in thermal equilibrium for most times t. This result is closely related to von Neumann’s quantum ergodic theorem of 1929. (shrink)

This paper offers the first careful analysis of the possibility that AI and humanity will go to war. The paper focuses on the case of artificial general intelligence, AI with broadly human capabilities. The paper uses a bargaining model of war to apply standard causes of war to the special case of AI/human conflict. The paper argues that information failures and commitment problems are especially likely in AI/human conflict. Information failures would be driven by the difficulty of measuring AI capabilities, (...) by the uninterpretability of AI systems, and by differences in how AIs and humans analyze information. Commitment problems would make it difficult for AIs and humans to strike credible bargains. Commitment problems could arise from power shifts, rapid and discontinuous increases in AI capabilities. Commitment problems could also arise from missing focal points, where AIs and humans fail to effectively coordinate on policies to limit war. In the face of this heightened chance of war, the paper proposes several interventions. War can be made less likely by improving the measurement of AI capabilities, capping improvements in AI capabilities, designing AI systems to be similar to humans, and by allowing AI systems to participate in democratic political institutions. (shrink)