We introduce a computational theory of situated language understanding in which the meaning of words and utterances depends on the physical environment and the goals and plans of communication partners. According to the theory, concepts that ground linguistic meaning are neither internal nor external to language users, but instead span the objective‐subjective boundary. To model the possible interactions between subject and object, the theory relies on the notion of perceived affordances: structured units of interaction that can be (...) used for prediction at multiple levels of abstraction. Language understanding is treated as a process of filtering perceived affordances. The theory accounts for many aspects of the situated nature of human language use and provides a unified solution to a number of demands on any theory of language understanding including conceptual combination, prototypicality effects, and the generative nature of lexical items.To support the theory, we describe an implemented system that understands verbal commands situated in a virtual gaming environment. The implementation uses probabilistic hierarchical plan recognition to generate perceived affordances. The system has been evaluated on its ability to correctly interpret free‐form spontaneous verbal commands recorded from unrehearsed game play between human players. The system is able to “step into the shoes” of human players and correctly respond to a broad range of verbal commands in which linguistic meaning depends on social and physical context. We quantitatively compare the system's predictions in response to direct player commands with the actions taken by human players and show generalization to unseen data across a range of situations and verbal constructions. (shrink)

This article contains the results of a theoretical analysis of the phenomenon of natural language understanding (NLU), as a methodological problem. The combination of structural-ontological and informational-psychological approaches provided an opportunity to describe the subject matter field of NLU, as a composite function of the mind, which systemically combines the verbal and discursive structural layers. In particular, the idea of NLU is presented, on the one hand, as the relation between the discourse of a specific speech message and (...) the meta-discourse of a language, in turn, activated by the need-motivational factors. On the other hand, it is conceptualized as a process with a specific structure of information metabolism, the study of which implies the necessity to differentiate the affective (emotional) and need-motivational influences on the NLU, as well as to take into account their interaction. At the same time, the hypothesis about the influence of needs on NLU under the scenario similar to the pattern of Yerkes-Dodson is argued. And the theoretical conclusion that emotions fulfill the function of the operator of the structural features of the information metabolism of NLU is substantiated. Thus, depending on the modality of emotions in the process of NLU, it was proposed to distinguish two scenarios for the implementation of information metabolism - reduction and synthetic. The argument in favor of the conclusion about the productive and constitutive role of emotions in the process of NLU is also given. (shrink)

From a leading authority in artificial intelligence, this book delivers a synthesis of the major modern techniques and the most current research in natural language processing. The approach is unique in its coverage of semantic interpretation and discourse alongside the foundational material in syntactic processing.

Is language understanding a special case of social cognition? To help evaluate this view, we can formalize it as the rational speech-act theory: Listeners assume that speakers choose their utterances approximately optimally, and listeners interpret an utterance by using Bayesian inference to “invert” this model of the speaker. We apply this framework to model scalar implicature (“some” implies “not all,” and “N” implies “not more than N”). This model predicts an interaction between the speaker's knowledge state and the (...) listener's interpretation. We test these predictions in two experiments and find good fit between model predictions and human judgments. (shrink)

The article argues that cognitive linguistic theory may prove an alternative to the Montague paradigm for designing natural language understanding systems. Within this framework it describes a system which models language understanding as a dialogical process between user and computer. The system operates with natural language texts as input and represent language meaning as entity-relationship diagrams.

In recent years the view that understanding a language requires knowing what its words and expressions mean has come under attack. One line of attack attempts to show that while knowledge can be undermined by Gettier-style counterexamples, language understanding cannot be. I consider this line of attack, particularly in the work of Pettit and Longworth, and show it to be unpersuasive. I stress, however, that maintaining a link between language understanding and knowledge does not (...) itself vindicate a cognitivist view of the former. (shrink)

While cognitive linguists have been successful at providing accounts of the stable knowledge structures (conceptual metaphors) that give rise to figurative language, and the conceptual mechanisms that manipulate these knowledge structures (conceptual blending), relatively less effort has been thus far devoted to the nature of the linguistic mechanisms involved in figurative language understanding. This paper presents a theoretical account of figurative language understanding, examining metaphor and metonymy in particular. This account is situated within the Theory (...) of Lexical Concepts and Cognitive Models (LCCM Theory). LCCM Theory (Evans, Cognitive Linguistics 17: 491–534, 2006, How words mean: Lexical concepts, cognitive models and meaning construction, Oxford University Press, 2009b) is a cognitively realistic model of lexical representation and semantic compositionality, providing, it is argued, an account of figurative language which complements the ‘backstage’ cognition perspective of Conceptual Blending Theory. It also integrates the notion of conceptual metaphor within the account provided of figurative language understanding. The paper introduces the key mechanisms involved in figurative language understanding arising from language use. The paper also provides a programmatic account of how conceptual metaphors are integrated with linguistic knowledge in figurative language use. It is argued the present proposals flesh out a key aspect of the conceptual integration perspective promoted by Fauconnier and Turner, with which LCCM Theory is continuous. In part, the paper attempts to advance the prospect of a ‘joined up’ cognitive linguistic account of figurative language understanding. (shrink)

The essay deals with the mechanism of interpretation for legal metaphorical expressions. Firstly, it points out the perspective the cognitive approach induced about legal metaphors; then it suggests that this perspective gains in plausibility when a new bilateral model of language understanding is endorsed. A possible sketch of the meaning-making procedure for legal metaphors, compatible with this new model, is then proposed, and illustrated with some examples built on concepts belonging to the Italian Civil Code. The insights the (...) bilateral model of understanding provides are compared with the practice followed by legal communities for dealing with the metaphorical expressions they coin and use. (shrink)

This paper describes the layers of context leveraged by language-endowed intelligent agents (LEIAs) during incremental natural language understanding (NLU). Context is defined as a combination of (...

Several disciplines within the cognitive sciences have advanced the idea that people comprehend the actions of others, including the linguistic meanings they communicate, through embodied simulations where they imaginatively recreate the actions they observe or hear about. This claim has important consequences for theories of mind and meaning, such as that people’s use and interpretation of language emerges as a kind of bodily activity that is an essential part of ordinary cognition. Daniel Weiskopf presents several arguments against the idea (...) that experiential simulations play a major role in immediate language use and meaning. We offer several rebuttals to Weiskopf, in which we critique his interpretation of simulation theory, present additional psycholinguistic evidence supportive of the simulation perspective, and suggest that a more traditional theory of linguistic meaning and processing has little psychological and empirical validity.Keywords: Language; Comprehension; Embodied cognition; Embodied simulation; Linguistic meaning, Psycholinguistics. (shrink)

An Example for Natural Language Understanding and the AI Problems it Raises I think this 1976 memorandum is of 1996 interest. The problems it raises haven't been solved or even substantially reformulated.

Meaning depends on context. This applies in obvious cases like deictics or sarcasm as well as more subtle situations like framing or persuasion. One key aspect of this is the identity of the participants in an interaction. Our interpretation of an utterance shifts based on a variety of factors, including personal history, background knowledge, and our relationship to the source. While obviously an incomplete model of individual differences, demographic factors provide a useful starting point and allow us to capture some (...) of this variance. However, the relevance of specific demographic factors varies between situations—where age might be the key factor in one context, ideology might dominate in another. To address this challenge, we introduce a method for combining demographics and context into situated demographic embeddings—mapping representations into a continuous geometric space appropriate for the given domain, showing the resulting representations to be functional and interpretable. We further demonstrate how to make use of related external data so as to apply this approach in low‐resource situations. Finally, we show how these representations can be incorporated into improve modeling of real‐world natural language understanding tasks, improving model performance and helping with issues of data sparsity. (shrink)

Many scholars often use the terms “metaphors,” “analogies,” and “models” interchangeably and inadvertently overlook the uniqueness of each word. According to recent cognitive studies, the three terms involve distinct cognitive processes using features from a familiar concept and applying them to an abstract, complicated concept. In the field of science and religion, there have been various objects or ideas used as metaphors, analogies, or models to describe the science–religion relationship. Although these heuristic tools provided some understanding of the complex (...) interaction, they failed to address the broad nature of science and religion as well as the multifarious relationship between the two in a sociocultural context. Unlike the previous candidates, the concept of language, including the notions of linguistic worldview, linguistic identity, dialects, power, and bilingualism, offers a unique and comprehensive window through which science, religion, and the relationship between the two are seen with clarity. (shrink)

This essay considers what it means to understand natural language and whether a computer running an artificial-intelligence program designed to understand natural language does in fact do so. It is argued that a certain kind of semantics is needed to understand natural language, that this kind of semantics is mere symbol manipulation (i.e., syntax), and that, hence, it is available to AI systems. Recent arguments by Searle and Dretske to the effect that computers cannot understand natural (...) class='Hi'>language are discussed, and a prototype natural-language-understanding system is presented as an illustration. (shrink)

Why is mutual understanding between two substantially different comprehensive language communities often problematic and even unattainable? To answer this question, the author first introduces a notion of presuppositional languages. Based on the semantic structure of a presuppositional language, the author identifies a significant condition necessary for effective understanding of a language: the interpreter is able to effectively understand a language only if he/she is able to recognize and comprehend its metaphysical presuppositions. The essential role (...) of the knowledge of metaphysical presuppositions in understanding is further strengthened by developing a truth-value conditional theory of understanding. It is concluded that if the interpreter approaches an incompatible alien language from the standpoint of the interpreter's own language by projecting the metaphysical presuppositions of his/her own language upon the alien language, then the mutual understanding between the two language communities is doomed to failure. (shrink)

This paper engages with Johaness Bronkhorst’s recognition of a “correspondence principle” as an underlying assumption of Nāgārjuna’s thought. Bronkhorst believes that this assumption was shared by most Indian thinkers of Nāgārjuna’s day, and that it stimulated a broad and fascinating attempt to cope with Nāgārjuna’s arguments so that the principle of correspondence may be maintained in light of his forceful critique of reality. For Bronkhorst, the principle refers to the relation between the words of a sentence and the realities they (...) are meant to convey. While I accept this basic intuition of correspondence, this paper argues that a finer understanding of the principle can be offered. In light of a set of verses from Nāgārjuna’s Śūnyatāsaptati (45–57), it is maintained that for Nāgārjuna, the deeper level of correspondence involves a structural identity he envisions between understanding and reality. Here Nāgārjuna claims that in order for things to exist, a conceptual definition of their nature must be available; in order for there to be a real world and reliable knowledge, a svabhāva of things must be perceived and accounted for. Svabhāva is thus reflected as a knowable essence. Thus, Nāgārjuna’s arguments attacks the accountability of both concepts and things, a position which leaves us with nothing more than mistaken forms of understanding as the reality of the empty. This markedly metaphysical approach is next analyzed in light of the debate Nāgārjuna conducts with a Nyāya interlocutor in his Vigrahavyāvartanī. The correspondence principle is here used to highlight the metaphysical aspect of the debate and to point out the ontological vision of Nāgārjuna’s theory of emptiness. In the analysis of the Vigrahavyāvartanī it becomes clear that the discussion revolves around a foundational metaphysical deliberation regarding the reality or unreality of svabhāva. In this dispute, Nāgārjuna fails to answer the most crucial point raised by his opponent—what is that he defines as empty? (shrink)

Stephen Laurence and Eric Margolis have recently argued that certain kinds of regress arguments against the language of thought (LOT) hypothesis as an account of how we understand natural languages have been answered incorrectly or inadequately by supporters of LOT ('Regress arguments against the language of thought', Analysis, 57 (1), 60-6, J 97). They argue further that this does not undermine the LOT hypothesis, since the main sources of support for LOT are (or might be) independent of it (...) providing an account of how we understand natural language. In my paper I seek to refute both these claims, and reinstate the putative explanation of natural language understanding as a necessarily central part of the support for LOT. The main argument exploits the fact that Laurence and Margolis give too little weight to the ideas (a) that LOT might be innate (b) that for LOT supporters a semantic theory must apply to in-the-head tokens, not linguistic utterances. (shrink)

Our long-standing hypothesis has been that feedforward information flow is sufficient for speech perception, reading, and sentence (syntactic and semantic) processing more generally. We are encouraged by the target article's argument for the same hypothesis, but caution that more precise quantitative predictions will be necessary to advance the field.

The papers in this volume represent the views of a range of experts in a variety of language-related disciplines on the role which context plays in language learning and language understanding. The authors provide various theoretical constructs which help impose order on the apparent chaos of contextual factors which may have an influence on the production and comprehension of speech events. They focus on a variety of types of context, including the context established by different speech (...) communities, interpersonal contexts, the classroom context, and the context provided by the linguistic code itself. The papers illustrate how the treatment of context varies across the disciplines of linguistics, historical stylistics, applied linguistics, and psycholinguistics. Each paper is prefaced by an editorial introduction to help the reader trace out common themes and points of conflict. (shrink)

A classic problem in cognitive science concerns how listeners perceive and understand speech as comprised of discrete words. We propose a Syllable Inference account of spoken word recognition and segmentation, under which alternative hierarchical models of syllables, words, and phonemes are dynamically posited from cues that include current and past speech rate, with a goal of maximal prediction of sensory input. Three experiments using the Visual World eye‐tracking paradigm provide evidence supporting our proposal.

A proposal is made concerning the introduction of the notions of cause and reason into a natural language understanding system. Its hypothesis is that one should prefer rational explanations of actions when dealing with human, or human‐like, agents, if one can find them in what one is analyzing, but that in other, nonhuman, cases one should prefer causal explanations. The reader is reminded of the existing state of the preference semantics system, and then are described the changes that (...) would have to be made to incorporate the above proposal and to find examples to test it. Finally, it is argued that there is no reason to think that a more complex taxonomy of causes (beyond the opposition of causes and reasons) is required, at least not if, as here. one seeks a procedural distinction corresponding to any taxonomic distinction among inference rules. (shrink)

Summary Pluralism and monism are the two current views concerning scientific research and language understanding. Between them there is a third, intermediate, view. We take a procedural methodology of science as exemplified in the work of L. Tondl, and procedural linguistics , as exemplified in the work of B. Harrison, to be representative of this third possibility. Procedures are cognitive, linguistic, and physical processes which, through their hierarchical interconnections can generate fruitful mechanisms . These mechanisms are sensitive to (...) context and operate in heuristic and algorithmic ways. Their similar logical structure points towards a profound unified basis for scientific and linguistic activities, thus providing an interesting bridge between what is achieved by a little child talking to his parents, and a creative scientist struggling to interpret the results of his experiments. (shrink)

When we say that we understand the language of God with the language of the universe, we mean that we can understand the language of God with the language of the universe and in other ways as well. Therefore, what we really want to say is that when we look at the event from our own point of view, that is, from our own factuality, we must necessarily understand the universe in order to understand the (...) class='Hi'>language of God, and for us to understand it can only be possible by understanding the language of the universe. We will present this with some examples. At the same time, we will talk about some styles of understanding in the history of philosophy. Since understanding the language of God is also understanding the language of religion, we will try to briefly show how the language of God or the language of the universe is understood through the language of religion, how this is wrong in Judaism, Christianity, especially in the idea of medieval Christian priests and a number of styles of understanding in the Islamic world. (shrink)

"To my knowledge, there has never [before] been a volume that analyzes, in one place, the actual language of science--those elements of thinking that are acknowledged to be the basis of scientific thought. . . . [Thus] this is a very important book, contributing to several fields: science, education, rhetoric, medicine, and perhaps even philosophy. . . . Darian's erudition is truly astonishing." --Celest A. Martin, Associate Professor, College Writing Program, University of Rhode Island From astronomy to zoology, the (...) practice of science proceeds from scientific ways of thinking. These patterns of thought, such as defining and classifying, hypothesizing and experimenting, form the building blocks of all scientific endeavor. Understanding how they work is therefore an essential foundation for everyone involved in scientific study or teaching, from elementary school students to classroom teachers and professional scientists. In this book, Steven Darian examines the language of science in order to analyze the patterns of thinking that underlie scientific endeavor. He draws examples from university science textbooks in a variety of disciplines, since these offer a common, even canonical, language for scientific expression. Darian identifies and focuses in depth on nine patterns--defining, classifying, using figurative language, determining cause and effect, hypothesizing, experimenting, visualizing, quantifying, and comparing--and shows how they interact in practice. He also traces how these thought modes developed historically from Pythagoras through Newton. (shrink)

The notion of modularity, introduced by Noam Chomsky and developed with special emphasis on perceptual and linguistic processes by Jerry Fodor in his important book The Modularity of Mind, has provided a significant stimulus to research in cognitive science. This book presents essays in which a diverse group of philosophers, linguists, psycholinguists, and neuroscientists - including both proponents and critics of the modularity hypothesis - address general questions and specific problems related to modularity. Jay L. Garfield is Associate Professor of (...) Philosophy in the School of Communications and Cognitive Science at Hampshire College. (shrink)

I advocate a theory of syntactic semantics as a way of understanding how computers can think (and how the Chinese-Room-Argument objection to the Turing Test can be overcome): (1) Semantics, considered as the study of relations between symbols and meanings, can be turned into syntax – a study of relations among symbols (including meanings) – and hence syntax (i.e., symbol manipulation) can suffice for the semantical enterprise (contra Searle). (2) Semantics, considered as the process of understanding one domain (...) (by modeling it) in terms of another, can be viewed recursively: The base case of semantic understanding –understanding a domain in terms of itself – is syntactic understanding. (3) An internal (or narrow ), first-person point of view makes an external (or wide ), third-person point of view otiose for purposes of understanding cognition. (shrink)

The present study tests a section of the DIET (direct and indirect effects model of text comprehension; Kim, 2017) model and focuses on the relations between early language skills, various facets of mental state understanding, and text comprehension. In a sample of 267 children, I analyzed the relations between language skills (vocabulary, sentence comprehension) at age 3;6, theory of mind (ToM) at age 5;6, mental state language and metacognitive knowledge at age 9;2, and children’s listening and (...) reading comprehension of texts at age 13;7 years. For reading comprehension, results favored a total mediation model that included only direct links from metacognitive knowledge and mental state language to reading comprehension. For listening comprehension, by contrast, a model that also included direct relations from language and ToM in preschool was favored. Metacognitive skills did not mediate the relation between early skills and later text comprehension but, along with mental state language, showed direct relations with reading comprehension beyond listening comprehension. Early language skills showed various indirect relations with later reading comprehension via ToM, mental state language, and listening comprehension, whereas ToM showed only small indirect relations with later reading comprehension via later listening comprehension. These different relations of the various components with later listening in contrast to reading comprehension are discussed. (shrink)

This paper is concerned with those elements of planning knowledge that are common to both understanding someone else's plan and creating a plan for one's own use. This planning knowledge can be divided into two bodies: Knowledge about the world, and knowledge about the planning process itself. Our interest here is primarily with the latter corpus. The central thesis is that much of the knowledge about the planning process itself can be formulated in terms of higher‐level goals and plans (...) called meta‐goals and meta‐plans. These entities can then be used by the same understanding and planning mechanisms that process ordinary goals and plans. However, the meta‐planning knowledge now enables these mechanisms to handle much more complicated situations in a uniform manner.Systems based on meta‐planning would have a number of advantages over existing problem solving and understanding systems. The same knowledge could be shared by both a planner and understander, and both would be able to handle complex situations elegantly. In addition, in planning, the use of meta‐planning has several advantages over more traditional methods involving constraints or critics. Meta‐planning allows the full power of a problem solver to be applied to situations that are generally amenable only to special purpose processing. In addition, meta‐planning facilitates the representation of some situations that are difficult to express otherwise. We have begun to introduce meta‐planning knowledge into two systems: PAM, a story understanding program, and PANDORA, a problem solving and plannin̈g system. (shrink)

The article is devoted to the applicability of Wittgenstein’s following the rule in the context of his philosophy of mathematics to real mathematical practice. It is noted that in «Philosophical Investigations» and «Remarks on the Foundations of Mathematics» Wittgenstein resorted to the analysis of rather elementary mathematical concepts, accompanied also by the inherent ambiguity and ambiguity of his presentation. In particular, against this background, his radical conventionalism, the substitution of logical necessity with the «form of life» of the community, as (...) well as the inadequacy of the representation of arithmetic rules by a language game are criticized. It is shown that the reconstruction of the Wittgenstein concept of understanding based on the Fregian division of meaning and referent goes beyond the conceptual framework of Wittgenstein language games. (shrink)

��We describe a comprehensive framework for text un- derstanding, based on the representation of context. It is designed to serve as a representation of semantics for the full range of in- terpretive and inferential needs of general natural language pro- cessing. Its most distinctive feature is its uniform representation of the various simple and independent linguistic sources that play a role in determining meaning: lexical associations, syntactic re- strictions, case-role expectations, and most importantly, contextual effects. Compositional syntactic structure from (...) a shallow parsing is represented in a neural net-based associative memory, where it then interacts through a Bayesian network with semantic associa- tions and the context or “gist” of the passage carried forward from preceding sentences. Experiments with more than 2000 sentences in different languages are included. (shrink)

When the language-dominant hemisphere is damaged by a focal lesion, the brain may reorganize the language network through functional and structural changes known as adaptive plasticity. Adaptive plasticity is documented for triggers including ischemic, tumoral, and epileptic focal lesions, with effects in clinical practice. Many questions remain regarding language plasticity. Different lesions may induce different patterns of reorganization depending on pathologic features, location in the brain, and timing of onset. Neuroimaging provides insights into language plasticity due (...) to its non-invasiveness, ability to image the whole brain, and large-scale implementation. This review provides an overview of language plasticity on MRI with insights for patient care. First, we describe the structural and functional language network as depicted by neuroimaging. Second, we explore language reorganization triggered by stroke, brain tumors, and epileptic lesions and analyze applications in clinical diagnosis and treatment planning. By comparing different focal lesions, we investigate determinants of language plasticity including lesion location and timing of onset, longitudinal evolution of reorganization, and the relationship between structural and functional changes. (shrink)

The author poses a question: when a person has a thought, what is it that determines what thought he is having? and, equivalently, what is it that determines what thought he is having. looking for an answer he sketches some general aspects of the problems involved in answering these questions, like the mind/body problem, for example. his conclusion is that the posed questions should be set against the background assumption that thoughts are just internal physical occurrences, and that thoughts are (...) categorized in the same way other mental occurrences are categorized. so the author categorizes them in terms of their introspectible characteristics and in terms of "that" clauses. these classifications can be understood as describing thought in terms of their place in the rational architecture. (shrink)

Philosophical Investigations, Volume 45, Issue 4, Page 490-511, October 2022.