A novel account of semantic information is proposed. The gist is that structural correspondence, analysed in terms of similarity, underlies an important kind of semantic information. In contrast to extant accounts of semantic information, it does not rely on correlation, covariation, causation, natural laws, or logical inference. Instead, it relies on structural similarity, defined in terms of correspondence between classifications of tokens into types. This account elucidates many existing uses of the notion of (...) class='Hi'>information, for example, in the context of scientific models and structural representations in cognitive science. It is poised to open a new research program concerned with various kinds of semantic information, its functions, and its measurement. (shrink)

Propositional attitude verbs, such as think and want, have long held interest for both theoretical linguists and language acquisitionists because their syntactic, semantic, and pragmatic properties display complex interactions that have proven difficult to fully capture from either perspective. This paper explores the granularity with which these verbs’ semantic and pragmatic properties are recoverable from their syntactic distributions, using three behavioral experiments aimed at explicitly quantifying the relationship between these two sets of properties. Experiment 1 gathers a (...) class='Hi'>measure of 30 propositional attitude verbs’ syntactic distributions using an acceptability judgment task. Experiments 2a and 2b gather measures of semantic similarity between those same verbs using a generalized semantic discrimination task and an ordinal scale task, respectively. Two kinds of analyses are conducted on the data from these experiments. The first compares both the acceptability judgments and the semantic similarity judgments to previous classifications derived from the syntax and semantics literature. The second kind compares the acceptability judgments to the semantic similarity judgments directly. Through these comparisons, we show that there is quite fine-grained information about propositional attitude verbs’ semantics carried in their syntactic distributions—whether one considers the sorts of discrete qualitative classifications that linguists traditionally work with or the sorts of continuous quantitative classifications that can be derived experimentally. (shrink)

In his recent book, Daniel Dennett defends a novel account of semantic information in terms of design worth getting (Dennett, 2017). While this is an interesting proposal in itself, my purpose in this commentary is to challenge several of Dennett’s claims. First, he argues that semantic information can be transferred without encoding and storing it. Second, this lack of encoding is what makes semantic information unmeasurable. However, the argument for both these claims, presented by (...) Dennett as an intuition pump, is invalid. (shrink)

The purpose of this paper is to look at some existing methods of semantic information quantification and suggest some alternatives. It begins with an outline of Bar-Hillel and Carnap’s theory of semantic information before going on to look at Floridi’s theory of strongly semantic information. The latter then serves to initiate an in-depth investigation into the idea of utilising the notion of truthlikeness to quantify semantic information. Firstly, a couple of approaches to (...) measure truthlikeness are drawn from the literature and explored, with a focus on their applicability to semantic information quantification. Secondly, a similar but new approach to measure truthlikeness/information is presented and some supplementary points are made. (shrink)

In this paper we explore the possibility of giving a justification of the “semantic information” content and measure, in the framework of the recent coalgebraic approach to quantum systems and quantum computation, extended to QFT systems. In QFT, indeed, any quantum system has to be considered as an “open” system, because it is always interacting with the background fluctuations of the quantum vacuum. Namely, the Hamiltonian in QFT always includes the quantum system and its inseparable thermal bath, (...) formally “entangled” like an algebra with its coalgebra, according to the principle of the “doubling” of the degrees of freedom between them. This is the core of the representation theory of cognitive neuroscience based on QFT. Moreover, in QFT, the probabilities of the quantum states follow a Wigner distribution, based on the notion and measure of quasiprobability, where regions integrated under given expectation values do not represent mutually exclusive states. This means that a computing agent, either natural or artificial, in QFT, against the quantum Turing machine paradigm, is able to change dynamically the representation space of its computations. This depends on the possibility of interpreting QFT system computations within the framework of category theory logic and its principle of duality between opposed categories, such as the algebra and coalgebra categories of QFT. This allows us to justify and not only to suppose, like in the “theory of strong semantic information” of L. Floridi, the definition of modal “local truth” and the notion of semantic information as a measure of it, despite both measures being defined on quasiprobability distributions. (shrink)

In 1972,Ernst Ulrich and Christine von Weizs ¨acker introduced the concept of pragmatic information with three desiderata:(i) Pragmatic information should assess the impact of a message upon its receiver;(ii)Pragmatic information should vanish in the limits of complete (non-interpretable)'novelty 'and complete 'confirmation';(iii)Pragmatic information should exhibit non-classical properties since novelty and confirmation behave similarly to Fourier pairs of complementary operators in quantum mechanics. It will be shown how these three desiderata can be naturally fulfilled within the framework of (...) Gardenfors' dynamic semantics of Bayesian belief models.(i)The meaning of a message is its impact upon the epistemic states of a cognitive agent. A pragmatic information measure can then be quanti .ed by the average information gain for the transition from a prior to a posterior state.(ii)Total novelty can be represented by the identical proposition, total con- .rmation by the logical consequence of propositions. In both cases, pragmatic information vanishes.(iii)For operators that are neither idempotent nor commuting, novelty and confirmation relative to a message sequence can be defined within Gardenfors' theory of belief revisions.The proposed approach is consistent with measures of relevance derived from statistical decision theory and it contains Bar-Hillel 's and Carnap's theory of semantic information as a special case. (shrink)

What is needed to enable communication about observation and measurement results in information systems? Information system ontologies make a certain conceptualization explicit and partially accoun...

Jerry Fodor and Ernest Lepore have launched a powerful attack against Paul Churchland's connectionist theory of semantics—aka State Space Semantics. In one part of their overall attack, they exploit the potentially orthogonal histories of different individuals to introduce what they labeled ‘the collateral information problem’. Aarre Laakso and Gary Cottrell have recently put forward a mathematical technique for measuring conceptual similarity across neural networks. Churchland uses Laakso and Cottrell's tecnique to defend State Space Semantics. In this paper I shall (...) highlight a potential problem for Laakso and Cottrell's technique, and for Churchland's subsequent defence of connectionist semantics that has been ignored in the connectionist literature. I shall argue that a connectionist sympathiser of Churchland could not make use of Laakso and Cottrell's neurosimulations to address Fodor and Lepore's collateral information challenge. (shrink)

The next generation of Geographic Information Systems (GIS) is anticipated to automate some of the reasoning required for spatial analysis. An important step in the development of such systems is to gain a better understanding and corresponding modeling practice of when to apply arithmetic operations to quantities. The concept of extensivity plays an essential role in determining when quantities can be aggregated by summing them, and when this is not possible. This is of particular importance to geographic information (...) systems, which serve to quantify phenomena across space and time. However, currently, multiple contrasting definitions of extensivity exist, and none of these suffice for handling the different practical cases occurring in geographic information. As a result, analysts predominantly rely on intuition and ad hoc reasoning to determine whether two quantities are additive. In this paper, we present a novel approach to formalizing the concept of extensivity. Though our notion as such is not restricted to quantifications occurring within geographic information, it is particularly useful for this purpose. Following the idea of spatio-temporal controls by Sinton, we define extensivity as a property of measurements of quantities with respect to a controlling quantity, such that a sum of the latter implies a sum of the former. In our algebraic definition of amounts and other quantities, we do away with some of the constraints that limit the usability of older approaches. By treating extensivity as a relation between amounts and other types of quantities, our definition offers the flexibility to relate a quantity to many domains of interest. We show how this new notion of extensivity can be used to classify the kinds of amounts in various examples of geographic information. (shrink)

Human creativity generates novel ideas to solve real-world problems. This thereby grants us the power to transform the surrounding world and extend our human attributes beyond what is currently possible. Creative ideas are not just new and unexpected, but are also successful in providing solutions that are useful, efficient and valuable. Thus, creativity optimizes the use of available resources and increases wealth. The origin of human creativity, however, is poorly understood, and semantic measures that could predict the success of (...) generated ideas are currently unknown. Here, we analyze a dataset of design problem-solving conversations in real-world settings by using 49 semantic measures based on WordNet 3.1 and demonstrate that a divergence of semantic similarity, an increased information content, and a decreased polysemy predict the success of generated ideas. The first feedback from clients also enhances information content and leads to a divergence of successful ideas in creative problem solving. These results advance cognitive science by identifying real-world processes in human problem solving that are relevant to the success of produced solutions and provide tools for real-time monitoring of problem solving, student training and skill acquisition. A selected subset of information content (IC Sánchez–Batet) and semantic similarity (Lin/Sánchez–Batet) measures, which are both statistically powerful and computationally fast, could support the development of technologies for computer-assisted enhancements of human creativity or for the implementation of creativity in machines endowed with general artificial intelligence. (shrink)

When communicating, people adapt their linguistic representations to those of their interlocutors. Previous studies have shown that this also occurs at the semantic level for vague and context-dependent terms such as quantifiers and uncertainty expressions. However, work to date has mostly focused on passive exposure to a given speaker's interpretation, without considering the possible role of active linguistic interaction. In this study, we focus on gradable adjectives big and small and develop a novel experimental paradigm that allows participants to (...) ask clarification questions to figure out their interlocutor's interpretation. We find that, when in doubt, speakers do resort to this strategy, despite its inherent cognitive cost, and that doing so results in higher semantic alignment measured in terms of communicative success. While not all question–answer pairs are equally informative, we show that speakers become better questioners as the interaction progresses. Yet, the higher semantic alignment observed when speakers are able to ask questions does not increase over time. This suggests that conversational interaction's key advantage may be to boost coordination without committing to long-term semantic updates. Our findings shed new light on the mechanisms used by speakers to achieve semantic alignment and on how language is shaped by communication. (shrink)

In a recent survey of the literature on the relation between information and confirmation, Crupi and Tentori (Stud Hist Philos Sci 47:81–90, 2014) claim that the former is a fruitful source of insight into the latter, with two well-known measures of confirmation being definable purely information-theoretically. I argue that of the two explicata of semantic information (due originally to Bar Hillel and Carnap) which are considered by the authors, the one generating a popular Bayesian confirmation (...) class='Hi'>measure is a defective measure of information, while the other, although an admissible measure of information, generates a defective measure of confirmation. Some results are proved about the representation of measures on consequence-classes. (shrink)

This paper articulates an account of causation as a collection of information-theoretic relationships between patterns instantiated in the causal nexus. I draw on Dennett’s account of real patterns to characterize potential causal relata as patterns with specific identification criteria and noise tolerance levels, and actual causal relata as those patterns instantiated at some spatiotemporal location in the rich causal nexus as originally developed by Salmon. I develop a representation framework using phase space to precisely characterize causal relata, including their (...) degree of counterfactual robustness, causal profiles, causal connectivity, and privileged grain size. By doing so, I show how the philosophical notion of causation can be rendered in a format that is amenable for direct application of mathematical techniques from information theory such that the resulting informational measures are causal informational measures. This account provides a metaphysics of causation that supports interventionist semantics and causal modeling and discovery techniques. (shrink)

Although mouse‐tracking has been taken as a real‐time window on different aspects of human decision‐making processes, whether purely semantic information affects response conflict at the level of motor output as measured through mouse movements is still unknown. Here, across two experiments, we investigated the effects of semantic knowledge by predicting participants’ performance in a standard keyboard task and in a mouse‐tracking task through distributional semantics, a usage‐based modeling approach to meaning. In Experiment 1, participants were shown word (...) pairs and were required to perform a two‐alternative forced choice task selecting either the more abstract or the more concrete word, using standard keyboard presses. In Experiment 2, participants performed the same task, yet this time response selection was achieved by moving the computer mouse. Results showed that the involvement of semantic components in the task at hand is observable using both standard reaction times (Experiment 1) as well as using indexes extracted from mouse trajectories (Experiment 2). In particular, mouse trajectories reflected the response conflict and its temporal evolution, with a larger deviation for increasing word semantic relatedness. These findings support the validity of mouse‐tracking as a method to detect deep and implicit decision‐making features. Additionally, by demonstrating that a usage‐based model of meaning can account for the different degrees of cognitive conflict associated with task achievement, these findings testify the impact of the human semantic memory on decision‐making processes. (shrink)

In the last 25 years, the concept of information has played a crucial role in communication theory, so much so that the terms information theory and communication theory are sometimes used almost interchangeably. It seems to us, however, that the notion of information is also destined to render valuable services to the student of induction and probability, of learning and reinforcement, of semantic meaning and deductive inference, as~well as of scientific method in general. The present volume (...) is an attempt to illustrate some of these uses of information concepts. In 'On Semantic Information' Hintikka summarizes some of his and his associates' recent work on information and induction, and comments briefly on its philosophical suggestions. Jamison surveys from the sub jectivistic point of view some recent results in 'Bayesian Information Usage'. Rosenkrantz analyzes the information obtained by experimen tation from the Bayesian and Neyman-Pearson standpoints, and also from the standpoint of entropy and related concepts. The much-debated principle of total evidence prompts Hilpinen to examine the problem of measuring the information yield of observations in his paper 'On the Information Provided by Observations'. Pietarinen addresses himself to the more general task of evaluating the systematizing ('explanatory') power of hypotheses and theories, a task which quickly leads him to information concepts. Domotor develops a qualitative theory of information and entropy. His paper gives what is probably the first axiomatization of a general qualitative theory of information adequate to guarantee a numerical representation of the standard sort. (shrink)

Although the everyday notion of information has clear semantic properties, the all-pervasive technical concept of Shannon information is usually considered as a non-semantic concept. In this paper I show how this concept was implicitly ‘semantized’ in the early 1950s by many authors, such as Rothstein or Brillouin, in order to explain the knowledge dynamics underlying certain scientific practices such as measurement. On the other hand, I argue that the main attempts in the literature to develop a (...) quantitative measure of semantic information to clarify science and scientific measurements, such as Carnap-Bar-Hillel, or Dretske, will not successfully achieve this philosophical aim for several reasons. Finally, I defend the use of a qualitative notion of semantic information within the information-theoretical framework MacKay to assess the informational dynamics underlying scientific practices, particularly measurements in statistical mechanics. (shrink)

In the last 25 years, the concept of information has played a crucial role in communication theory, so much so that the terms information theory and communication theory are sometimes used almost interchangeably. It seems to us, however, that the notion of information is also destined to render valuable services to the student of induction and probability, of learning and reinforcement, of semantic meaning and deductive inference, as~well as of scientific method in general. The present volume (...) is an attempt to illustrate some of these uses of information concepts. In 'On Semantic Information' Hintikka summarizes some of his and his associates' recent work on information and induction, and comments briefly on its philosophical suggestions. Jamison surveys from the sub jectivistic point of view some recent results in 'Bayesian Information Usage'. Rosenkrantz analyzes the information obtained by experimen tation from the Bayesian and Neyman-Pearson standpoints, and also from the standpoint of entropy and related concepts. The much-debated principle of total evidence prompts Hilpinen to examine the problem of measuring the information yield of observations in his paper 'On the Information Provided by Observations'. Pietarinen addresses himself to the more general task of evaluating the systematizing power of hypotheses and theories, a task which quickly leads him to information concepts. Domotor develops a qualitative theory of information and entropy. His paper gives what is probably the first axiomatization of a general qualitative theory of information adequate to guarantee a numerical representation of the standard sort. (shrink)

Current theories propose that our sense of curiosity is determined by the learning progress or information gain that our cognitive system expects to make. However, few studies have explicitly tried to quantify subjective information gain and link it to measures of curiosity. Here, we asked people to report their curiosity about the intrinsically engaging perceptual ‘puzzles’ known as Mooney images, and to report on the strength of their aha experience upon revealing the solution image (curiosity relief). We also (...) asked our participants (279) to make a guess concerning the solution of the image, and used the distribution of these guesses to compute the crowdsourced semantic entropy (or ambiguity) of the images, as a measure of the potential for information gain. Our results confirm that curiosity and, even more so, aha experience is substantially associated with this semantic information gain measure. These findings support the expected information gain theory of curiosity and suggest that the aha experience or intrinsic reward is driven by the actual information gain. In an unannounced memory part, we also established that the often reported influence of curiosity on memory is fully mediated by the aha experience or curiosity relief. We discuss the implications of our results for the burgeoning fields of curiosity and psychoaesthetics. (shrink)

Empirical studies indicate that analogy consists of two main processes: retrieval and mapping. While current theories and models of analogy have revealed much about the mainly structural constraints that govern the mapping process, the similarities that underpin the correspondences between individual representational elements and drive retrieval are understood in less detail. In existing models symbol similarities are externally defined but neither empirically grounded nor theoretically justified. This paper introduces a new model (EMMA: the environmental model of analogy) which relies on (...) co‐occurrence information provided by LSA (Latent Semantic Analysis; Landauer & Dumais, 1997) to ground the relations between the symbolic elements aligned in analogy. LSA calculates a contextual distribution for each word encountered in a corpus by counting the frequency with which it co‐occurs with other words. This information is used to define a model that locates each word encountered in a high‐dimensional space, with relations between elements in this space representing contextual similarities between words. A series of simulation experiments demonstrate that the environmental approach to semantics embodied in LSA can produce appropriate patterns of analogical retrieval, but that this semantic measure is not sufficient to model analogical mapping. The implications of these findings, both for theories of representation in analogy research and more general theories of semantics in cognition, are explored. (shrink)

The deflationary aim of this book, which occupies Part I, is to show that a widely held view has little to be said for it. The constructive aim, pursued in Part II, is to make plausible a measure-theoretic account of propositional attitudes. The discussion is throughout instructive, illuminating and sensitive to the many intricacies surrounding attitude ascriptions and how they can carry information about a subject's psychology. There is close engagement with cognitive science. The book should be read (...) by anyone seriously engaged with issues about propositional attitudes.According to the widely held view, which Matthews calls the Received View, the attitude of Φing that p is a matter of standing in a computational/functional relation to an explicit Representation that expresses the proposition that p, and thinking is ‘an inferential computational process defined over one or more of these Representations that eventuates in the production of either another Representation or a behavior’. The representations are understood to be sentences in a language of thought and thus to have a compositional syntax and semantics. The theory that Matthews aims to make plausible has it that ascriptions of propositional attitudes in the form ‘X Φs that p’, ascribe a state to a person by relating that person to an abstract object that is the representative of the state in roughly the way that numbers on a scale are the measure-theoretic representations of certain physical magnitudes. We are to think of the role of ‘Jones believes that interest rates will fall’ by analogy with that of ‘Jones weighs 150lbs’. The latter depends on there being arithmetical relations defined over numbers that enable its particular assignment of a number to Jones's weight to represent physical properties that Jones has in virtue …. (shrink)

We propose a sheaf-theoretic framework for the representation of a quantum observable structure in terms of Boolean information sieves. The algebraic representation of a quantum observable structure in the relational local terms of sheaf theory effectuates a semantic transition from the axiomatic set-theoretic context of orthocomplemented partially ordered sets, la Birkhoff and Von Neumann, to the categorical topos-theoretic context of Boolean information sieves, la Grothendieck. The representation schema is based on the existence of a categorical adjunction, which (...) is used as a theoretical platform for the development of a functorial formulation of information transfer, between quantum observables and Boolean localisation devices in typical quantum measurement situations. We also establish precise criteria of integrability and invariance of quantum information transfer by cohomological means. (shrink)

An important question in early bilingual first language acquisition concerns the development of lexical-semantic associations within and across two languages. The present study investigates the earliest emergence of lexical-semantic priming at 18 and 24 months in Spanish-English bilinguals (N= 32) and its relation to vocabulary knowledge within and across languages. Results indicate a remarkably similar pattern of development between monolingual and bilingual children, such that lexical-semantic development begins at 18 months and strengthens by 24 months. Further, measures (...) of cross-language lexical knowledge are stronger predictors of children’s lexical-semantic processing skill than measures that capture single-language knowledge only. This suggests that children make use of both languages when processing semantic information. Together these findings inform the understanding of the relation between lexical-semantic breadth and organization in the context of dual language learners in early development. (shrink)

Current genetics studies often refer to notions from information science. The purpose of this paper is to summarize and structure the different notions of information used in biology, as a step towards developing a taxonomy of information. Within this framework we propose an extension of Floridi’s conceptual model of information. We also make use of the concept of specified information and show that functional information and many other notions of information are either special (...) cases of, or are closely related to, specified information. Since functionality of the proteins that genes code serves as an external and independent specification, this makes it possible to define genetic information in a way that includes semantic aspects. In particular, we discuss how to understand the qualitative aspects of genetic information, how to measure its quantitative aspects, and how variants of Shannon’s information measure can be applied to molecular sequence data of protein families. While a mathematical framework may not be able to incorporate all that is included within biological information, some aspects of it allow for statistical modelling. This is especially true if we restrict our focus on the discipline of genetics. The concept of genetic information is still disputed because it attributes semantic traits to what seems to be regular biochemical entities. Some researchers maintain that the use of information in biology is just metaphorical and may even be misleading. We argue that the foundation of the metaphorical view is relatively weak given the current findings in bioinformatics and show that the present understanding of genetics fits well into the context of the modern philosophy of information. The paper concludes that informational concepts have robust scientific applications at the level of genes. (shrink)

Frequency effects are pervasive in studies of language, with higher frequency words being recognized faster than lower frequency words. However, the exact nature of frequency effects has recently been questioned, with some studies finding that contextual information provides a better fit to lexical decision and naming data than word frequency ( Adelman et al., 2006 ). Recent work has cemented the importance of these results by demonstrating that a measure of the semantic diversity of the contexts that (...) a word occurs in provides a powerful measure to account for variability in word recognition latency ( Johns et al., 2012, 2015 ; Jones et al., 2012 ). The goal of the current study is to extend this measure to examine bilingualism and aging, where multiple theories use frequency of occurrence of linguistic constructs as central to accounting for empirical results ( Gollan et al., 2008 ; Ramscar et al., 2014 ). A lexical decision experiment was conducted with four groups of subjects: younger and older monolinguals and bilinguals. Consistent with past results, a semantic diversity variable accounted for the greatest amount of variance in the latency data. In addition, the pattern of fits of semantic diversity across multiple corpora suggests that bilinguals and older adults are more sensitive to semantic diversity information than younger monolinguals. (shrink)

This article provides the first comprehensive reconstruction and analysis of Hintikka’s attempt to obtain a measure of the information yield of deductive inferences. The reconstruction is detailed by necessity due to the originality of Hintikka’s contribution. The analysis will turn out to be destructive. It dismisses Hintikka’s distinction between surface information and depth information as being of any utility towards obtaining a measure of the information yield of deductive inferences. Hintikka is right to identify (...) the failure of canonical information theory to give an account of the information yield of deductions as a scandal, however this article demonstrates that his attempt to provide such an account fails. It fails primarily because it applies to only a restricted set of deductions in the polyadic predicate calculus, and fails to apply at all to the deductions in the monadic predicate calculus and the propositional calculus. Some corollaries of these facts are a number of undesirable and counterintuitive results concerning the proposed relation of linguistic meaning (and hence synonymy) with surface information. Some of these results will be seen to contradict Hintikka’s stated aims, whilst others are seen to be false. The consequence is that the problem of obtaining a measure of the information yield of deductive inferences remains an open one. The failure of Hintikka’s proposal will suggest that a purely syntactic approach to the problem be abandoned in favour of an intrinsically semantic one. (shrink)

Suppose you are stranded on an island and you want to get over to the nearby mainland. Your only option is to swim. But is the other shore close enough? If you embark and it isn’t, you drown. So you prefer to know before taking off. Happily, you are well equipped. You have not only a yardstick, but also a theodolite for measuring angles, and a good knowledge of trigonometry. You then determine the distance to the other shore by means (...) of triangulation. You fix two points, A and B, on your own shore, and identify a third point, C, in sight on the opposite shore. You then measure the distance between A and B with your yardstick, and the two angles ABC and CAB with your theodolite. With this information you can calculate the distances AC and BC to the other shore. (shrink)

Word order alternation has been described as one of the most productive information structure markers and discourse organizers across languages. Psycholinguistic evidence has shown that word order is a crucial cue for argument interpretation. Previous studies about Spanish sentence comprehension have shown greater difficulty to parse sentences that present a word order that does not respect the order of participants of the verb's lexico-semantic structure, irrespective to whether the sentences follow the canonical word order of the language or (...) not. This difficulty has been accounted as the cognitive cost related to the miscomputation of prominence status of the argument that precedes the verb. Nonetheless, the authors only analyzed the use of alternative word orders in isolated sentences, leaving aside the pragmatic motivation of word order alternation. By means of an eye-tracking task, the current study provides further evidence about the role of information structure for the comprehension of sentences with alternative word order and verb type, and sheds light on the interaction between syntax, semantics and pragmatics. We analyzed both “early” and “late” eye-movement measures as well as accuracy and response times to comprehension questions. Results showed an overall influence of information structure reflected in a modulation of late eye-movement measures as well as offline measures like total reading time and questions response time. However, effects related to the miscomputation of prominence status did not fade away when sentences were preceded by a context that led to non-canonical word order of constituents, showing that prominence computation is a core mechanism for argument interpretation, even in sentences preceded by context. (shrink)

Many researchers want to unify probability and logic by defining logical probability or probabilistic logic reasonably. This paper tries to unify statistics and logic so that we can use both statistical probability and logical probability at the same time. For this purpose, this paper proposes the P–T probability framework, which is assembled with Shannon’s statistical probability framework for communication, Kolmogorov’s probability axioms for logical probability, and Zadeh’s membership functions used as truth functions. Two kinds of probabilities are connected by an (...) extended Bayes’ theorem, with which we can convert a likelihood function and a truth function from one to another. Hence, we can train truth functions (in logic) by sampling distributions (in statistics). This probability framework was developed in the author’s long-term studies on semantic information, statistical learning, and color vision. This paper first proposes the P–T probability framework and explains different probabilities in it by its applications to semantic information theory. Then, this framework and the semantic information methods are applied to statistical learning, statistical mechanics, hypothesis evaluation (including falsification), confirmation, and Bayesian reasoning. Theoretical applications illustrate the reasonability and practicability of this framework. This framework is helpful for interpretable AI. To interpret neural networks, we need further study. (shrink)

The human conceptual system comprises simulated information of sensorimotor experience and linguistic distributional information of how words are used in language. Moreover, the linguistic shortcut hypothesis predicts that people will use computationally cheaper linguistic distributional information where it is sufficient to inform a task response. In a pre‐registered category production study, we asked participants to verbally name members of concrete and abstract categories and tested whether performance could be predicted by a novel measure of sensorimotor similarity (...) (based on an 11‐dimensional representation of sensorimotor strength) and linguistic proximity (based on word co‐occurrence derived from a large corpus). As predicted, both measures predicted the order and frequency of category production but, critically, linguistic proximity had an effect above and beyond sensorimotor similarity. A follow‐up study using typicality ratings as an additional predictor found that typicality was often the strongest predictor of category production variables, but it did not subsume sensorimotor and linguistic effects. Finally, we created a novel, fully grounded computational model of conceptual activation during category production, which best approximated typical human performance when conceptual activation was allowed to spread indirectly between concepts, and when candidate category members came from both sensorimotor and linguistic distributional representations. Critically, model performance was indistinguishable from typical human performance. Results support the linguistic shortcut hypothesis in semantic processing and provide strong evidence that both linguistic and grounded representations are inherent to the functioning of the conceptual system. All materials, data, and code are available at https://osf.io/vaq56/. (shrink)

R. Suszko’s Sentential Calculus with Identity \( SCI \) results from classical propositional calculus \( CPC \) by adding a new connective \(\equiv \) and axioms for identity \(\varphi \equiv \psi \) (which we interpret here as ‘propositional identity’). We reformulate the original semantics of \( SCI \) using Boolean prealgebras which, introduced in different ways, are known in the literature as structures for the modeling of (hyper-) intensional semantics. We regard intensionality here as a measure for the discernibility (...) of propositions (and hyperintensionality as a high degree of intensionality). As concrete examples of \( SCI \) -based intensional modeling, we review and study algebraic semantics of some Lewis-style modal logics in the vicinity of \( S3 \) and present conditions under which those modal systems can be restored, in a precise sense, as certain axiomatic extensions of \( SCI \). This generalizes work of Suszko which is focused on the modal systems \( S4 \) and \( S5 \). Our approach is particularly intended as a proposal to consider and to further study \( SCI \) (and its extensions) as a general framework for the modeling of (hyper-) intensional semantics. (shrink)

The philosophy of measurement studies the conceptual, ontological, epistemic, and technological conditions that make measurement possible and reliable. A new wave of philosophical scholarship has emerged in the last decade that emphasizes the material and historical dimensions of measurement and the relationships between measurement and theoretical modeling. This essay surveys these developments and contrasts them with earlier work on the semantics of quantity terms and the representational character of measurement. The conclusions highlight four characteristics of the emerging research program in (...) philosophy of measurement: it is epistemological, coherentist, practice oriented, and model based. (shrink)

A naturalistic scheme of primitive conceptual representations is proposed using the statistical measure of mutual information. It is argued that a concept represents, not the class of objects that caused its tokening, but the class of objects that is most likely to have caused it (had it been tokened), as specified by the statistical measure of mutual information. This solves the problem of misrepresentation which plagues causal accounts, by taking the representation relation to be determined via (...) ordinal relationships between conditional probabilities. The scheme can deal with statistical biases and does not rely on arbitrary criteria. Implications for the theory of meaning and semantic content are addressed. (shrink)

This paper introduces the logic of evidence and truth \ as an extension of the Belnap–Dunn four-valued logic \. \ is a slightly modified version of the logic \, presented in Carnielli and Rodrigues. While \ is equipped only with a classicality operator \, \ is equipped with a non-classicality operator \ as well, dual to \. Both \ and \ are logics of formal inconsistency and undeterminedness in which the operator \ recovers classical logic for propositions in its scope. (...) Evidence is a notion weaker than truth in the sense that there may be evidence for a proposition \ even if \ is not true. As well as \, \ is able to express preservation of evidence and preservation of truth. The primary aim of this paper is to propose a probabilistic semantics for \ where statements \\) and \\) express, respectively, the amount of evidence available for \ and the degree to which the evidence for \ is expected to behave classically—or non-classically for \ \). A probabilistic scenario is paracomplete when \ + P 1\), and in both cases, \ < 1\). If \ = 1\), or \ = 0\), classical probability is recovered for \. The proposition \, a theorem of \, partitions what we call the information space, and thus allows us to obtain some new versions of known results of standard probability theory. (shrink)

Affective information can be retrieved simply by measuring words co‐occurrences in linguistic contexts. Lenci and colleagues demonstrate that the affective measures retrieved from linguistic occurrences predict words’ concreteness: abstract words are more heavily loaded with affective information than concrete ones. These results challenge the Affective grounding hypothesis, suggesting that abstract concepts may be ungrounded and coded only linguistically, and that their affective load may be a linguistic factor.

The contents and structure of semantic memory have been the focus of much recent research, with major advances in the development of distributional models, which use word co‐occurrence information as a window into the semantics of language. In parallel, connectionist modeling has extended our knowledge of the processes engaged in semantic activation. However, these two lines of investigation have rarely been brought together. Here, we describe a processing model based on distributional semantics in which activation spreads throughout (...) a semantic network, as dictated by the patterns of semantic similarity between words. We show that the activation profile of the network, measured at various time points, can successfully account for response times in lexical and semantic decision tasks, as well as for subjective concreteness and imageability ratings. We also show that the dynamics of the network is predictive of performance in relational semantic tasks, such as similarity/relatedness rating. Our results indicate that bringing together distributional semantic networks and spreading of activation provides a good fit to both automatic lexical processing (as indexed by lexical and semantic decisions) as well as more deliberate processing (as indexed by ratings), above and beyond what has been reported for previous models that take into account only similarity resulting from network structure. (shrink)

In spite of being ubiquitous in life sciences, the concept of information is harshly criticized. Uses of the concept other than those derived from Shannon's theory are denounced as pernicious metaphors. We perform a computational experiment to explore whether Shannon's information is adequate to describe the uses of said concept in commonplace scientific practice. Our results show that semantic sequences do not have unique complexity values different from the value of meaningless sequences. This result suggests that quantitative (...) theoretical frameworks do not account fully for the complex phenomenon that the term “information” refers to. We propose a restructuring of the concept into two related, but independent notions, and conclude that a complete theory of biological information must account completely not only for both notions, but also for the relationship between them. (shrink)

Collecting human similarity judgments is instrumental to measuring and modeling neurocognitive representations and has been made more efficient by the multi-arrangement task. While this task has been tested for collecting semantic similarity judgments, it is unclear whether it also lends itself to phonological and orthographic similarity judgments of words. We have extended the task to include these lexical modalities and compared the results between modalities and against computational models. We find that similarity judgments can be collected for all three (...) modalities, although word forms were considered more difficult to sort and resulted in less consistent inter- and intra-rater agreement than semantics. For all three modalities we can construct stable group-level representational similarity matrices. However, these do not capture significant idiosyncratic similarity information unique to each participant. We discuss the potential underlying causes for differences between modalities and their effect on the application of the multi-arrangement task. (shrink)

The study of biodiversity spans many disciplines and includes data pertaining to species distributions and abundances, genetic sequences, trait measurements, and ecological niches, complemented by information on collection and measurement protocols. A review of the current landscape of metadata standards and ontologies in biodiversity science suggests that existing standards such as the Darwin Core terminology are inadequate for describing biodiversity data in a semantically meaningful and computationally useful way. Existing ontologies, such as the Gene Ontology and others in the (...) Open Biological and Biomedical Ontologies (OBO) Foundry library, provide a semantic structure but lack many of the necessary terms to describe biodiversity data in all its dimensions. In this paper, we describe the motivation for and ongoing development of a new Biological Collections Ontology, the Environment Ontology, and the Population and Community Ontology. These ontologies share the aim of improving data aggregation and integration across the biodiversity domain and can be used to describe physical samples and sampling processes (for example, collection, extraction, and preservation techniques), as well as biodiversity observations that involve no physical sampling. Together they encompass studies of: 1) individual organisms, including voucher specimens from ecological studies and museum specimens, 2) bulk or environmental samples (e.g., gut contents, soil, water) that include DNA, other molecules, and potentially many organisms, especially microbes, and 3) survey-based ecological observations. We discuss how these ontologies can be applied to biodiversity use cases that span genetic, organismal, and ecosystem levels of organization. We argue that if adopted as a standard and rigorously applied and enriched by the biodiversity community, these ontologies would significantly reduce barriers to data discovery, integration, and exchange among biodiversity resources and researchers. (shrink)

This chapter contains section titled: Introduction General Scenario for the Transmission of Information and Its Application to Genetics Semiotic Dimensions of Biological Information Syntactic Dimension I: Measuring the Statistical Entropy of Signals and Messages Syntactic Dimension II: Estimating the Algorithmic Complexity of Signals and Messages Semantic Dimension: Classifying the Mutual Complexity of Transmitters and Receivers Acknowledgment References Further Reading.

Since the beginning of the XX-th century, it became increasingly evident that information, besides matter and energy, is a major actor in the life processes. Moreover, communication of information has been recognized as differentiating living things from inanimate ones, hence as specific to the life processes. Therefore the sciences of matter and energy, chemistry and physics, do not suffice to deal with life processes. Biology should also rely on sciences of information. A majority of biologists, however, did (...) not change their mind and continued to describe life in terms of chemistry and physics. They merely borrowed some vocabulary from the information sciences. The first science of information available to biological applications, semiotics, appeared at the end of the XIX-th century. It is a qualitative and descriptive science which stemmed from efforts of linguists and philosophers to understand the human language and is thus mainly concerned with semantics. Applying semiotics to biology resulted in today’s Biosemiotics. Independently, an explosive expansion of communication engineering began in the second half of the XX-th century. Besides tremendous progresses in hardware technology, it was made possible by the onset of a science of literal communication: Information Theory (Shannon, Bell Syst Tech J 27:379–457, 623–656, 1948). Literal communication consists of faithfully transporting a message from a place to another, or from an instant to another. Because the meaning of a message does not matter for its transportation, information theory ignores semantics. This restriction enables defining information as a measurable quantity on which a mathematical theory of communication is founded. Although lacking implementation means at its beginning, information theory became later very successful for designing communication means. Modern ones, like mobile phones, can be thought of as experimentally proving the relevance and accuracy of information theory since their design and operation heavily rely on it. Information theory is plainly relevant to biological functions which involve literal communication, especially heredity. This paper is intended to compare the two approaches. It shows that, besides obvious differences, they have some points in common: for instance, the quantitative measurement of information obeys Peirce’s triadic paradigm. They also can mutually enlighten each other. Using information theory, which is closer to the basic communication mechanisms, may appear as a preliminary step prior to more elaborated investigations. Criticizing genetics from outside, information theory furthermore reveals that the ability of the template-replication paradigm to faithfully conserve genomes is but a prejudice. Heredity actually demands error-correcting means which impose severe constraints to the living world and must be recognized as biological facts. (shrink)

The paper sets out to offer an alternative to the function/argument approach to the most essential aspects of natural language meanings. That is, we question the assumption that semantic completeness (of, e.g., propositions) or incompleteness (of, e.g., predicates) exactly replicate the corresponding grammatical concepts (of, e.g., sentences and verbs, respectively). We argue that even if one gives up this assumption, it is still possible to keep the compositionality of the semantic interpretation of simple predicate/argument structures. In our opinion, (...) compositionality presupposes that we are able to compare arbitrary meanings in term of information content. This is why our proposal relies on an ‘intrinsically’ type free algebraic semantic theory. The basic entities in our models are neither individuals, nor eventualities, nor their properties, but ‘pieces of evidence’ for believing in the ‘truth’ or ‘existence’ or ‘identity’ of any kind of phenomenon. Our formal language contains a single binary non-associative constructor used for creating structured complex terms representing arbitrary phenomena. We give a finite Hilbert-style axiomatisation and a decision algorithm for the entailment problem of the suggested system. (shrink)

Information theory offers a measure of "mutual information" which provides an appropriate measure of tracking efficiency for the naturalistic epistemologist. The statistical entropy on which it is based is arguably the best way of characterizing the uncertainty associated with the behavior of a system, and it is ontologically neutral. Though not appropriate for the naturalization of meaning, mutual information can serve as a measure of epistemic success independent of semantic maps and payoff structures. (...) While not containing payoffs as terms, mutual information places both upper and lower bounds on payoffs. This constitutes a non-trivial relationship to utility. (shrink)

Parafoveal preview benefit is an implicit measure of lexical activation in reading. PB has been demonstrated for orthographic and phonological but not for semantically related information in English. In contrast, semantic PB is obtained in German and Chinese. We propose that these language differences reveal differential resource demands and timing of phonological and semantic decoding in different orthographic systems.

The deflationary aim of this book, which occupies Part I, is to show that a widely held view has little to be said for it. The constructive aim, pursued in Part II, is to make plausible a measure-theoretic account of propositional attitudes. The discussion is throughout instructive, illuminating and sensitive to the many intricacies surrounding attitude ascriptions and how they can carry information about a subject's psychology. There is close engagement with cognitive science. The book should be read (...) by anyone seriously engaged with issues about propositional attitudes.According to the widely held view, which Matthews calls the Received View, the attitude of Φing that p is a matter of standing in a computational/functional relation to an explicit Representation that expresses the proposition that p, and thinking is ‘an inferential computational process defined over one or more of these Representations that eventuates in the production of either another Representation or a behavior’ . The representations are understood to be sentences in a language of thought and thus to have a compositional syntax and semantics . The theory that Matthews aims to make plausible has it that ascriptions of propositional attitudes in the form ‘X Φs that p’, ascribe a state to a person by relating that person to an abstract object that is the representative of the state in roughly the way that numbers on a scale are the measure-theoretic representations of certain physical magnitudes . We are to think of the role of ‘Jones believes that interest rates will fall’ by analogy with that of ‘Jones weighs 150lbs’. The latter depends on there being arithmetical relations defined over numbers that enable its particular assignment of a number to Jones's weight to represent physical properties that Jones has in virtue …. (shrink)

Sophisticated senator and legislative onion. Whether or not you have ever heard of these things, we all have some intuition that one of them makes much less sense than the other. In this paper, we introduce a large dataset of human judgments about novel adjective-noun phrases. We use these data to test an approach to semantic deviance based on phrase representations derived with compositional distributional semantic methods, that is, methods that derive word meanings from contextual information, and (...) approximate phrase meanings by combining word meanings. We present several simple measures extracted from distributional representations of words and phrases, and we show that they have a significant impact on predicting the acceptability of novel adjective-noun phrases even when a number of alternative measures classically employed in studies of compound processing and bigram plausibility are taken into account. Our results show that the extent to which an attributive adjective alters the distributional representation of the noun is the most significant factor in modeling the distinction between acceptable and deviant phrases. Our study extends current applications of compositional distributional semantic methods to linguistically and cognitively interesting problems, and it offers a new, quantitatively precise approach to the challenge of predicting when humans will find novel linguistic expressions acceptable and when they will not. (shrink)

Recent studies have shown that schizophrenia may be a disease affecting the states of consciousness. The present study is aimed at investigating metamemory, i.e., the knowledge about one's own memory capabilities, in patients with schizophrenia. The accuracy of the Confidence level (CL) in the correctness of the answers provided during a recall phase, and the predictability of the Feeling of Knowing (FOK) when recall fails were measured using a task consisting of general information questions and assessing semantic memory. (...) Nineteen outpatients were paired with 19 control subjects with respect to age, sex, and education. Results showed that patients with schizophrenia exhibited an impaired semantic memory. CL ratings as well as CL and FOK accuracy were not significantly different in the schizophrenic and the control groups. However, FOK ratings were significantly reduced for the patient group, and discordant FOK judgments were also observed more frequently. Such results suggest that FOK judgments are impaired in patients with schizophrenia, which confirms that schizophrenia is an illness characterized by an impaired conscious awareness of one's own knowledge. (shrink)

The Influence of Emotional and Non-emotional Concepts Activation on Information Processing and Unintentional Memorizing The aim of the work is to compare mechanisms of semantic and emotional processing and memory. Targets were primed by category name. The congruency of prime and target was manipulated. The reaction time of lexical decisions and the effects of unintentional memorizing of word targets were measured. Activation of semantic and emotional nodes leads to faster processing of related concepts: congruent targets are processed (...) faster than incongruent. Processing congruent primed emotional concepts depends on their modality: anger and joy words are processed faster than sadness. Thus, congruently primed activating emotional concepts are processed differently from congruently primed deactivating concepts. The effectiveness of unintentional memory of emotional and non-emotional concepts is based on different mechanisms: congruently primed emotional words are better remembered than incongruently primed. The results are discussed in the framework of spreading activation theory and theory of emotional memory. (shrink)

The aim of this study is to develop a valid and reliable measurement tool for determining students' spiritual health and life orientation. For this purpose, the Spiritual Health and Life-Orientation Measure (SHALOM) inventory developed by Fisher (2010) is adapted to Turkish. The adaptation study was carried out on 1591 high school students in three study groups studying in Ankara and Muş. The original English measure consisting of four dimensions and twenty items was translated into Turkish, factor analysis, validity (...) and reliability tests were conducted on the sampling data. As a result of the study, the Turkish-adapted inventory consists of four dimensions (personal, social, environmental and transcendental) which resemble the original inventory. In addition, internal consistency coefficients of the inventory dimensions were in perfect harmony with the original inventory and served the purpose of the scale. In Conclusion The Turkish adaptation of the SHALOM Inventory can be used in different disciplines of psychology, educational sciences, and social sciences. Summary: The concept of religion, which is an important dynamic and carrier of the social field, has gone into a double distinction since the second half of the 18th century; the concept of spirituality has begun to be refined from the concept of religion. The concepts of religion and spirituality are very difficult to define; While the concept of religion focuses ideology and rules of belief, spirituality centers on individual experiences and interrelationships that extend religion. For this reason, different spirituality and religion definitions are made from different perspectives and different spirituality scales were developed within this framework. However, the results of these studies differ significantly from each other; this means that spirituality was defined and conceptualized based on the scale that was used. Early period studies on spirituality mostly focus on religion, health, psychology and work life. In these studies, after defining the concept of spirituality; the relationship between the concept and health, religion, psychology and business life or necessity for human life is discussed. In the West, until the 1950s, the concepts of religion and spirituality were used interrelated. However, today these two concepts are almost completely separated from each other.Literature consists of numerous inventory development studies to measure spirituality. The fact that the inventory works based on different conceptual foundations makes it difficult to draw a general, meaningful and consistent conclusion about spiritual health and life orientation. Furthermore, spirituality measurements reflecting the religion and values ​​of a particular culture cannot be comprehensive or universal. At this point, Fisher criticizes the measurement tools developed for the purpose of measuring spirituality: in terms of "mixing religion and spirituality", "relying on the world of values", "not taking into account cultural differences", "and questioning only the mystical/spiritual experience". As a result, it can be said that no measurement developed in the conceptual structure of the West does not take into account the cultural flexibility and accept its spiritual values as universal or prevalent.The SHALOM inventory developed by Fisher, which adapted to the Turkish culture in present study, is based on four basic (individual, social, environmental and transcendent) areas that constitute the world of interpersonal relationship. In this study, spirituality, as in Fisher's work, emphasizes the interaction with certain concepts of different intensities that are considered as independent from religion and above religions. In this context, the concept of spirituality communicates with one's personal space, social position, nature, and transcendental power. This adaptation study will provide useful information and comments on the students' spiritual health levels. This is the most important motive behind the idea of adapting the SHALOM inventory developed by Fisher to the Turkish culture. In addition, by adapting the SHALOM inventory, which is emphasized to have cultural flexibility and adapted to different languages, a new and different measurement tool will be available to understand the nature of the concept of spirituality.This research was carried out to adapt the inventory of Spiritual Health and Life Orientation scale developed for students to Turkish culture. This inventory adaptation study was performed with the data collected from three working groups in Ankara and Muş provinces and 1591 high school students. The first study group was carried out with 414, the second study group with 788, and the third group with 389 high school students. While the data collected from 414 students were used for Exploratory Factor Analysis (AFA) analysis, data collected from 788 students were used for Confirmatory Factor Analysis (CFA). In addition, 389 students were used to determine the criterion validity of the inventory. The original language of the SHALOM inventory, which is intended to be adapted into Turkish, is English, and translation studies are conducted separately by three linguistic experts who know the grammar and semantic characteristics of both languages. After the translation studies, the scale was applied to the sampling group and AFA was performed on the sample data. The AFA results showed that a factor roof resembling the original inventory was formed. Determining factors are given appropriate names (personal, enviromental, social and transcendental) by taking into consideration the theoretical names and the dimension names in the original form of the SHALOM. The structure was confirmed by DFA, and as a result of the DFA, X2/sd (1.72) ratio and IFI (0.96) fit indicator was found to be the appropiate fit for the model tested. As a result, it is understood that the Spiritual Health and Life Orientation Inventory consists of four dimensions as in the original inventory, the internal consistency coefficients of the inventory dimensions are in harmony with the original inventory and serve the purpose of the scale. In conclusion the Turkish adaptation of the SHALOM Inventory can be used in different disciplines of psychology, educational sciences, and social sciences. Spirituality should not only be defined within the framework of Western theories, but the nature and likelihood of the spirituality predicted by Islam should be discussed. Moreover, the types and dimensions of Islamic spirituality should be determined by taking into account the cultural subjectivity of an Islamic character. In the study of spirituality, the human model which modernity presents universally should not be accepted as the only truth. It should be tried to develop human models that come from Islamic culture and history and which are specific to us and define us. This should be taken into account not only in mental health / religious studies, but also in psychology of religion in general. In addition, culture-specificity should be given importance, and the experience gained from the cultural accumulation developed by the Turkish civilization with the Islamic doctrine should lead to the studies of spirituality. In this respect, this study aims to adapt the value and spiritual orientation of a different culture to Turkish culture, but it is problematic to construct the concept with Western values. Although Western values are similar to Islamic values and principles, it is envisaged that it may be difficult to measure the concept of spirituality in practice. (shrink)

Recently there has been a lively revival of interest in implicatures, particularly scalar implicatures. Building on the resulting literature, our main goal in the present paper is to establish an empirical generalization, namely that SIs can occur systematically and freely in arbitrarily embedded positions. We are not so much concerned with the question whether drawing implicatures is a costly option (in terms of semantic processing, or of some other markedness measure). Nor are we specifically concerned with how implicatures (...) come about (even though, to get going, we will have to make some specific assumptions on this matter). The focus of our discussion is testing the claim of the pervasive embeddability of SIs in just about any context, a claim that remains so far controversial. While our main goal is the establishment of an empirical generalization, if we succeed, a predominant view on the division of labor between semantics and pragmatics will have to be revised. A secondary goal of this paper is to hint at evidence that a revision is needed on independent grounds. But let us first present, in a rather impressionistic way, the reasons why a revision would be required if our main generalization on embedded SIs turns out to be correct. In the tradition stemming from Grice (1989), implicatures are considered a wholly pragmatic phenomenon and SIs are often used as paramount examples. Within such a tradition, 㳊 semantics is taken to deal with the compositional construction of sentence meaning (a term which we are using for now in a loose, non technical way), while pragmatics deals with how sentence meaning is actually put to use (i.e. enriched and possibly modified through reasoning about speakers’ intentions, contextually relevant information, etc.). Simply put, on this view pragmatics takes place at the level of complete utterances and pragmatic enrichments are a root phenomenon (something that happens globally to sentences) rather than a compositional one.. (shrink)