This paper attempts to answer a central question in unsupervised learning: what does it mean to “make sense” of a sensory sequence? In our formalization, making sense involves constructing a symbolic causal theory that both explains the sensory sequence and also satisfies a set of unity conditions. The unity conditions insist that the constituents of the causal theory – objects, properties, and laws – must be integrated into a coherent whole. On our account, making sense of sensory (...) input is a type of program synthesis, but it is unsupervised program synthesis. Our second contribution is a computer implementation, the Apperception Engine, that was designed to satisfy the above requirements. Our system is able to produce interpretable human-readable causal theories from very small amounts of data, because of the strong inductive bias provided by the unity conditions. A causal theory produced by our system is able to predict future sensor readings, as well as retrodict earlier readings, and impute (fill in the blanks of) missing sensory readings, in any combination. In fact, it is able to do all three tasks simultaneously. We tested the engine in a diverse variety of domains, including cellular automata, rhythms and simple nursery tunes, multi-modal binding problems, occlusion tasks, and sequence induction intelligence tests. In each domain, we test our engine's ability to predict future sensor values, retrodict earlier sensor values, and impute missing sensory data. The Apperception Engine performs well in all these domains, significantly out-performing neural net baselines. We note in particular that in the sequence induction intelligence tests, our system achieved human-level performance. This is notable because our system is not a bespoke system designed specifically to solve intelligence tests, but a general-purpose system that was designed to make sense of any sensory sequence. (shrink)

From birth to 15 months infants and caregivers form a fundamentally intersubjective, dyadic unit within which the infant’s ability to recognize gender/sex in the world develops. Between about 18 and 36 months the infant accumulates an increasingly clear and subjective sense of self as female or male. We know little about how the precursors to gender/sex identity form during the intersubjective period, nor how they transform into an independent sense of self by 3 years of age. In this Theory and (...) Hypothesis article I offer a general framework for thinking about this problem. I propose that through repetition and patterning, the dyadic interactions in which infants and caregivers engage imbue the infant with an embodied, i.e., sensori-motor understanding of gender/sex. During this developmental period (which I label Phase 1) gender/sex is primarily an intersubjective project. From 15 to 18 months (which I label Phase 2) there are few reports of newly appearing gender/sex behavioral differences, and I hypothesize that this absence reflects a period of developmental instability during which there is a transition from gender/sex as primarily inter-subjective to gender/sex as primarily subjective. Beginning at 18 months (i.e., the start of Phase 3), a toddler’s subjective sense of self as having a gender/sex emerges, and it solidifies by 3 years of age. I propose a dynamic systems perspective to track how infants first assimilate gender/sex information during the intersubjective period (birth to 15 months); then explore what changes might occur during a hypothesized phase transition (15 to 18 months), and finally, review the emergence and initial stabilization of individual subjectivity-the period from 18 to 36 months. The critical questions explored focus on how to model and translate data from very different experimental disciplines, especially neuroscience, physiology, developmental psychology and cognitive development. I close by proposing the formation of a research consortium on gender/sex development during the first 3 years after birth. (shrink)

I argue that the GANE model basically explains an arousal-based amplification of emotional stimuli, whereas effects on neutral stimuli indicate a contextualization process aiming to reduce stimulus ambiguity. To extend the model's validity, I suggest distinguishing between internal and external emotional sources, as well considering the stimulus valence and addressing age-related differences in attention and memory preferences.

We propose that a top priority of the cerebral cortex must be the discovery and explicit representation of the environmental variables that contribute as major factors to environmental regularities. Any neural representation in which such variables are represented only implicitly (thus requiring extra computing to use them) will make the regularities more complex and therefore more difficult, if not impossible, to learn. The task of discovering such important environmental variables is not an easy one, since their existence is only indirectly (...) suggested by the sensory input patterns the cortex receives – these variables are “hidden.” We present a candidate computational strategy for (1) discovering regularity-simplifying environmental variables, (2) learning the regularities, and (3) using regularities in perceptual and decision-making tasks. The SINBAD computational model discovers useful environmental variables through a search for different, but nevertheless highly correlated functions of any kind over non-overlapping subsets of the known variables, this being indicative of some important environmental variable that is responsible for the correlation. We suggest that such a search is performed in the neocortex by the dendritic trees of individual pyramidal cells. According to the SINBAD model, the basic function of each pyramidal cell is (1) to discover and represent one of the regularity-simplifying environmental variables, and (2) to learn to infer the state of its variable from the states of other variables, represented by other pyramidal cells. A network of such cells – each cell just attending to representation of its variable – can function as a sophisticated and useful inferential model of the outside world. (shrink)

What we perceive is the product of an intrinsic process and not part of external physical reality. This notion is consistent with the philosophical position of transcendental idealism but also agrees with physiological findings on the thalamocortical system. -Frequency rhythms of discharge activity from thalamic and cortical neurons are facilitated by cholinergic arousal and resonate in thalamocortical networks, thereby transiently forming assemblies of coherent oscillations under constraints of sensory input and prefrontal attentional mechanisms. Perception and conscious experience may (...) be based on such assemblies and sensory input to thalamic nuclei plays merely a constraining role in their formation. In schizophrenia, the ability of sensory input to modulate self-organisation of thalamocortical activity may be generally reduced. If during arousal thalamocortical self-organisation is underconstrained by sensory input, then attentional mechanisms alone may determine the content of perception and hallucinations may arise. (shrink)

What we perceive is the product of an intrinsic process and not part of external physical reality. This notion is consistent with the philosophical position of transcendental idealism but also agrees with physiological findings on the thalamocortical system. -Frequency rhythms of discharge activity from thalamic and cortical neurons are facilitated by cholinergic arousal and resonate in thalamocortical networks, thereby transiently forming assemblies of coherent oscillations under constraints of sensory input and prefrontal attentional mechanisms. Perception and conscious experience may (...) be based on such assemblies and sensory input to thalamic nuclei plays merely a constraining role in their formation. In schizophrenia, the ability of sensory input to modulate self-organisation of thalamocortical activity may be generally reduced. If during arousal thalamocortical self-organisation is underconstrained by sensory input, then attentional mechanisms alone may determine the content of perception and hallucinations may arise. (shrink)

In numerous peripheral sense organs, external stimuli are detected by primary sensory neurons compartmentalized within specialized structures composed of cuticular or epithelial tissue. Beyond reflecting developmental constraints, such compartmentalization also provides opportunities for grouped neurons to functionally interact. Here, the authors review and illustrate the prevalence of these structural units, describe characteristics of compartmentalized neurons, and consider possible interactions between these cells. This article discusses instances of neuronal crosstalk, examples of which are observed in the vertebrate tastebuds and multiple (...) types of arthropod chemosensory hairs. Particular attention is paid to insect olfaction, which presents especially well‐characterized mechanisms of functional, cross‐neuronal interactions. These examples highlight the potential impact of peripheral processing, which likely contributes more to signal integration than previously considered. In surveying a wide variety of structural units, it is hoped that this article will stimulate future research that determines whether grouped neurons in other sensory systems can also communicate to impact information processing. (shrink)

Some 20 years ago Todd and colleagues proposed that rhythm perception is mediated by the conjunction of a sensory representation of the auditory input and a motor representation of the body (Todd, 1994a, 1995 ), and that a sense of motion from sound is mediated by the vestibular system (Todd, 1992a, 1993b ). These ideas were developed into a sensory-motor theory of rhythm and beat induction (Todd et al., 1999 ). A neurological substrate was proposed which might (...) form the biological basis of the theory (Todd et al., 2002 ). The theory was implemented as a computational model and a number of experiments conducted to test it. In the following time there have been several key developments. One is the demonstration that the vestibular system is primal to rhythm perception, and in related work several experiments have provided further evidence that rhythm perception is body dependent. Another is independent advances in imaging, which have revealed the brain areas associated with both vestibular processing and rhythm perception. A third is the finding that vestibular receptors contribute to auditory evoked potentials (Todd et al., 2014a, b ). These behavioral and neurobiological developments demand a theoretical overview which could provide a new synthesis over the domain of rhythm perception. In this paper we suggest four propositions as the basis for such a synthesis. (1) Rhythm perception is a form of vestibular perception; (2) Rhythm perception evokes both external and internal guidance of somatotopic representations; (3) A link from the limbic system to the internal guidance pathway mediates the “dance habit”; (4) The vestibular reward mechanism is innate. The new synthesis provides an explanation for a number of phenomena not often considered by rhythm researchers. We discuss these along with possible computational implementations and alternative models and propose a number of new directions for future research. (shrink)

It has been shown that various types of stress initiate different physiological and neuroendocrine disorders. Oxytocin is mainly produced in the supraoptic nucleus and paraventricular nucleus of the hypothalamus. Hypothalamic OT has antistress effects and attenuates the hypothalamic–pituitary–adrenal axis. One mechanism behind the antistress effects of OT is mediated through the inhibition from GABAA receptors on corticotropin-releasing factor expression at the PVN. Various manual therapies such as acupuncture, transcutaneous electrical nerve stimulation, and massage initiate the stimulation of somatosensory neurons of (...) the body. It is well-known that TENS simulates OT expression, while it inhibits CRF expression at the PVN following chronic stress loading in rodents. Upregulation of OT expression at the hypothalamus is activated by the somatosensory stimulation, which is mediated via the spinothalamic pathway. Thus, somatosensory stimulation is beneficial in treating stress-associated symptoms. Hypothalamic OT is associated with the social behaviors, including maternal care and affiliation. Childhood neglect and/or child abuse are severely responsible for deleterious long-term effects on the cognitive/social activity and behavioral development. At parturition, a profound amount of OT is released into the systemic circulation in response to vaginal and cervical stimulation caused by the body of fetus, which induces the onset of maternal behavior. Peridural anesthesia effectively impairs the sensitivity to vaginal and cervical stimulation at parturition. OT levels in cerebrospinal fluid is significantly reduced following peridural anesthesia. The vaginal delivery mothers had significantly more OT pulses than the caesarian section mothers. Due to low levels of endogenous OT, maternal behavior could be interrupted by epidural anesthesia and CS at parturition because of the reduction of the usual sensory input from the genitalia. (shrink)

Hand motor impairment persists after stroke. Sensory inputs may facilitate recovery of motor function. This pilot study tested the effectiveness of tactile sensory noise in improving hand motor function in chronic stroke survivors with tactile sensory deficits, using a repeated measures design. Sensory noise in the form of subthreshold, white noise, mechanical vibration was applied to the wrist skin during motor tasks. Hand dexterity assessed by the Nine Hole Peg Test and the Box and Block Test (...) and pinch strength significantly improved when the sensory noise was turned on compared with when it was turned off in chronic stroke survivors. The subthreshold sensory noise to the wrist appears to induce improvements in hand motor function possibly via neuronal connections in the sensoriomotor cortex. The approach of applying concomitant, unperceivable mechanical vibration to the wrist during hand motor tasks is easily adoptable for clinic use as well as unsupervised home use. This pilot study suggests a potential for a wristband-type assistive device to complement hand rehabilitation for stroke survivors with sensorimotor deficit. (shrink)

Based on recent insight into the thalamocortical system and its role in perception and conscious experience, a unified pathophysiological framework for hallucinations in neurological and psychiatric conditions is proposed, which integrates previously unrelated neurobiological and psychological findings. Gamma-frequency rhythms of discharge activity from thalamic and cortical neurons are facilitated by cholinergic arousal and resonate in networks of thalamocortical circuits, thereby transiently forming assemblies of coherent gamma oscillations under constraints of afferent sensory input and prefrontal attentional mechanisms. If perception (...) is based on synchronisation of intrinsic gamma activity in the thalamocortical system, then sensory input to specific thalamic nuclei may merely play a constraining role. Hallucinations can be regarded as underconstrained perceptions that arise when the impact of sensory input on activation of thalamocortical circuits and synchronisation of thalamocortical gamma activity is reduced. In conditions that are accompanied by hallucinations, factors such as cortical hyperexcitability, cortical attentional mechanisms, hyperarousal, increased noise in specific thalamic nuclei, and random sensory input to specific thalamic nuclei may, to a varying degree, contribute to underconstrained activation of thalamocortical circuits. The reticular thalamic nucleus plays an important role in suppressing random activity of relay cells in specific thalamic nuclei, and its dysfunction may be implicated in the biological vulnerability to hallucinations in schizophrenia. Combined with general activation during cholinergic arousal, this leads to excessive disinhibition in specific thalamic nuclei, which may allow cortical attentional mechanisms to recruit thalamic relay cells into resonant assemblies of gamma oscillations, regardless of their actual sensory input, thereby producing an underconstrained perceptual experience. Key Words: Charles Bonnet syndrome; gamma oscillations; hallucinations; late paraphrenia; Lewy body dementia; perception; schizophrenia; thalamocortical system. (shrink)

A key question in studying consciousness is how neural operations in the brain can identify streams of sensory input as belonging to distinct modalities, which contributes to the representation of qualitatively different experiences. The basis for identification of modalities is proposed to be constituted by self-organized comparative operations across a network of unimodal and multimodal sensory areas. However, such network interactions alone cannot answer the question how sensory feature detectors collectively account for an integrated, yet phenomenally (...) differentiated experiential content. This problem turns out to be different from, although related to, the binding problem. It is proposed that the neural correlate of an enriched, multimodal experience is constituted by the attractor state of a dynamic associative network. Within this network, unimodal and multimodal sensory maps continuously interact to influence each other’s attractor state, so that a feature change in one modality results in a fast re-coding of feature information in another modality. In this scheme, feature detection is coded by firing-rate, whereas firing phase codes relational aspects. (shrink)

How should a machine intelligence perform unsupervised structure discovery over streams of sensory input? One approach to this problem is to cast it as an apperception task [1]. Here, the task is to construct an explicit interpretable theory that both explains the sensory sequence and also satisfies a set of unity conditions, designed to ensure that the constituents of the theory are connected in a relational structure. However, the original formulation of the apperception task had one fundamental (...) limitation: it assumed the raw sensory input had already been parsed using a set of discrete categories, so that all the system had to do was receive this already-digested symbolic input, and make sense of it. But what if we don't have access to pre-parsed input? What if our sensory sequence is raw unprocessed information? The central contribution of this paper is a neuro-symbolic framework for distilling interpretable theories out of streams of raw, unprocessed sensory experience. First, we extend the definition of the apperception task to include ambiguous (but still symbolic) input: sequences of sets of disjunctions. Next, we use a neural network to map raw sensory input to disjunctive input. Our binary neural network is encoded as a logic program, so the weights of the network and the rules of the theory can be solved jointly as a single SAT problem. This way, we are able to jointly learn how to perceive (mapping raw sensory information to concepts) and apperceive (combining concepts into declarative rules). (shrink)

In this paper we wish to bring together two seemingly independent areas of research: synaesthesia and sensory substitution. Synaesthesia refers to a rare condition where a sensory stimulus elicits not only the sensation that stimulus evokes in its own modality, but an additional one; a synaesthete may thus hear the word “Monday”, and, in addition to hearing it, have a concurrent visual experience of a red color. Sensory substitution, in contrast, attempts to substitute a sensory modality (...) that a person has lost by transforming the information it provided so that it can be accessed through another, intact sensory modality. To make visual information accessible to a blind person, for example, data taken by a camera would be transformed into tactile or auditory information. What do synaesthesia and sensory substitution have in common? Research in both of these areas contributes to our understanding both of cross-modal cooperation and of sensory sensations or qualia, asking under what circumstances these can arise in a modality that is not stimulated. Synaesthesia reveals that this “sensory cross-activation” is possible, and sensory substitution research hopes to induce it. In this article, we will review briefly the literature on synaesthesia, and discuss the issue of qualia for this domain of research. We will then address the evidence for synaesthesia and visual qualia in the blind, and the research on sensory substitution, to finally ask whether sensory substitution may induce a ‘synthetic’ form of synaesthesia by taking advantage of the nervous system’s capacity for generating visual images in the absence of retinal input. (shrink)

The processing of time intervals in the sub- to supra-second range by the brain is critical for the interaction of primates with their surroundings in activities, such as foraging and hunting. For an accurate processing of time intervals by the brain, representation of physical time within neuronal circuits is necessary. I propose that time dimension of the physical surrounding is represented in the brain by different types of neuronal oscillators, generating spikes or spike bursts at regular intervals. The proposed oscillators (...) include the pacemaker neurons, tonic inputs, and synchronized excitation and inhibition of inter-connected neurons. Oscillators, which are built inside various circuits of brain, help to form modular clocks, processing time intervals or other temporal characteristics specific to functions of a circuit. Relative or absolute duration is represented within neuronal oscillators by “neural temporal unit,” defined as the interval between regularly occurring spikes or spike bursts. Oscillator output is processed to produce changes in activities of neurons, named frequency modulator neuron, wired within a separate module, represented by the rate of change in frequency, and frequency of activities, proposed to encode time intervals. Inbuilt oscillators are calibrated by (a) feedback processes, (b) input of time intervals resulting from rhythmic external sensory stimulation, and (c) synchronous effects of feedback processes and evoked sensory activity. A single active clock is proposed per circuit, which is calibrated by one or more mechanisms. Multiple calibration mechanisms, inbuilt oscillators, and the presence of modular connections prevent a complete loss of interval timing functions of the brain. (shrink)

Sensation elicited by a skin stimulus was subjectively reported to feel stronger when followed by a stimulus to somatosensory cerebral cortex , even when C was delayed by up to 400 ms or more. This expands the potentiality for retroactive effects beyond that previously known as backward masking. It also demonstrates that the content of a sensory experience can be altered by another cerebral input introduced after the sensory signal arrives at the cortex. The long effective S-C (...) intervals support the thesis that a duration of cortical activity of up to 0.5 s is required before awareness of a sensory stimulus is developed. (shrink)

It remains a standing problem how and why the first nervous systems evolved. Molecular and genomic information is now rapidly accumulating but the macroscopic organization and functioning of early nervous systems remains unclear. To explore potential evolutionary options, a coordination centered view is discussed that diverges from a standard input–output view on early nervous systems. The scenario involved, the skin brain thesis, stresses the need to coordinate muscle-based motility at a very early stage. This paper addresses how this scenario (...) with its focus on coordination also deals with sensory aspects. It will be argued that the neural structure required to coordinate extensive sheets of contractile tissue for motility provides the starting point for a new multicellular organized form of sensing. Moving a body by muscle contraction provides the basis for a multicellular organization that is sensitive to external surface structure at the scale of the animal body. Instead of thinking about early nervous systems as being connected to the environment merely through input and output, the implication developed here is that early nervous systems provide the foundation for a highly specific animal sensorimotor organization in which neural activity directly reflects bodily and environmental spatiotemporal structure. While the SBT diverges from the input–output view, it is closely linked to and supported by ongoing work on embodied approaches to intelligence to which it adds a new interpretation of animal embodiment and sensorimotor organization. (shrink)

During sensory stimulation, visual cortical neurons undergo massive synaptic bombardment. This increases their input conductance, and action potentials mainly result from membrane potential fluctuations. To understand the response properties of neurons operating in this regime, we studied a model neuron with synaptic inputs represented by transient membrane conductance changes. We show that with a simultaneous increase of excitation and inhibition, the firing rate first increases, reaches a maximum, and then decreases at higher input rates. Comodulation of excitation (...) and inhibition, therefore, does not provide a straightforward way of controlling the neuronal firing rate, in contrast to coding mechanisms postulated previously. The synaptically induced conductance increase plays a key role in this effect: it decreases firing rate by shunting membrane potential fluctuations, and increases it by reducing the membrane time constant, allowing for faster membrane potential transients. These findings do not depend on details of the model and, hence, are relevant to cells of other cortical areas as well. (shrink)

The sense of agency is a subjective feeling that one's own actions drive action outcomes. Previous studies have focused primarily on the temporal contingency between actions and sensory inputs as a possible mechanism for the sense of agency. However, the contribution of the integrity of visual inputs has not been systematically addressed. In the current study, we developed a psychophysical task to examine the role of visual inputs as well as temporal contingencies toward the sense of agency. Specifically, participants (...) were required to track a target on a sinusoidal curve on a computer screen. Visual integrity of sensory inputs was manipulated by gradually occluding a computer cursor, and participants were asked to report the sense of agency on a nine-point Likert scale. Temporal contingency was manipulated by varying the delay between finger movements on a touchpad and cursor movements. The results showed that the sense of agency was influenced by both visual integrity and temporal contingency. These results are discussed in the context of current models that have proposed that the sense of agency emerges from the comparison of visual inputs with motor commands. (shrink)

The propositions that the senses are separate and that the global array may be sufficient for adequate perception are questioned. There is evidence that certain tasks may be primarily but these are a special case along the behavioral continuum. Many tasks involve sensory information that is ambiguous, and other sources of information may be required for adequate perception.

Often, sensory input underdetermines perception. One such example is the perception of illusory contours. In illusory contour perception, the content of the percept includes the presence of a contour that is absent from the informational content of the sensation. (By “sensation” I mean merely information-bearing events at the transducer level. I intend no further commitment such as the identification of sensations with qualia.) I call instances of perception underdetermined by sensation “underdetermined perception.” The perception of illusory contours is (...) just one kind of underdetermined perception. The focus of this chapter is another kind of underdetermined perception: what I shall call "active perception". Active perception occurs in cases in which the percept, while underdetermined by sensation, is determined by a combination of sensation and action. The phenomenon of active perception has been used by several to argue against the positing of representations in explanations of sensory experience, either by arguing that no representations need be posited or that far fewer than previously thought need be posited. Such views include, but are not limited to those of Gibson (1966, 1986), Churchland. (shrink)

What mediates between sensory input and motor output? What makes it possible to act on what you perceive? Bence Nanay argues that pragmatic representations provide the perceptual guidance for performing actions. They play a key role in our mental lives, and help explain why the majority of our mental processes are very similar to those of animals.

Sensory substitution devices are a type of sensory prosthesis that (typically) convert visual stimuli transduced by a camera into tactile or auditory stimulation. They are designed to be used by people with impaired vision so that they can recover some of the functions normally subserved by vision. In this chapter we will consider what philosophers might learn about the nature of the senses from the neuroscience of sensory substitution. We will show how sensory substitution devices work (...) by exploiting the cross-modal plasticity of sensory cortex: the ability of sensory cortex to pick up some types of information about the external environment irrespective of the nature of the sensory inputs it is processing. We explore the implications of cross-modal plasticity for theories of the senses that attempt to make distinctions between the senses on the basis of neurobiology. (shrink)

Multimodal integration is the formation of a coherent percept from different sensory inputs such as vision, audition, and somatosensation. Most research on multimodal integration in speech perception has focused on audio-visual integration. In recent years, audio-tactile integration has also been investigated, and it has been established that puffs of air applied to the skin and timed with listening tasks shift the perception of voicing by naive listeners. The current study has replicated and extended these findings by testing the effect (...) of air puffs on gradations of voice onset time along a continuum rather than the voiced and voiceless endpoints of the original work. Three continua were tested: bilabial (“pa/ba”), velar (“ka/ga”), and a vowel continuum (“head/hid”) used as a control. The presence of air puffs was found to significantly increase the likelihood of choosing voiceless responses for the two VOT continua but had no effect on choices for the vowel continuum. Analysis of response times revealed that the presence of air puffs lengthened responses for intermediate (ambiguous) stimuli and shortened them for endpoint (non-ambiguous) stimuli. The slowest response times were observed for the intermediate steps for all three continua, but for the bilabial continuum this effect interacted with the presence of air puffs: responses were slower in the presence of air puffs, and faster in their absence. This suggests that during integration auditory and aero-tactile inputs are weighted differently by the perceptual system, with the latter exerting greater influence in those cases where the auditory cues for voicing are ambiguous. (shrink)

This article investigates the agency of the architecture of the Temple of Apollo at Claros and its cognitive impact on the ritual of divination. In the comparison with Delphi, Claros represents a peculiar example of how architecture evolved to suit and shape at the same time the ritual it was hosting. The paper starts with the analysis of the exteriors of the building, highlighting the choice of the Doric style dictated by the desire of being associated to Delphi. A further (...) analysis of the internal layout gives the author a chance of describing the cognitive inputs that the peculiar structure sent to the ancient mind. Specifically, the paper studies how the narrow tunnels made of black marble that turned seven times and the underground cave like adyton created a situation of sensory confusion in the mind of the seekers and the oracle that found themselves prone to detect agencies in the surrounding space and specifically to identify the agent with Apollo. (shrink)

Behrendt & Young's (B&Y's) theory offers a potentially important perspective on the neurobiology of schizophrenia, but it remains incomplete. In addition to bottom-up contributions, such as those associated with disturbances in sensory constraints on cognitive processes, a comprehensive model requires the integration of the consequences of abnormal top-down modulation of input processing for the evolution of “underconstrained” perceptions. Dysfunctional cholinergic modulation of input functions represents a necessary mechanism for the generation of false perceptions.

A new theory is taking hold in neuroscience. It is the theory that the brain is essentially a hypothesis-testing mechanism, one that attempts to minimise the error of its predictions about the sensory input it receives from the world. It is an attractive theory because powerful theoretical arguments support it, and yet it is at heart stunningly simple. Jakob Hohwy explains and explores this theory from the perspective of cognitive science and philosophy. The key argument throughout The Predictive (...) Mind is that the mechanism explains the rich, deep, and multifaceted character of our conscious perception. It also gives a unified account of how perception is sculpted by attention, and how it depends on action. The mind is revealed as having a fragile and indirect relation to the world. Though we are deeply in tune with the world we are also strangely distanced from it. (shrink)

Brains, it has recently been argued, are essentially prediction machines. They are bundles of cells that support perception and action by constantly attempting to match incoming sensory inputs with top-down expectations or predictions. This is achieved using a hierarchical generative model that aims to minimize prediction error within a bidirectional cascade of cortical processing. Such accounts offer a unifying model of perception and action, illuminate the functional role of attention, and may neatly capture the special contribution of cortical processing (...) to adaptive success. This target article critically examines this approach, concluding that it offers the best clue yet to the shape of a unified science of mind and action. Sections 1 and 2 lay out the key elements and implications of the approach. Section 3 explores a variety of pitfalls and challenges, spanning the evidential, the methodological, and the more properly conceptual. The paper ends (sections 4 and 5) by asking how such approaches might impact our more general vision of mind, experience, and agency. (shrink)

Sensorimotor psychology studies the mental processes that control goal-directed bodily motion. Recently, sensorimotor psychologists have provided empirically successful Bayesian models of motor control. These models describe how the motor system uses sensory input to select motor commands that promote goals set by high-level cognition. I highlight the impressive explanatory benefits offered by Bayesian models of motor control. I argue that our current best models assign explanatory centrality to a robust notion of mental representation. I deploy my analysis to (...) defend intentional realism, to rebut eliminativism and instrumentalism regarding mental representation, and to explore the relation between intentionality and normativity. (shrink)

The perceptual system estimates distal conditions based upon proximal sensory input. It typically exploits information from multiple cues across and within modalities: it estimates shape based upon visual and haptic cues; it estimates depth based upon convergence, binocular disparity, motion parallax, and other visual cues; and so on. Bayesian models illuminate the computations through which the perceptual system combines sensory cues. I review key aspects of these models. Based on my review, I argue that we should posit (...) co-referring perceptual representations corresponding to distinct sensory cues. For example, the perceptual system represents a distal size using a representation canonically linked with vision and a distinct representation canonically linked with touch. Distinct co-referring perceptual representations represent the same denotation, but they do so under different modes of presentation. Bayesian cue combination models demonstrate that psychological explanation of perception should attend to mode of presentation and not simply to denotation. (shrink)

Our only channel of information about the world is the impact of external forces on our sensory surfaces. So says science itself. There is no clairvoyance. How, then, can we have parlayed this meager sensory input into a full-blown scientific theory of the world? This is itself a scientific question. The pursuit of it, with free use of scientific theory, is what I call naturalized epistemology. The Roots of Reference falls within that domain. Its more specific concern, (...) within that domain, is reference to concrete and abstract objects: what such reference consists in, and how we achieve it. (shrink)

A basic function of cognition is to detect regularities in sensory input to facilitate the prediction and recognition of future events. It has been proposed that these implicit expectations arise from an internal predictive coding model, based on knowledge acquired through processes such as statistical learning, but it is unclear how different types of statistical information affect listeners’ memory for auditory stimuli. We used a combination of behavioral and computational methods to investigate memory for non-linguistic auditory sequences. Participants (...) repeatedly heard tone sequences varying systematically in their information-theoretic properties. Expectedness ratings of tones were collected during three listening sessions, and a recognition memory test was given after each session. Information-theoretic measures of sequential predictability significantly influenced listeners’ expectedness ratings, and variations in these properties had a significant impact on memory performance. Predictable sequences yielded increasingly better memory performance with increasing exposure. Computational simulations using a probabilistic model of auditory expectation suggest that listeners dynamically formed a new, and increasingly accurate, implicit cognitive model of the information-theoretic structure of the sequences throughout the experimental session. (shrink)

As with any sensory input, music might be expected to incorporate the processing of information about the safety of the environment. Little research has been done on how such processing has evolved and how different kinds of sounds may affect the experience of certain environments. In this article, we investigate if music, as a form of auditory information, can trigger the experience of safety. We hypothesized that there should be an optimal, subjectively preferred degree of information density of (...) musical sounds, at which safety-related information can be processed optimally; any deviation from the optimum, that is, both higher and lower levels of information density, should elicit experiences of higher stress and danger; and in general, sonic scenarios with music should reduce experiences of stress and danger more than other scenarios. In Experiment 1, the information density of short music-like rhythmic stimuli was manipulated via their tempo. In an initial session, listeners adjusted the tempo of the stimuli to what they deemed an appropriate tempo. In an ensuing session, the same listeners judged their experienced stress and danger in response to the same stimuli, as well as stimuli exhibiting tempo variants. Results are consistent with the existence of an optimum information density for a given rhythm; the preferred tempo decreased for increasingly complex rhythms. The hypothesis that any deviation from the optimum would lead to experiences of higher stress and danger was only partly fit by the data. In Experiment 2, listeners should indicate their experience of stress and danger in response to different sonic scenarios: music, natural sounds, and silence. As expected, the music scenarios were associated with lowest stress and danger whereas both natural sounds and silence resulted in higher stress and danger. Overall, the results largely fit the hypothesis that music seemingly carries safety-related information about the environment. (shrink)

Language-related potentials are increasingly used to objectify adaptive neuroplasticity in stroke-related aphasia recovery. Using preattentive [mismatch negativity ] and attentive phonologically related paradigms, neuroplasticity in sensory memory and cognitive functioning underlying phonological processing can be investigated. In aphasic patients, MMN amplitudes are generally reduced for speech sounds with a topographic source distribution in the right hemisphere. For P300 amplitudes and latencies, both normal and abnormal results have been reported. The current study investigates the preattentive and attentive phonological discrimination ability (...) in 17 aphasic patients at two timepoints during aphasia recovery. Between the two timepoints, a significant improvement of behavioral language performance in both languages is observed in all patients with the MMN latency at timepoint 1 as a predictive factor for aphasia recovery. In contrast to monolinguals, bilingual aphasic patients have a higher probability to improve their processing speed during rehabilitation, resulting in a shortening of the MMN latency over time, which sometimes progresses toward the normative values. (shrink)

Performance and control of upright bipedal posture requires a constant and dynamic integration of relative contributions of different sensory inputs (i. e., sensory reweighting) to enable effective adaptations as individuals face environmental changes and perturbations. Children with gymnastic experience showed balance performance closer to that of adults during and after proprioceptive alteration than children without gymnastic experience when their center of pressure (COP) was analyzed. However, a particular COP sway can be achieved through performing and coordinating different postural (...) movements. The aim of this study was to assess how children and adults of different gymnastic experience perform and control postural movements while they have to adjust balance during and after bilateral tendon vibration. All participants were equipped with spherical markers attached to their skin and two vibrators strapped over the Achilles tendons. Bipedal stance was performed in three 45-s trials in two visual conditions (eyes open, EO, and eyes closed, EC) ordered randomly in which vibration lasted 10 s. Posture movements were analyzed by a principal component analysis (PCA) calculated on normalized and weighted markers coordinates. The relative standard deviation of each principal movement component (principal position, PP-rSTD) quantified its contribution to the whole postural movements, i.e., quantified the coordinative structure. The first (principal velocities, PV-rSTD) and second (principal accelerations, PA-rSTD) time-derivatives characterized the rate-dependent sensory information associated with and the neuromuscular control of the postural movements, respectively. Children without gymnastic experience showed a different postural coordinative structure and different sensory-motor control characteristics. They used less ankle movements in the anterior-posterior direction but increased ankle movements in medio-lateral direction, presented larger hip and trunk velocities, and exhibited more hip actions. Gymnastic experience during childhood seemed to benefit the development of proprioceptive reweighting processes in children, leading to a more mature form of coordinating and controlling posture similarly to adults. (shrink)

The paper develops an account of minimal traces devoid of representational content and exploits an analogy to a predictive processing framework of perception. As perception can be regarded as a prediction of the present on the basis of sparse sensory inputs without any representational content, episodic memory can be conceived of as a “prediction of the past” on the basis of a minimal trace, i.e., an informationally sparse, merely causal link to a previous experience. The resulting notion of episodic (...) memory will be validated as a natural kind distinct from imagination. This trace minimalist view contrasts with two theory camps dominating the philosophical debate on memory. On one side, we face versions of the Causal Theory that hold on to the idea that episodic remembering requires a memory trace that causally links the event of remembering to the event of experience and carries over representational content from the content of experience to the content of remembering. The Causal Theory, however, fails to account for the epistemic generativity of episodic memory and is psychologically and information-theoretically implausible. On the other side, a new camp of simulationists is currently forming up. Motivated by empirical and conceptual deficits of the Causal Theory, they reject not only the necessity of preserving representational content, but also the necessity of a causal link between experience and memory. They argue that remembering is nothing but a peculiar form of imagination, peculiar only in that it has been reliably produced and is directed towards an episode of one’s personal past. Albeit sharing their criticism of the Causal Theory and, in particular, rejecting its demand for an intermediary carrier of representational content, the paper argues that a causal connection to experience is still necessary to fulfill even the minimal requirements of past-directedness and reliability. (shrink)

Much discussed but still unresolved is whether a subject's internal physical structure is a sufficient condition for his beliefs and desires. The question has sometimes been expressed as a question about microstructurally identical Doppelgänger. Imagine two subjects who are identical right down to the ions traversing the synapses. Their senses are stimulated in all the same ways, their bodies execute the same motions, and identical physical events mediate between the sensory inputs and the behavioral outputs. Must they have the (...) very same beliefs and desires? Let us call the thesis that they must, internalism. The internalist may hold that a physical similarity less complete than this will also guarantee identity in beliefs and desires, but certainly, he holds, perfect identity of internal physical histories will suffice.Internalism will be opposed by those who sense that the nature of mentality is closely tied to the nature of explanation in terms of mental states and that in explaining a subject's behavior we cannot abstract, even in principle, from the character of the environment in which the subject is embedded. This essay offers a partial articulation of this point of view and shows how it conflicts with internalism. A consequence of the view to be described is that our attributions of belief must reflect the probabilistic regularities in the subject's environment. As we shall see, this consequence conflicts with internalism in two ways. The first conflict turns on the fact that there is no limit on the possible variety of such regularities. The second conflict turns on the fact that two subjects might by chance have the same micro-structural history though different probabilistic regularities obtain in their respective environments. (shrink)

Nineteenth-century investigations of the deep sea provide a case study for black box science. Naturalists were forced to theorize about a space for which they had no direct sensory observations. This study traces the emergence of bathymetry and deep-sea biology and then analyzes how men of science dealt with the uncertainty associated with their black box practices. I argue that these investigators created multiple types of black boxes based on their uncertainties and that these black boxes did not operate (...) equivalently. Consequently, scholars should be aware of the different categories of black boxes when they describe scientific practices. (shrink)

What is Functionalism? Functionalism is one of the major proposals that have been offered as solutions to the mind/body problem. Solutions to the mind/body problem usually try to answer questions such as: What is the ultimate nature of the mental? At the most general level, what makes a mental state mental? Or more specifically, What do thoughts have in common in virtue of which they are thoughts? That is, what makes a thought a thought? What makes a pain a pain? (...) Cartesian Dualism said the ultimate nature of the mental was to be found in a special mental substance. Behaviorism identified mental states with behavioral dispositions; physicalism in its most influential version identifies mental states with brain states. Functionalism says that mental states are constituted by their causal relations to one another and to sensory inputs and behavioral outputs. Functionalism is one of the major theoretical developments of Twentieth Century analytic philosophy, and provides the conceptual underpinnings of much work in cognitive science. (shrink)

When the stored representation of the meaning of a stimulus is accessed through the processing of a sensory input it is maintained in an activated state for a certain amount of time that allows for further processing. This semantic activation is generally accompanied by conscious identification, which can be demonstrated by the ability of a person to perform discriminations on the basis of the meaning of the stimulus. The idea that a sensory input can give rise (...) to semantic activation without concomitant conscious identification was the central thesis of the controversial research in subliminal perception. Recently, new claims for the existence of such phenomena have arisen from studies in dichotic listening, parafoveal vision, and visual pattern masking. Because of the fundamental role played by these types of experiments in cognitive psychology, the new assertions have raised widespread interest. (shrink)