This collection of new essays on sensory individuals in unimodal and multimodal perception features contributions by outstanding researchers in the fields of philosophy of perception, experimental psychology, and cognitive neuroscience. The topics investigated include conceptual, developmental, and methodological aspects of object perception, and especially how various sense modalities construct their objects from sensory features and feature bearers. The interdisciplinary approach offered has enabled new directions in research on this subject. As ordered in this volume, (...) the topics of the contributions progress from treating neural sensory processes as primarily unisensory towards approaches that take perceptual processing to be modality-independent, meta-modal, and multimodal. Even within these latter approaches, sensory stimuli, sensory properties, brain activations, and corresponding perceptual phenomenology have often been characterized in a modality-specific way. Thus, it is timely to explore the relation between those processes that are unisensory and those that are multisensory. One of the primary themes of this collection is examining whether the basic building blocks of human perception are best understood as modality-dependent units of different forms or in terms of multimodal perceptual objects. Another theme is the relation between low-level object processing (segmentation and perceptual grouping processes) and high-level object knowledge embracing object concept and object-related expectations. A final theme is the role that perceptual objects play as loci of unification in unimodal and multimodal perception, namely that they enable binding and integration of sensory properties to individual entities or events. (shrink)

Sensory Individuals: Unimodal and Multimodal Perspectives provides an interdisciplinary, well-balanced, and comprehensive look at different aspects of unisensory and multisensory objects, using both nuanced philosophical analysis and informed empirical work. The research presented in this book represents the field's progression from treating neural sensory processes as primarily modality-specific towards its current state of the art, according to which perception, and its supporting neural processes, are multi-modal, modality-independent, meta-modal, and task-dependent. Even within such approaches sensory (...) stimuli, properties, brain activations, and corresponding perceptual phenomenology can still be characterized in a modality-specific way. The book examines the basic building blocks of human perception, and whether they are best understood as sense modality dependent units of different forms or multimodal perceptual objects. The book combines a variety of innovative and integrative angles to explore the topic and acts as a catalyst for an increasingly diverse field of research, which is in an exciting phase of growth and advancement. New questions are arising as quickly as they are being answered, and the collection Sensory Individuals provides an original and up-to-date addition to the field. (shrink)

Higher animals need to identify and track material objects because they depend on interactions with them for nutrition, reproduction, and social interaction. This paper investigates the perception of material objects. It argues, first, that material objects are tagged, in all five external senses, as bearers of the features detected by them. This happens through a perceptual process, here entitled Generalized Completion, which creates the appearance of objects that have properties that transcend the activation of sensory receptors. The paper (...) shows, secondly, that material objects are privileged subjects for perceived motion and interaction. That is, they are perceived as subjects for these properties while their parts seem to be subjects only derivatively. Material objects are the only perceptual subjects that are both multisensory and privileged. (shrink)

Higher animals need to identify and track material objects because they depend on interactions with them for nutrition, reproduction, and social interaction. This paper investigates the perception of material objects. It argues, first, that material objects are tagged, in all five external senses, as bearers of the features detected by them. This happens through a perceptual process, here entitled Generalized Completion, which creates the appearance of objects that have properties that transcend the activation of sensory receptors. The paper (...) shows, secondly, that material objects are privileged subjects for perceived motion and interaction. That is, they are perceived as subjects for these properties while their parts seem to be subjects only derivatively. Material objects are the only perceptual subjects that are both multisensory and privileged. (shrink)

This chapter examines how our sense modalities interact in the perception of persistence. The chapter concentrates on two questions. The first concerns perceptual processing—do perceptual computations of object persistence ever integrate and compute over representations from more than one modality? It argues that this question should be answered affirmatively. The second question concerns perceptual experience—do experiences of object persistence ever exhibit a constitutively multisensory phenomenal character, or is the phenomenology of object persistence (...) always uniquely associated with just one modality? The chapter argues that the available evidence underdetermines the answer to this question, but suggests ways it might be empirically resolved. (shrink)

The capacity for feature binding is typically explained in terms of the attribution model: a perceptual state selects an individual and attributes properties to it (Kahneman & Treisman 1984; Clark 2004; Burge 2010). Thus features are bound together in virtue of being attributed to the same individual. While the attribution model successfully explains some cases of binding in perception, not all binding need be understood as property attribution. This chapter argues that some forms of binding—those (...) involving holistic iconic representations, which bind features outside the limits of attention and object files—don’t fit the attribution model. The chapter then sketches an alternative coordination model of binding that construes icons as complex analog representations. (shrink)

Chapter 1 First Person Access to Mental States. Mind Science and Subjective Qualities -/- Abstract. The philosophy of mind as we know it today starts with Ryle. What defines and at the same time differentiates it from the previous tradition of study on mind is the persuasion that any rigorous approach to mental phenomena must conform to the criteria of scientificity applied by the natural sciences, i.e. its investigations and results must be intersubjectively and publicly controllable. In Ryle’s view, philosophy (...) of mind needs to adopt an antimentalist stance to achieve this aim. Antimentalism not only definitively rejects the idea that mind is a substance separated from the body, it also denies that mental phenomena radically differ from physical phenomena by virtue of several unique features. Most problematically, mental phenomena have a conscious character (mental states are related to specific qualitative feelings) and are accessible only to the first-person (only the subject knows directly what s/he is experiencing inside his/her mind). Ryle takes a strong stance on antimentalism going so far as to maintain that an approach to mind which aims to meet the criteria of scientificity set by the natural sciences must avoid any reference to internal, unobservable mental states. In his view (which is considered a specifically philosophical version of psychological behaviorism and also addresses questions put forward in psychological research), mental states can be redescribed in terms of behavioral dispositions. In this chapter, we address the historical roots of the antimentalist view and analyze its relation to the later tradition of research on mind. We show that, compared to the antimentalist stance, functionalism and cognitivism take a step back when they maintain that direct reference to mental states is necessary since mental states cause and therefore explain human behavior. This step backwards is often interpreted as a return to mentalism. However, this is only partially true. Indeed, we suggest that these later traditions retain one important element of Ryle’s antimentalism, i.e. the idea that mental states must be uniquely identified using external and publicly observable criteria, while excluding any reference to introspection and those qualitative dimensions of a mental state, which are accessible only to the first-person. According to the perspective we put forward, this epistemological stance has continued to influence contemporary research on mind and current philosophical and psychological theories which both tend to exclude the subjective qualities of human experience from their accounts of how the mind works. The issue we raise here is whether this is legitimate or whether subjective qualities do play a role with respect to the way our mind works. The conclusion of this chapter anticipates the argument the book makes in in favor of this latter position, starting from a particular angle, i.e. the problem of how we categorize concepts related to our internal states. -/- Chapter 2 The Misleading Aspects of the Mind/Computer Analogy. The Grounding Problem and the Thorny Issue of Propriosensitive Information -/- Abstract. After the crisis of behaviorism, cognitivism and functionalism became the predominant models in the field of psychology and of philosophy, respectively. Their success is mainly due to the new key they use for interpreting mental processes: the mind/computer analogy. On the basis of this analogy, mental operations are seen as cognitive processes based on computations, i.e. on manipulations of abstract symbols which are in turn understood as informational unities (representations). This chapter identifies two main problems with this model. The first is how these symbols can relate to and communicate with perception and thus allow us to identify and classify what we perceive through the senses. Here we limit ourselves to presenting this issue in relation to the classical symbol grounding problem originally put forward by Harnad on the basis of Searle’s Chinese room argument. An attempt to address the problem raised here will be made in chap. 3. The second point we discuss in relation to the mind/computer analogy concerns the idea of information it fosters. Indeed, following this analogy, information is something available in the external world which can be captured by the senses and transmitted to the central system without being influenced or modified by the procedures of transmission. This perspective does not take into account that – unlike computers – in living beings information is acquired by means of the body. As Ulric Neisser has already pointed out, the body is itself an informational source that provides us with additional sensory experience that influences (modifies or complements) the information extracted from the external world by the senses. To develop this line of analysis and to determine exactly what information is provided by the body and how this might influence cognition, we examine Sherrington’s and Gibson’s positions. Moving on from their views, we qualify bodily information in terms of ‘proprioception’. We use ‘proprioception’ in a broad sense to describe any kind of experience we have of our internal states (including postural information as well as sensations related to the general state of the body and its parts). Following Damasio’s and Craig’s studies, we further elaborate this position, arguing that living beings are equipped with an internal propriosensitive monitoring system which maps all the changes that constantly occur in our body and that give us perceptual (‘proprioceptive’ or propriosensitive) information about what happens inside us. Moreover, relying on Goldie’s and Ratcliffe’s view, we show that emotional information can also be considered as a form of ‘proprioception’ which contributes to determining everything we perceive. This analysis leads us to the second main thesis of this book: ‘proprioception’ is a form of internal perception and it is an essential component of the sensory information we can access and use for all cognitive purposes. -/- Chapter 3 Semantic Competence from the Inside: Conceptual Architecture and Composition -/- Abstract. Concepts are essential constituents of thought: they are the instruments we use to categorize our experience, i.e. to classify things and group them together in homogeneous sets. Here we define concepts as the internal mental information (representations) that allows us, among other things, to master words in natural language. By analyzing the way in which individuals master word meanings we explore a number of hypotheses regarding the nature of concepts. Following Diego Marconi’s research, we differentiate between two kind of abilities that underpin lexical competence – so-called ‘referential’ and ‘inferential competence’ – and we suggest that, in order to support these abilities, concepts must also include two corresponding kinds of information, i.e. inferential and referential information. We point out that the most widely used and acknowledged theories of concepts do not make this distinction, instead broadly characterizing the information used for categorization in terms of propositionally described feature lists. However, we show that while feature lists can explain inferential competence, they do not account for referential competence. To address the issue of referential competence we examine Ray Jackendoff’s hypothesis that to account for the possibility of linking perceptual and conceptual information we need to assume the existence of a (visual) representation that encodes the geometric and topological properties of objects and bridges the gap between the percept and the concept. Furthermore, we analyze the extension of this work by Jesse Prinz who introduced the notion of a proxytype, a perceptual representation of a class of objects that incorporates structural and parametric information related to their appearance. However, as we point out, proxytypes can only explain the relationship between perception and concepts with respect to instances that can be perceived through the senses and that belong to the same class by virtue of their physical similarity. We suggest that this notion be extended to include larger conceptual classes. To accomplish this, we further develop Mark Johnson, George Lakoff and Jean Mandler’s idea of a schematic image and argue that conceptual representations include a perceptual schema. Perceptual schemata are non-linguistic, structured experiential gestalts (patterns or maps) that make use of information taken from all sensory modalities, including body perception. They accomplish a quasi-conceptual function: they allow us to recognize and to classify different instances. In this work, we hypothesize that perceptual schemata are an essential component of concepts, but not identical to them. Instead, we suggest that concepts include both perceptual and propositional information with perceptual schemata providing the ‘perceptual core concept’ that grounds related propositional information. -/- Chapter 4 In the Beginning There Were Categories. The Bodily Origin of Prelinguistic Categorical Organization: The Example of Folkbiological Taxonomies -/- Abstract. Studies of categorization in psychology and the cognitive sciences have made use of the notions of ‘category’ and ‘concept’ without precisely defining what is meant by either; in fact, often these terms have been used as synonyms, making it difficult to address specific issues related to conceptual development. This chapter begins by discussing the definitions of, as well as the distinctions between, ‘categories’ and ‘concepts’ in the classical philosophical tradition (Aristotle, Kant and Husserl). We introduce our view of categories with reference to Husserl. Categorization is defined as the way in which our experience is originally (pre-linguistically) organized in a passive and fully unconscious manner on the basis of universal structuring principles. Conceptualization is explained as a later process in which the earlier categorical macro-classes are further subdivided into more specific and detailed sets; this later process also relies on linguistic learning and exposure to culture. On the basis of Ray Jackendoff, Jean Mandler, George Lakoff and Mark Johnson’s work, we hypothesize that categorization is a two-step process that begins with the formation of homogeneous sets of entities partitioned into regions that describe the ontological boundaries of the objects that humans perceive (categories) and continues at a later stage with the development of more specific classifications (concepts). In this chapter, we mainly address three related issues: Why should we assume that there is categorical organization which precedes the development of a conceptual system? How do categories and concepts relate to each other? Shall we hypothesize that categories are innate or that they are formed before concepts on the basis of information and organizational structure available at a very early developmental stage? We show that categorical partitions are necessary for categorization and, following Mandler, that the general categories we form at an early age do not match our adult superordinate concepts. As for the third issue, we argue that there might be no need to assume that categories are innately present in the human mind, since their formation can be explained – at least in certain cases – by basic mechanisms that work on body (propriosensitive) information. This hypothesis will not be discussed in general, but in relation to a particularly relevant example of categorical partition, i.e. the folk-biological dichotomy between ANIMATE/INANIMATE. This is compared with other dichotomies that derive from it, but are not directly categorical such as LIVING/NON-LIVING and BIOLOGICAL/NON-BIOLOGICAL. -/- Chapter 5 Internal States: From Headache to Anger. Conceptualization and Semantic Mastery -/- Abstract. Here we ask if we can also apply the distinction between referential and inferential competence we introduced in Chapter 3 to words that do not refer to things that are perceived using the external senses, especially to words/concepts that denote bodily experiences (such as pain, thirst, hunger, etc.) or emotions. We introduce and discuss the hypothesis that – even though such words/concepts do not refer to intersubjectively identifiable entities in the external world – they do have a kind of referent that can be accessed via direct perception, more specifically ‘proprioception’, as we have defined it in terms of all propriosensitive information we can consciously access. In the first part of the chapter, we specifically consider terms denoting bodily experiences such as ‘pain’ or ‘hunger’ and argue that their referents are identified and classified from a first-personal point of view on the basis of four main characteristics: their specific intensity, their localization in the body, their co-occurrence with other signals and above all their specific qualitative sensations. Emotions are addressed in the second part of the chapter. We suggest that there is a continuity between bodily experiences and emotions. In particular, we argue for a perceptual theory of emotions in line with that proposed by James and Lange at the end of the 19th century and developed more recently by authors such as Damasio (see also chap. 2§5, §6). The hypothesis we put forward is that the referential information that supports the categorization of emotions and therefore also our mastery of terms referring to emotions consists in the perception (i.e. the ‘proprioception’) of those bodily states and changes in bodily states which constitute our emotional experience. In the context of this discussion we examine some objections to this line of reasoning that arise from a cognitivist perspective and following authors such as Oatley, Johnson-Laird and Frijda, we distinguish between basic emotions that can be identified and classified solely on the basis on how they feel and complex emotions whose identification and classification additionally depends on cognitive factors. To describe how emotions are identified and classified on the basis of how they feel, we rely on Marcel and Lambie’s distinction between an ‘emotion state’ and an ‘emotion experience’. Both notions indicate kinds of feelings that we consciously experience. However, they describe first-order and second order emotion awareness respectively. The emotion state is the feeling we have of the bodily states and changes that occur when we are experiencing an emotion, while the emotion experience is the fully developed and integrated emotion we both experience and are, with reflection, aware of experiencing. On the basis of this differentiation, we also show that the same characteristics that aid in the identification and classification of bodily experiences (specific qualitative sensations; somatic localization; specific intensity; presence/absence of specific concomitant sensations) can also be used for the identification and classification of emotions – at least basic emotions. In the last two sections of the chapter we present some clinical evidence on the semantic competence of people who suffer from Alexithymia and Autism Spectrum Disorder which supports the conclusions of our preceding analyses. -/- Chapter 6 The ‘Proprioceptive’ Component of Abstract Concepts -/- Abstract. In this chapter, we address the issue of whether the mastery of abstract words requires only inferential knowledge and thus, if the concepts that support the mastery of abstract words include only linguistic information. We start by differentiating the notions of ‘abstract’ and ‘general’ which are often erroneously confused. We then identify a strict definition of abstract, as contrasted with ‘concrete’, that applies to words or concepts whose referent cannot be experienced by the senses. We argue that abstract words/concepts would be better described as theoretical, because they are usually conceived as structured sets of inferential knowledge expressed linguistically; that is, as small theories. Pointing out parallels with Carnap’s analysis of this issue in philosophy of science, we hypothesize that words/concepts denoting non-observable entities are not all ‘equally theoretical’, because their link to sensory experience can be stronger or weaker. We revive the distinction, inspired by Quine, between theoretical and intertheoretical concepts/words. This distinction relies on the fact that the former – unlike the latter – retains a strong, although indirect, connection with perception. In Quine’s discussion, perception is understood uniquely in terms of observability, i.e. of external sensory experience. Here we argue, however, that bodily, ‘proprioceptive’ (i.e. propriosensitive) experience can also serve to referentially ground theoretical (i.e. abstract) concepts/words. We frame this issue using the example of the theoretical concept ‘freedom’ and Lakoff’s hypothesis that this concept is developed on the basis of bodily information. We contrast this with the example of ‘democracy’ which more closely resembles an intertheoretical concept/word. Furthermore, we show that one of the classical views put forward in psycholinguistic research to explain how abstract concepts are mentally represented – i.e. Paivio’s Dual Coding Theory – points in the same direction as our analysis. The same is true of Barsalou’s work suggesting that we use internal information to understand at least some abstract words. To sustain this position, we put forward two lines of evidence: the first comes from psycholinguistic studies while the second examines deficits of semantic competence exhibited by people with Autism Spectrum Disorder. On the basis of our analysis, we put forward a classification that distinguishes between different kinds of concreteness and different degrees of abstraction: concepts/words referring to body experiences and basic emotions are described as analogous to concrete concepts/words because they are grounded in perceptual (i.e. propriosensitive) experience, while abstract concepts/words are considered more or less abstract depending on whether they are intratheoretical (and rely entirely on inferential information) or theoretical (and are partially grounded in perceptual – or more often in propriosensitive perceptual – information). In the last section of the chapter we consider two scales that have been used in psycholinguistic research to measure the degree of concreteness vs. abstractness of words and we show that – used conjointly – they can provide a measure of the internal vs. external grounding of specific words. (shrink)

Sense interaction is ubiquitous. All conscious experiences involve at least some interaction between the senses. One of the most debated questions in recent scholarship concerns the proper way of characterizing the phenomenology of multisensory experiences. According to Charles Spence and Tim Bayne (2015), the phenomenal character of multisensory integration is reducible to the co-conscious sum of modality-specific features. Following Casey O'Callaghan (2015), we can call this The Thesis of Minimal Multimodality. The main goal of the paper is (...) to refute the thesis and show that the effect of multisensory integration is reflected in experience in a way that is not exhausted by (the sum of) modality-specific phenomenal features. Whereas O'Callaghan's strategy in trying to prove this consists in providing phenomenological evidence that runs contrary to what Spence and Bayne hold, he does not, however, put into question what has become since T. Nagel's famous essay (1974) the standard conception of the phenomenal. By drawing conceptual resources in the work of Husserl and Merleau-Ponty, I will elaborate another approach and explain why the phenomenal character of experience cannot be reduced to its "what it's like" character. Phenomenal experience is thicker, and also includes various forms of bodily self-experiences and felt possibilities of action and behaviours. Building on these and like insights, the main objective of the paper is to outline a phenomenological account of multimodal perception and sensory interaction. I will draw three main conclusions. First, I will argue that both Husserl and Merleau-Ponty would, too, reject The Thesis of Minimal Multimodality and endorse the strong, Constitutive Thesis that O'Callaghan defends. More interestingly still, we will see, secondly, that the widening of phenomenal consciousness that they argue for allows to generalize the constitutive thesis, thereby showing that all perceptual experience constitutively depend on the interplay of two or more senses. Spelling out the details of this claim will bring me, thirdly, to specify the intrinsic relation between normativity and perceptual experience. In short, I will argue that the mechanisms responsible for multimodality make a phenomenological difference evaluable in normative terms. (shrink)

The Bayesian model of multisensory cue integration proposed by Ernst and Banks provides an attractive model for understanding a way that our sensory systems may interact. Moreover, it has been suggested that the process of multisensory integration that it models underpins conscious experiences with multisensory representational contents merged across modalities. Should we therefore take empirical support for the Bayesian model as evidence of the multimodality of perception? Focusing on evidence of integration across vision and touch, I (...) argue that apparent support for the model does not warrant the rejection of the view that each of our conscious perceptual experiences is associated with one and only one sense modality. (shrink)

Object perception deploys a suite of perceptual capacities that constrains attention, guides reidentification, subserves recognition, and anchors demonstrative thought. Objects for perception—perceptual objects—are the targets of such capacities. Characterizing perceptual objects for multisensory perception faces two puzzles. First is the diversity of objects across sensory modalities. Second is the unity of multisensory perceptual objects. This paper resolves the puzzles. Objects for perception are structured mereologically complex individuals. Perceptual objects are items that (...) bear perceptible features and have perceptible parts arranged to form a unified whole. This circumscribes the targets of object perception where neutral talk concerning intentional objects and objects of perception cannot. Nonetheless, it is more permissive than identifying perceptual objects with material bodies, which excludes too much and leans too heavily on vision. The account thus is tailored to capture the role of objects in perception beyond vision: tactual, auditory, and olfactory objects are individuals with differing structures. Its flexibility also enables the account to accommodate shared objects for multisensory perception: multisensory perceptual objects are mereologically complex individuals with hybrid structure. For instance, one can bimodally perceive a common whole with parts accessible to one but not both modalities. Each sense provides a partial perspective on a complex whole that is perceptible through the coordinated use of multiple senses. Understanding perceptual objects as structured mereologically complex individuals thus provides a theoretically useful notion of an object for multisensory perception that resolves the puzzles of diversity and of unity. (shrink)

This paper concerns epistemic developments in the field of sensory perception. I argue that Uexküll’s concept of the Umwelträume and certain principles of multisensory integration explain and describe in similar terms the manner in which different sensory modalities interact. Indeed, they both concern knowledge, describing in spatial terms how the mind makes itself up, makes up its objects, and how the objects, in turn, make up the mind. My intention is to set side by side these two (...) trends of thought in order to mutually explain them. I suggest that there is some sort of dialectic at work between the Umwelträume and multisensory integration: in the first case interaction between the senses results in the creation of high definition subjects, whereas in the latter the interaction of the senses results in high definition objects. (shrink)

The integration of multisensory information is an essential mechanism in perception and action control. Research in multisensory integration is concerned with how the information from the different sensory modalities, such as the senses of vision, hearing, smell, taste, touch, and proprioception, are integrated to a coherent representation of objects (for an overview, see e.g., Calvert, Spence and Stein, 2004). The combination of information from the different senses is central for action control. For instance, when you grasp for (...) a rubber duck, you can see its size, feel its compliance and hear the sound it produces. Moreover, identical physical properties of an object can be provided by different senses. You can both see and feel the size of the rubber duck. Even when you grasp for the rubber duck with a tool (e.g., with tongs), the information from the proximal hand, from the effective part of the distal tool and from the eyes are integrated in a manner to act successfully (for limitations of this integration see Sutter et al., 2013).Over the recent decade a surge of interest in multisensory integration and action control has been witnessed, especially in connection with the idea of a statistically optimized integration of multiple sensory sources. The human information processing system is assumed to adjust moment-by-moment the relative contribution of each sense’s estimate to a multisensory task. The sense’s contribution depends on its variance, so that the total varia... (shrink)

This is the editors' Introduction to a special issue of the journal, Multisensory Research. European philosophers of the modern period found multisensory perception to be impossible because they thought that perceptual ideas are defined by how they are experienced. Under this conception, the individual modalities are determinables of ideas—just as colour is a determinable that embraces red and blue, so also the visual is a determinable that embraces colour and (visually experienced) shape. Since no idea is experienced (...) as, for example, both visual and auditory, there can be no such thing as audiovisual perception. This conception of modality is not directly contested, but a variety of perceptual phenomena are listed that could raise interesting questions if treated as multimodal in origin. (shrink)

Multisensory processing encompasses all of the various ways in which the presence of information in one sensory modality can adaptively influence the processing of information in a different modality. In Part I of this survey article, I begin by presenting a cartography of some of the more extensively investigated forms of multisensory processing, with a special focus on two distinct types of multisensory integration. I briefly discuss the conditions under which these different forms of multisensory (...) processing occur as well as their important perceptual consequences and interrelations. In Part II, I then turn to examining of some of the different possible ways in which the structure of conscious perceptual experience might also be characterized as multisensory. In addition, I discuss the significance of research on multisensory processing and multisensory consciousness for philosophical attempts to individuate the senses. (shrink)

It is tempting to hold that perceptual experience amounts to a co-conscious collection of visual, auditory, tactual, gustatory, and olfactory episodes. If so, each aspect of perceptual experience on each occasion is associated with a specific modality. This paper, however, concerns a core variety of multimodal perceptual experience. It argues that there is perceptually apparent intermodal feature binding. I present the case for this claim, explain its consequences for theorizing about perceptual experience, and defend (...) it against objections. I maintain that just as one thing may perceptually appear at once to jointly bear several features associated with the same sense modality, one thing also may perceptually appear at once to jointly bear features associated with different sense modalities. For instance, just as something may visually appear at once to be both red and round, or to have a red part and a green part, something may multimodally perceptually appear at once to be both bright and loud, or to have a red part and a rough part. The main lesson, I argue, is that perceiving is not just co-consciously seeing, hearing, feeling, tasting, and smelling at the same time. And perceptual phenomenal character is not on each occasion exhausted by that which is distinctive to or associated with a given modality, along with that which accrues thanks to simple co-consciousness. Not all ways of perceiving are modality specific. I defend this account against three main objections: that singular content theorists avoid my conclusions; that apparent infusion of perceptible features is required for perceptually apparent binding but does not occur intermodally; and that the diversity of objects across modalities makes perceptually apparent intermodal binding rare. (shrink)

When I am looking at an apple, I perceptually attribute certain properties to certain entities. Two questions arise: what are these entities (what is it that I perceptually represent as having properties) and what are these properties (what properties I perceive this entity as having)? This paper is about the former, less widely explored, question: what does our perceptual system attribute properties to? In other words, what are these ‘sensory individuals’. There have been important debates in philosophy of (...) perception about what sensory individuals would be the most plausible candidates for which sense modalities. The aim of this paper is to ask a related question about picture perception: what is the sensory individual of picture perception? When we look at a picture and see an apple depicted in it, what kind of entity do we see? What do we perceptually attribute properties to? I argue that the most straightforward candidates (ordinary objects, sui generis sensory individuals, no sensory individuals) are all problematic and that the most plausible candidate for the sensory individuals of picture perception are spatiotemporal regions. (shrink)

This chapter distinguishes between two kinds of ordinary multisensory experience that go beyond mere co-consciousness of features (e.g., the experience that results from concurrently hearing a sound in the hallway and seeing the cup on the table). In one case, a sensory experience in one modality creates a perceptual demonstrative to whose referent qualities are attributed in another sensory modality. For example, when you hear someone speak, auditory experience attributes audible qualities to a seen event, a (...) person’s speaking motions. The second kind of multisensory experience attributes features experienced in several sensory modalities to one and the same object via a process of amodal perceptual integration, i.e., integration that occurs separately from processing within the individual sensory modalities. Multisensory experiences arising from holding and seeing a tomato or from seeing the Indian curry boil and smelling it are examples of the second kind of multisensory experience. At the end of the chapter we look at synesthesia, a kind of atypical multisensory experience, and argue that one version of this phenomenon may be able to shed light on the neural mechanism underlying amodally integrated multisensory experience. (shrink)

What are the sensory individuals of audition? What are the entities our auditory system attributes properties to? We examine various proposals about the nature of the sensory individuals of audition, and show that while each can account for some aspects of auditory perception, each also faces certain difficulties. We then put forward a new conception of sensory individuals according to which auditory sensory individuals are composite individuals. A feature shared by all existing accounts of sounds and (...) sources is that they postulate sensory individuals that are non-composite. They identify the sensory individual of sound hearing or source hearing with one type of entity in the environment, be they sound waves, vibrations, or interactions. We question this assumption and argue that our perceptual systems represent two or more aspects of the environment as a single sensory individual. Finally, we show that taking auditory individuals to be composite sensory individuals allows for an account of audition that is less problematic than its existing alternatives. (shrink)

In crossmodal identification, a subject token identifies an item perceived in one sensory modality with an item perceived in another sensory modality. Does crossmodal identification always occur in cognition, or does crossmodal identification sometimes take place in perception? This paper argues that crossmodal identification occurs in cognition, and not in perception. Nevertheless, multisensory perception is not unalive to crossmodal identity. Experimental evidence demonstrates that perception is differentially sensitive to the identity of individuals presented to distinct senses. Such (...) sensitivity enhances recognition and improves action. This approach relies on distinguishing crossmodal identification from perceiving crossmodal identity. Perception registers crossmodal identity, but crossmodal identification as such belongs to thought. (shrink)

Perception is the ultimate source of our knowledge about contingent facts. It is an extremely important philosophical development that starting in the last quarter of the twentieth century, philosophers have begun to change how they think of perception. The traditional view of perception focussed on sensory receptors; it has become clear, however, that perceptual systems radically transform the output of these receptors, yielding content concerning objects and events in the external world. Adequate understanding of this process requires that (...) we think of perception in new ways—how it operates, the differences among the modalities, and integration of content provided by the individual senses. Philosophers have developed new analytic tools, and opened themselves up to new ways of thinking about the relationship of perception to knowledge. The Oxford Handbook of the Philosophy of Perception is a collection of entries by leading researchers that reviews these new directions in philosophical thought. The Introduction to the Handbook reviews the history of the subject from its beginnings in ancient Greece to the nineteenth century, and the way that science and philosophy have together produced new conceptions during the last hundred years. It shows how the new thinking about perception has led to a complex web of theories. (shrink)

Perception has been for philosophers in the last few decades an area of compelling interest and intense investigation. Developments in contemporary cognitive science and neuroscience has thrown up new information about the brain and new conceptions of how sensory information is processed and used. These new conceptions offer philosophers opportunities for reconceptualising the senses--what they tell us, how we use them, and the nature of the knowledge they give us. Today, the philosophy of perception resonates with ideas that had (...) not even been articulated in the 1970s and 1980s. This Handbook is a survey by leading philosophical thinkers of contemporary issues and new thinking in philosophy of perception. It includes sections on the history of the subject, introductions to contemporary issues in the epistemology, ontology and aesthetics of perception, treatments of the individual sense modalities and of the things we perceive by means of them, and a consideration of how perceptual information is integrated and consolidated. New analytic tools and applications to other areas of philosophy are discussed in depth. Each of the entries is written by a leading expert, some collaborating with younger figures; each seeks to introduce the reader to a broad range of issues. All contain new ideas on the topics covered; together they demonstrate the vigour and innovative zeal of a young field. (shrink)

This article proposes an object properties approach to object perception. By thinking about objects as clusters of co-instantiated features that possess certain canonical higher-order object properties we can steer a middle way between two extreme views that are dominant in different areas of empirical research into object perception and the development of the object concept. Object perception should be understood in terms of perceptual sensitivity to those object properties, where that perceptual (...) sensitivity can be explained in a manner consistent with the graded representation approach adopted by some connectionist modellers. The object properties approach does justice to the differences between a perceptual system solving the binding problem, on the one hand, and genuinely perceiving objects, on the other, without running into the theoretical problems associated with treating young infants as 'little scientists'. (shrink)

This volume is about the many ways we perceive. Contributors explore the nature of the individual senses, how and what they tell us about the world, and how they interrelate. They consider how the senses extract perceptual content from receptoral information. They consider what kinds of objects we perceive and whether multiple senses ever perceive a single event. They consider how many senses we have, what makes one sense distinct from another, and whether and why distinguishing senses may (...) be useful. They consider the extent to which the senses act in concert, rather than as discrete modalities, and whether this influence is epistemically pernicious, neutral, or beneficial. They explore both the familiar five sense modalities and other candidate sense modalities, including a sense for flavour, inner senses (e.g., a sense for pain), and various senses that may result from using sensory substitution devices. Contributors often represent competing views, and the methods they deploy sometimes differ from one essay to the next—with some drawing upon the sciences and engineering and others relying upon conceptual analysis. All contributors agree, nonetheless, that traditional theorizing about the senses is hampered by a neglect of the senses other than vision, and by the misconception that vision is a passive receptacle for an image thrown by a lens. And many contributors believe that it is unduly restrictive to think of perception as a collation of contents provided by individual sense modalities; they think that to understand perception properly, we need to build into our accounts the idea that the senses work together. The ambition of the volume is to begin to develop better paradigms for understanding the senses, and thereby to move toward a better understanding of perception. (shrink)

Philosophers and cognitive scientists address the relationships among the senses and the connections between conscious experiences that form unified wholes. In this volume, cognitive scientists and philosophers examine two closely related aspects of mind and mental functioning: the relationships among the various senses and the links that connect different conscious experiences to form unified wholes. The contributors address a range of questions concerning how information from one sense influences the processing of information from the other senses and how unified (...) states of consciousness emerge from the bonds that tie conscious experiences together. Sensory Integration and the Unity of Consciousness is the first book to address both of these topics, integrating scientific and philosophical concerns. A flood of recent work in both philosophy and perception science has challenged traditional conceptions of the sensory systems as operating in isolation. Contributors to the volume consider the ways in which perceptual contact with the world is or may be “multisensory,” discussing such subjects as the modeling of multisensory integration and philosophical aspects of sensory modalities. Recent years have seen a similar surge of interest in unity of consciousness. Contributors explore a range of questions on this topic, including the nature of that unity, the degree to which conscious experiences are unified, and the relationship between unified consciousness and the self. Contributors Tim Bayne, David J. Bennett, Berit Brogaard, Barry Dainton, Ophelia Deroy, Frederique de Vignemont, Marc Ernst, Richard Held, Christopher S. Hill, Geoffrey Lee, Kristan Marlow, Farid Masrour, Jennifer Matey, Casey O'Callaghan, Cesare V. Parise, Kevin Rice, Elizabeth Schechter, Pawan Sinha, Julia Trommershaeuser, Loes C. J. van Dam, Jonathan Vogel, James Van Cleve, Robert Van Gulick, Jonas Wulff. (shrink)

The dual role of olfaction in both smelling and tasting, i.e. flavour perception, makes it an important test case for philosophical theories of sensory individuation. Indeed, the psychologist Paul Rozin claimed that olfaction is a “dual sense”, leading some scientists and philosophers to propose that we have not one, but two senses of smell: orthonasal and retronasal olfaction. In this paper I consider how best to understand Rozin’s claim, and upon what grounds one might judge there to be (...) one or two distinct olfactory modalities. I conclude that while Rozin may be right that humans have dual occurrences of an olfactory ‘sense’, the concept of a sense-modality, and hence the ‘sense’ of smell, is ambiguous between two different notions: a physiological sensory channel and an experiential modality, along the lines suggested by J. J. Gibson. Furthermore, recognising that these are complementary rather than competing conceptions of a sense-modality enables the formulation of a powerful ‘dual-concept’ framework for posing and addressing questions concerning the complex architecture of human multisensory experience. (shrink)

The basis of perception is the processing and categorization of perceptual stimuli from the environment. Much progress has been made in the science of perceptual categorization. Yet there is still no consensus on how the brain generates sensory individuals, from sensory input and perceptual categories in memory. This chapter argues that perceptual categorization is highly variable across perceivers due to their use of different perceptual strategies for solving perceptual problems they encounter, and (...) that the perceptual system structurally adjusts to the strategies that are most successful. Despite this variability, the different sensory individuals that result when different perceivers rely on different strategies nonetheless correspond to actual external world objects/features. This view is called 'perceptual pluralism'. (shrink)

Human perception has long been a critical subject of design thinking. While various studies have stressed the link between thinking and acting, particularly in spatial experience, the term “design thinking” seems to disconnect conceptual thinking from physical expression or process. Spatial perception is multimodal and fundamentally bound to the body that is not a mere receptor of sensory stimuli but an active agent engaged with the perceivable environment. The body apprehends the experience in which one’s kinesthetic engagement and (...) knowledge play an essential role. Although design disciplines have integrated the abstract, metaphoric, and visual aspects of the body and its movement into conceptual thinking, studies have pointed out that design disciplines have emphasized visuality above the other sensory domains and heavily engaged with the perception of visual configurations, relying on the Gestalt principles. Gestalt psychology must be valued for its attention to a whole. However, the theories of design elements and principles over-empathizing such visuality posit the aesthetics of design mainly as visual value and understate other sensorial and perceptual aspects. Although the visual approach may provide a practical means to represent and communicate ideas, a design process heavily driven by visuality can exhibit weaknesses undermining certain aspects of spatial experience despite the complexity. Grounded in Merleau-Ponty’s notion of multisensory perception, this article discusses the relationship between body awareness and spatial perception and its implication for design disciplines concerning built environments. Special attention is given to the concepts of kinesthetic and synesthetic phenomena known as multisensory and cross-sensory, respectively. This discussion integrates the corporeal and spatiotemporal realms of human experience into the discourse of kinesthetic and synesthetic perceptions. Based on the conceptual, theoretical, and precedent analyses, this article proposes three models for design thinking: Synesthetic Translation, Kinesthetic Resonance, and Kinesthetic Engagement. To discuss the concepts rooted in action-based perception and embodied cognition, this study borrows the neurological interpretation of haptic perception, interoception, and proprioception of space. This article suggests how consideration of the kinesthetic or synesthetic body can deepen and challenge the existing models of the perceptual aspects of environmental psychology adopted in design disciplines. (shrink)

Our emotional states affect how we perceive the world. If I am stressed, annoyed, or irritated, I might experience the sound of children laughing and screaming as they play around the house in a negative manner — it is unpleasant, loud, piercing, and so on. Yet, if I’m in a relaxed, happy, loving mood, the very same sounds might be experienced as pleasant, playful, warm, and so on. The sounds being made by the children are the same in both cases, (...) but how they are experienced differs. The auditory experience is affected by the emotional state that I am in. I perceive the sounds differently depending on how I’m feeling. Although this might at first seem to be a trivial observation, it certainly is not. We take for granted that our perceptual experiences give rise to justified beliefs and knowledge. Thus, if my perceptual experience of an object can differ based on my emotional state, and I take my perceptual experience to justify my beliefs and even lead to knowledge, then we might have a problem. If emotions — which are not fixed and in large part uncontrolled — affect our ability to accurately perceive the world, then they may undermine the justified beliefs and knowledge gained on the basis of our perceptual experience of the world. My goal here is to explore this potential problem. -/- I consider how we might understand the effect that emotions have on the justification of our perceptual beliefs about the world, beliefs that we acquire from a variety of sensory modalities — audition, gustation olfaction, and so on. I take the problem to be associated with one of two forms of perceptual influence: penetration or multisensory integration. In any given perceptual moment there are multiple sensory modalities and mental states at play, each affecting the overall experience. Whether we understand the influence of emotion on perception as a form of non-perceptual penetration or a form of non-visual sensory perception of the inner body — interoception — the potential epistemological difficulties remain: how can we be said to acquire justified beliefs and knowledge on the basis of such influenced perceptual experience. As has been the norm, only the five exteroceptive senses of vision, audition, olfaction, taste and touch are typically discussed in the context of sensory perception. However, as I argue, there is strong reason to accept the claim that emotional experience is a form of interoception, and that interoception ought to be considered when discussing sensory perception. In this way, then, I propose that clarifying the role played by interoception in sense perception across modalities is necessary if we are to make progress on the epistemological problems at hand. (shrink)

Our emotional states affect how we perceive the world. If I am stressed, annoyed, or irritated, I might experience the sound of children laughing and screaming as they play around the house in a negative manner — it is unpleasant, loud, piercing, and so on. Yet, if I’m in a relaxed, happy, loving mood, the very same sounds might be experienced as pleasant, playful, warm, and so on. The sounds being made by the children are the same in both cases, (...) but how they are experienced differs. The auditory experience is affected by the emotional state that I am in. I perceive the sounds differently depending on how I’m feeling. Although this might at first seem to be a trivial observation, it certainly is not. We take for granted that our perceptual experiences give rise to justified beliefs and knowledge. Thus, if my perceptual experience of an object can differ based on my emotional state, and I take my perceptual experience to justify my beliefs and even lead to knowledge, then we might have a problem. If emotions — which are not fixed and in large part uncontrolled — affect our ability to accurately perceive the world, then they may undermine the justified beliefs and knowledge gained on the basis of our perceptual experience of the world. My goal here is to explore this potential problem. -/- I consider how we might understand the effect that emotions have on the justification of our perceptual beliefs about the world, beliefs that we acquire from a variety of sensory modalities — audition, gustation olfaction, and so on. I take the problem to be associated with one of two forms of perceptual influence: penetration or multisensory integration. In any given perceptual moment there are multiple sensory modalities and mental states at play, each affecting the overall experience. Whether we understand the influence of emotion on perception as a form of non-perceptual penetration or a form of non-visual sensory perception of the inner body — interoception — the potential epistemological difficulties remain: how can we be said to acquire justified beliefs and knowledge on the basis of such influenced perceptual experience. As has been the norm, only the five exteroceptive senses of vision, audition, olfaction, taste and touch are typically discussed in the context of sensory perception. However, as I argue, there is strong reason to accept the claim that emotional experience is a form of interoception, and that interoception ought to be considered when discussing sensory perception. In this way, then, I propose that clarifying the role played by interoception in sense perception across modalities is necessary if we are to make progress on the epistemological problems at hand. (shrink)

Molyneux’s question is, very roughly, that of whether a blind person's prior acquaintance with shape properties by touch alone would suffice for visually identifying those properties, if her sight were restored. The question is at least in part an empirical one, and various scientific attempts have been made to answer it not only for sight and haptic touch but also for various other sensory modalities. This paper is not aimed at answering Molyneux’s original or related questions. Rather, our aim (...) here is to bring his question to bear on the nature of multisensory integration. In particular, we argue that variants on Molyneux's question spell trouble for a dominant view of multisensory integration and develop an alternative account that is immune to these problems. Finally, we show that the answer to Molyneux’s original question has interesting consequences for whether our alternative account is true of all cases of multisensory experience. (shrink)

Perception has been for philosophers in the last few decades an area of compelling interest and intense investigation. In large part, the catalyst for this activity has come from contemporary cognitive science and neuroscience, which has been progressing at an accelerating pace, throwing up new information about the brain and new conceptions of how sensory information is processed and used. These new conceptions offer philosophers opportunities for reconceptualizing the senses—what they tell us, how we use them, and the nature (...) of the knowledge they give us. Today, the philosophy of perception resonates with ideas that had not even been articulated in the 1970s and 1980s. This Handbook is a survey by leading philosophical thinkers of contemporary issues and new thinking in philosophy of perception. It includes sections on the history of the subject, introductions to contemporary issues in the epistemology, ontology, and aesthetics of perception, treatments of the individual sense modalities and of the things we perceive by means of them, and a consideration of how perceptual information is integrated and consolidated. New analytic tools and applications to other areas of philosophy are discussed in depth. Each of the forty-five entries is written by a leading expert, some collaborating with younger figures; each seeks to introduce the reader to a broad range of issues. All contain new ideas on the topic covered; together they are a portrait of the vigour and innovative zeal of a young field. The book is accessible to anybody who has an intellectual interest in issues concerning perception. (shrink)

In this paper we argue that object perception may be affected by what we call “perceptual frames.” Perceptual frames are adaptations of the perceptual system that guide how perceptual objects are singled out from a sensory environment. These adaptations are caused by perceptual learning and realized through bottom-up functional processes such that sensory information is organized in a subject-dependent way leading to idiosyncratic perceptual object representations. Through domain-specific training, perceptual (...) learning, and the acquisition of object-knowledge, it is possible to modulate the adaptive perceptual system such that its ability to represent becomes bespoke. Different perceivers with different perceptual frames may, therefore, receive the same sensory information and perceive different perceptual objects due to the effects of framing. Consequently, we demonstrate the plausibility of this account by surveying empirical data concerning the functions of (1) multisensory integration, (2) amodal completion, and (3) predictive anticipation. Regarding (1), we argue that the perceptual system’s optimization processes employ perceptual frames to facilitate multisensory feature binding. Regarding (2), we argue that amodal completion can occur with or without the help of mental imagery, yet either instance of amodal completion requires perceptual frames. Regarding (3), we demonstrate that perceptually anticipating an object’s motion involves the implementation of perceptual frames. We conclude that framing effects are a matter of perceptual diversity and highlight the need to accommodate unique perspectives in the philosophy and science of perception. (shrink)

In this short paper, I outline four philosophical arguments concerning the objects we perceive. These arguments build up to the conclusion that the objects of perceptual experience are material objects. I then show that the first three of these arguments parallel important psychological positions in vision science. Thus, (1) the notion of object used in Logical Atomism resembles the concept as it is defined in the Feature Integration Theory of Treisman and Gelade (1980). But (2) Frank Jackson's (1975) (...) Many-Property Problem leads to a substrate-quality structure for visual experience that corresponds to the structure of attended experience in Feature Integration Theory. A third philosophical argument (3) concerns the perception of movement. This argument culminates in the proposition that perceptual features are seen as belonging to material objects. There is a close resemblance between these objects and those of Zenon Pylyshyn's (1980) FINSTs. Finally, (4) I argue that material objects are the only substrates of multimodal perceptual experience. Perceptual psychology has yet to investigate this structure. (shrink)

Cognitive scientists have long known that the modalities interact during perceptual processing. Cross-modal illusions like the ventriloquism effect show that the course of processing in one modality can alter the course of processing in another. But how do the modalities interact in the specific domain of object perception? This paper distinguishes and analyzes two kinds of multisensory interaction in object perception. First, the modalities may bind features to a single object or event. Second, the modalities (...) may cooperate when differentiating an object or event from its surroundings. I critically evaluate evidence for various forms of multisensory binding. I then consider the case for multisensory differentiation. I argue that existing evidence for multisensory differentiation is inconclusive. I highlight ways that the issue might be empirically resolved. (shrink)

A central preoccupation of philosophy in the twentieth century was to determine constitutive conditions under which accurate (objective) empirical representation of the macrophysical environment is possible. A view that dominated attitudes on this project maintained that an individual cannot empirically represent a physical subject matter as having specific physical characteristics unless the individual can represent some constitutive conditions under which such representation is possible. The version of this view that dominated the century's second half maintained that objective empirical representation of (...) the physical environment requires the individual to be able to supplement this representation with representation of general constitutive features of objectivity. This essay criticizes instances of this version in P. F. Strawson and Quine. It maintains that all versions of the position postulate conditions on objective empirical representation that are more intellectual than are warranted. Such views leave it doubtful that animals and human infants perceptually represent elements in the physical environment. By appeal to common sense and to empirical perceptual psychology, this essay argues that unaided perception yields objective representation of the macrophysical environment. It does so in prelinguistic animals, even in animals that almost surely lack propositional attitudes. The essay concludes with explications of nondeflationary conceptions of representation and perception. It distinguishes nonperceptual sensing from perceptual representation and explicates perceptual representation as a type of objective sensory representation. Objectivity is marked by perceptual constancies. Representation is marked by a nontrivial role for veridicality conditions in explanations of the relevant states. (shrink)

My thesis is that perceptual awareness is richly multisensory. I argue for this conclusion on the grounds that certain forms of multisensory perceptual experience are incompatible with the claim that each aspect of a perceptual experience is associated with some specific sensory modality or another. First, I explicate what it is for some feature of a conscious perceptual episode to be modality specific. Then, I argue based on philosophical and experimental evidence that some (...) novel intermodal features are perceptible only through the coordinated use of multiple senses. I appeal to cases that involve consciously perceptible feature instances and feature types that could not be perceptually experienced through the use of individual sense modalities working on their own or simply in parallel and co-consciously. Finally, I offer an account of how to type perceptual experiences by modality that makes room for richly multisensory experiences. (shrink)

The first part of this survey article presented a cartography of some of the more extensively studied forms of multisensory processing. In this second part, I turn to examining some of the different possible ways in which the structure of conscious perceptual experience might also be characterized as multisensory. In addition, I discuss the significance of research on multisensory processing and multisensory consciousness for philosophical debates concerning the modularity of perception, cognitive penetration, and the individuation (...) of the senses. (shrink)

How do people learn multisensory, or amodal, representations, and what consequences do these representations have for perceptual performance? We address this question by performing a rational analysis of the problem of learning multisensory representations. This analysis makes use of a Bayesian nonparametric model that acquires latent multisensory features that optimally explain the unisensory features arising in individual sensory modalities. The model qualitatively accounts for several important aspects of multisensory perception: (a) it integrates information from (...) multiple sensory sources in such a way that it leads to superior performances in, for example, categorization tasks; (b) its performances suggest that multisensory training leads to better learning than unisensory training, even when testing is conducted in unisensory conditions; (c) its multisensory representations are modality invariant; and (d) it predicts ‘‘missing” sensory representations in modalities when the input to those modalities is absent. Our rational analysis indicates that all of these aspects emerge as part of the optimal solution to the problem of learning to represent complex multisensory environments. (shrink)

For more than a century now, researchers have acknowledged the existence of seemingly arbitrary crossmodal congruency effects between dimensions of sensory stimuli in the general population. Such phenomena, known by a variety of terms including 'crossmodal correspondences', involve individual stimulus properties, rely on a crossmodal mapping of unisensory features, and appear to be shared by the majority of individuals. In other words, members of the general population share underlying preferences for specific pairings across the senses. Crossmodal correspondences between complementary (...) sensory cues have often been referred to as synesthetic correspondences but, we would argue, differ from full-blown synesthetic experiences in a number of important ways, including the fact that there are no idiosyncratic concurrent sensations. Recent psychophysical evidence suggests that such crossmodal correspondences can modulate multisensory integration by helping to resolve the crossmodal binding problem. Here, we propose a model to account for the effects of crossmodal correspondences between complementary auditory and visual cues and critically review their relation to full-blown synesthesia. (shrink)

It is arguably the case that olfactory system contains two senses that share the same type of stimuli, sensory transduction mechanism, and processing centers. Yet, orthonasal and retronasal olfaction differ in their types of perceptible objects as individuated by their sensory qualities. What will be explored in this paper is how the account of orthonasal smell developed in the Molecular Structure Theory of smell can be expanded for retronasal olfaction (Young, 2016, 2019a-b, 2020). By considering the object (...) of olfactory perception to be the molecular structure of chemical compounds composing odor plumes, Molecular Structure Theory provides a means for determining an odor’s olfactory quality, how odors can be identified and individuated, and how we perceive smellscapes. Surveying the differences between orthonasal and retronasal olfaction provides the basis for the central argument of the paper that the perceptible objects we refer to as smells and individuated on the basis of their olfactory qualities are only relative to orthonasal olfaction. Retronasal olfaction it is speculatively concluded might play an essential role in our perception of flavorful objects. (shrink)

Pain is commonly explained in terms of the perceptual activity of a distinct sensory modality, the function of which is to enable us to perceive actual or potential damage to the body. However, the characterization of pain experience in terms of a distinct sensory modality with such content is problematic. I argue that pain is better explained as occupying a different role in relation to perception: to indicate when the stimuli that are sensed in perceiving anything by (...) means of a sensory modality exceed a significant level of intensity. Viewing the system underlying pain experience as an integral and functionally integrated feature of all the senses provides a new perspective on the diverse forms of pain, what it is like to experience pain and the contrasting natures of pain and pleasure. (shrink)

Philosophers and scientists have studied sensory perception and, in particular, vision for many years. Increasingly, however, they have become interested in the nonvisual senses in greater detail and the problem of individuating the senses in a more general way. The Aristotelian view is that there are only five external senses—smell, taste, hearing, touch, and vision. This has, by many counts, been extended to include internal senses, such as balance, proprioception, and kinesthesis; pain; and potentially other human and nonhuman senses. (...) This “multisensory turn” has been driven partly by developments in contemporary psychology and neuroscience, which have revealed a host of complex interrelations and interactions between sensory modalities previously thought to be distinct. Contrasts between modalities and other crossmodal phenomena, including multisensory integration, synesthesia, and sensory substitution, have also begun to receive more attention in a burgeoning scientific and philosophical literature on multisensory perception and other crossmodal effects. This article focuses on recent empirically informed contributions to the philosophy of perception, as well as key scientific works that provide important background information and insights into the nature of the senses and sensory perception. Indeed, one of the lessons of the multisensory turn, and of contemporary philosophy of mind more generally, is that philosophers ignore this body of empirical research at their peril because many human and animal senses turn out to be richer and more complex than philosophers and scientists had previously imagined, making this a fruitful area for interdisciplinary interaction and research. (shrink)

In Nyāya philosophy, a special kind of extraordinary sensory connection is admitted named jñānalakṣaṇā pratyāsatti or jñānalakṣaṇa sannikarṣa. It is held that sometimes our sense-organ can be connected to such an object which is not amenable to the operating sense-organ. In such cases, cognition (jñāna) plays the role of sensory connection and connects the content of itself to the operating sense-organ. The paradigmatic example of jñānalakṣaṇa perception is to ‘see’ fragrant sandal through visual (...) class='Hi'>sense from non-smellable distance. This hypothesis of jñānalakṣaṇa has been criticized by the opponents being considered as counterintuitive, mysterious and theoretically overloaded. This paper tries to demystify the notion. It shows that although it seems to be metaphysically mysterious phenomenon at first sight, it is not so at all. The paper explores the psychological process involved in this sensory connection. The hypothesis is shown to have sufficient explanatory power, because the Naiyāyikas have used this hypothesis to explain five different epistemic situations. Hence, this paper argues that it is not a theoretical overload. The opponents counter-argue that all those five cognitive situations can be explained without admitting jñānalakṣaṇa. Moreover, if we admit jñānalakṣaṇa, then a particular kind of inference will become redundant. The paper answers all those objections and defends the hypothesis. The second part of the paper presents an empirical evidence in support of the hypothesis. The arguments leveled against the hypothesis of jñānalakṣaṇa can be contested on the ground that they try to disprove something which is supported on experimental ground. Experiments represent universally acceptable objective facts supported by experience—denying which amounts to anubhavavirodha, which philosophers would want to avoid. Hence, supporting jñānalakṣaṇa on the ground of scientific experiments can be considered as a philosophical stand. Now, there is a clinically recognized and neurophysiologically proved condition, called synaesthesia, where stimulation of a particular sensory modality automatically and involuntarily activates a different sensory modality simultaneously without a direct stimulation of the second modality. As for example, when a sound → colour synaesthete listens to a particular tone such as C-sharp, she visualizes particular colour, such as blue, in her mind’s eye; for a grapheme → colour synaesthete a particular number or alphabet is always tinged with a particular colour. This paper shows that the cognitive process involved in synaesthesia lends support to the hypothesis of jñānalakṣaṇa pratyāsatti. It has been proved through several experiments that it is a genuine perceptual phenomenon and is not a confabulation of memory. There are several alternative theories which explain the phenomenon neurophysiologically. The paper discusses the most popular one: the cross-activation hypothesis. There are two major objections against the project of comparing jñānalakṣaṇa with synaesthesia. First, synaesthesia is a neurological condition present in a few numbers of people whereas jñānalakṣaṇa is claimed to be universal phenomenon. Second, syneasthesia is a sensory experience whereas jñānalakṣaṇa involves application of concepts. The paper answers these questions. Firstly, multimodal processing in the brain is a universal phenomenon; secondly, there is a form of synaesthesia where top-down processing is involved. In those cases, concepts play important role for having synaesthetic experience. (shrink)

How many senses do humans possess? Five external senses, as most cultures have it—sight, hearing, touch, smell, and taste? Should proprioception, kinaesthesia, thirst, and pain be included, under the rubric bodily sense? What about the perception of time and the sense of number? Such questions reduce to two. 1. How do we distinguish a sense from other sorts of information-receiving faculties? 2. By what principle do we distinguish the senses? Aristotle discussed these questions in the De Anima. (...) H. P. Grice revived them in 1967. More recently, they have taken on fresh interest as a result of a collection of essays edited by Fiona Macpherson. This entry reviews some approaches to these questions and advances some new ideas for the reader’s consideration. It proposes that the senses constitute an integrated learning system, membership in which answers question 1. It also proposes that the modalities can be distinguished from one another in two ways, by the means of information pick-up and by the kinds of activity that a perceiver undertakes to make use of them. (shrink)

According to the decomposition thesis, perceptual experiences resolve without remainder into their different modality-specific components. Contrary to this view, I argue that certain cases of multisensory integration give rise to experiences representing features of a novel type. Through the coordinated use of bodily awareness—understood here as encompassing both proprioception and kinaesthesis—and the exteroceptive sensory modalities, one becomes perceptually responsive to spatial features whose instances couldn’t be represented by any of the contributing modalities functioning in isolation. I develop (...) an argument for this conclusion focusing on two cases: 3D shape perception in haptic touch and experiencing an object’s egocentric location in crossmodally accessible, environmental space. (shrink)

We can discern two opposing viewpoints regarding synesthesia. According to the first, it is an oddity, an outlier, or a disordered condition. According to the second, synesthesia is pervasive, driving creativity, metaphor, or language itself. Which is it? Ultimately, I favor the first perspective, according to which cross-sensory synesthesia is an outlying condition. But the second perspective is not wholly misguided. My discussion has three lessons. First, synesthesia is just one of a variety of effects in which one (...) class='Hi'>sense modality causally impacts and reshapes experience associated with another. These effects are utterly common. However, due to their unfamiliarity, and to their conflict with a widespread conception of the role of the senses in perception and perceptual experience, until recently they have been surprising. Second, synesthesia nevertheless must be distinguished from other inter-modal effects that lead to misperception, such as crossmodal illusions. Third, synesthesia also may be distinguished from the potentially much broader class of synesthetic effects, which could be common across the population and within individuals. (shrink)

Haptic touch is an inherently active and exploratory form of perception, involving both coordinated movements and an array of distinct sensory receptors in the skin. For this reason, some have claimed that haptic touch is not a single sense, but rather a multisensory collection of distinct sensory systems. Though this claim is often made, it relies on what I regard as a confused conception of multisensory interaction. In its place, I develop a nuanced hierarchy of (...) multisensory involvement. According to this hierarchy, touch turns out to be a single modality in that its various receptors assign their features to the same tangible objects. When we grasp an object a range of distinct properties?shape, warmth, heft, texture, etc.?are all felt to belong to the object, just as different visual properties are associated with a visual object. Paradigm multisensory experiences, on the other hand, involve associations between distinct perceptual experiences, as when the way something looks affects the way something sounds. Thus despite its functional and physiological diversity, haptic touch can be regarded as a single sense. (shrink)

Neural correlates exist for a basic component of logical formulae, PREDICATE(x). Vision and audition research in primates and humans shows two independent neural pathways; one locates objects in body-centered space, the other attributes properties, such as colour, to objects. In vision these are the dorsal and ventral pathways. In audition, similarly separable “where” and “what” pathways exist. PREDICATE(x) is a schematic representation of the brain's integration of the two processes of delivery by the senses of the location of an arbitrary (...) referent object, mapped in parietal cortex, and analysis of the properties of the referent by perceptual subsystems. The brain computes actions using a few “deictic” variables pointing to objects. Parallels exist between such nonlinguistic variables and linguistic deictic devices. Indexicality and reference have linguistic and nonlinguistic (e.g., visual) versions, sharing the concept of attention. The individual variables of logical formulae are interpreted as corresponding to these mental variables. In computing action, the deictic variables are linked with “semantic” information about the objects, corresponding to logical predicates. Mental scene descriptions are necessary for practical tasks of primates, and preexist language phylogenetically. The type of scene descriptions used by nonhuman primates would be reused for more complex cognitive, ultimately linguistic, purposes. The provision by the brain's sensory/perceptual systems of about four variables for temporary assignment to objects, and the separate processes of perceptual categorization of the objects so identified, constitute a pre-adaptive platform on which an early system for the linguistic description of scenes developed. Key Words: argument; attention; deictic; dorsal; logic; neural; object; predicate; reference; ventral. (shrink)

Perceptual experience strikes us as a presentation of the here and now. I argue that it also involves experience of the past. This claim is often made based on cases, like seeing stars, involving significant signal-transmission lag, or based on how working memory allows us to experience extended events. I argue that the past is injected into perceptual experience via a third way: long-term memory traces in sensory circuits. Memory, like the receptor-based senses, is an integrated and (...) constituent modality through which we experience the environment. Because of this modality, we experience the sensed properties of stimuli partly as they are now, but also partly as we encountered them in the past. (shrink)

When I am looking at my coffee machine that makes funny noises, this is an instance of multisensory perception – I perceive this event by means of both vision and audition. But very often we only receive sensory stimulation from a multisensory event by means of one sense modality, for example, when I hear the noisy coffee machine in the next room, that is, without seeing it. The aim of this paper is to bring together empirical (...) findings about multimodal perception and empirical findings about (visual, auditory, tactile) mental imagery and argue that on occasions like this, we have multimodal mental imagery: perceptual processing in one sense modality (here: vision) that is triggered by sensory stimulation in another sense modality (here: audition). Multimodal mental imagery is not a rare and obscure phenomenon. The vast majority of what we perceive are multisensory events: events that can be perceived in more than one sense modality – like the noisy coffee machine. And most of the time we are only acquainted with these multisensory events via a subset of the sense modalities involved – all the other aspects of these multisensory events are represented by means of multisensory mental imagery. This means that multisensory mental imagery is a crucial element of almost all instances of everyday perception. (shrink)