It is a commonly held view that auditory perception functions to tell us about sounds and their properties. In this paper I argue that this common view is mistaken and that auditory perception functions to tell us about the objects that are the sources of sounds. In doing so, I provide a general theory of auditory perception and use it to give an account of the content of auditory experience and of the nature (...) of sounds. (shrink)

The aim of the paper is to present and analyze problems associated with the mechanisms of auditory perception (especially those responsible for speech perception), their specific disorders and functions. I discuss research on speech perception in the broader theoretical context of the mechanistic model of scientific explanation and the perspective of cognitive implantology that explores the possibilities for building hybrid auditory systems.

Audiovisual interaction in speech perception is well defined in adults. Despite the large body of evidence suggesting that children are also sensitive to visual input, very few empirical studies have been conducted. To further investigate whether visual inputs influence auditory perception of phonemes in preschoolers in the same way as in adults, we conducted an audiovisual identification test. The auditory stimuli were presented either in an auditory condition only or simultaneously with a visual presentation of (...) the articulation of the vowel /e/ or /ø/. The results suggest that, although all participants experienced visual influence on auditory perception, substantial individual differences exist in the 5- to 6-year-old group. While additional work is required to confirm this hypothesis, we suggest that auditory and visual systems are developing at that age and that multisensory phonological categorization of the rounding contrast took place only in children whose sensory systems and sensorimotor representations were mature. (shrink)

Jean Gabbert Harrell argues persuasively in her book, Soundtracks, that aesthetic theories have often been deficient because they have tried to be too inclusive. That is, the experience of music is profoundly different from that of painting, for instance, and that it is wrong to compare them. Her reasoning for this viewpoint is based in part on a recognition that auditory perception is fully developed in humans prior to either visual or significant tactual perception, bringing a genetic, (...) developmental aspect to her discussion. In its genetic orientation toward sensory development and its concentration exclusively on auditory perception, Soundtracks provides an argument against the relativism of aesthetic judgment in auditory art that has never before been suggested. (shrink)

We can easily discriminate self-produced from externally generated sensory signals. Recent studies suggest that the prediction of the sensory consequences of one’s own actions made by forward model can be used to attenuate the sensory effects of self-produced movements, thereby enabling a differentiation of the self-produced sensation from the externally generated one. The present study showed that attenuation of sensation occurred both when participants themselves performed a goal-directed action and when they observed experimenter performing the same action, although they clearly (...) reported that the tones were produced by other during action observation and by themselves during their own action. These results suggest that sensory prediction of action modulates ongoing auditory processing irrespective of who produces the sounds and that the explicit judgment of agency does not necessarily rely on the same mechanisms on which implicit perceptual measures such as sensory attenuation rely. (shrink)

According to sensorimotor theory perceiving is a bodily skill involving exercise of an implicit know-how of the systematic ways that sensations change as a result of potential movements, that is, of sensorimotor contingencies. The theory has been most successfully applied to vision and touch, while perceptual modalities that rely less on overt exploration of the environment have not received as much attention. In addition, most research has focused on philosophically grounding the theory and on psychologically elucidating sensorimotor laws, but the (...) theory’s ramifications for neuroscience still remain underexamined. Here we sketch the beginnings of a research program that could address these two outstanding challenges in terms of auditory perception. We review the neuroscience literature on passive listening, which is defined as listening without overt bodily movement, and conclude that sensorimotor theory provides a unique perspective on the consistent finding of motor system activation. In contrast to competing theories, this activation is predicted to be involved not only in the perception of speech- and action-related sounds, but in auditory perception in general. More specifically, we propose that the auditory processing associated with supplementary motor areas forms part of the neural basis of the exercise of sensorimotor know-how: these areas’ recognized role in facilitating spontaneous motor responses to sound and supporting flexible engagement of sensorimotor processes to guide auditory experience and enable auditory imagery, can be understood in terms of two key characteristics of sensorimotor interaction, its “alerting capacity” and “corporality”, respectively. We also highlight that there is more to the inside of the body than the brain: there is an opportunity to develop sensorimotor theory into new directions in terms of the still poorly understood active processes of the peripheral auditory system. (shrink)

This dissertation aims to revive wave theory in the philosophy of sound. Wave theory identifies sounds with compression waves. Despite its wide acceptance in the scientific community as the default position, many philosophers have rejected wave theory and opted for different versions of distal theory instead. According to this current majority view, a sound has its stationary location at its source. I argue against this and other alternative philosophical theories of sound and develop wave theory into a more defensible form. (...) Philosophers of sound tend to emphasise how sounds are experienced to be in their arguments. Most often, it is assumed that that which appears to be a distally located bearer of auditory properties in an auditory experience is a sound. Chapter 1 argues that if this distal entity is the sound source instead, many of the existing theories of sound will be severely affected. Chapter 2 discusses auditory perception and criticises the common assumption that we hear non-sound entities in virtue of hearing sounds. I show that this assumption begs the question against certain theories of sound and that the contrary view that sound sources can be directly heard is more plausible. If sound sources can be directly heard, then features commonly attributed to sounds based on auditory experiences might rather be features of sound sources. I examine eight of such features in Chapter 3. Only four of them survive. Chapters 4 and 5 review the existing theories of sound. After a taxonomy of existing theories of sound, each theory is criticised one-by-one. Some of them are problematic precisely because they rely on the implausible assumption that that which appears to be distally located in an auditory experience is a sound rather than a sound source. Lastly, Chapter 6 focuses on wave theory. It begins with two positive arguments for wave theory in general, followed by my replies to two common objections in the literature. I then move on to develop my version of wave theory. There are two core aspects of my view. The first one is a metaphysics of compression waves; the second is an account of what it is to hear compression waves. After comparing my view with a similar theory, I demonstrate the explanatory power of my view in two steps. First, the eight commonly accepted features of sounds examined in Chapter 3 are revisited. It turns out that my view can accommodate all of them. Second, explanations for four special sound-related phenomena are offered at the end of the chapter. I conclude in the last chapter with the suggestion that, as a philosopher, the best way to defend wave theory is to offer a better understanding of auditory perception which explains how compression waves are experienced. (shrink)

This paper proposes some guidelines for the undeveloped discussion of auditory epistemology. Auditory epistemology is an approach concerned with the perceptual basis for knowledge and belief, specifically around audition. The article pursues two goals. Firstly, it claims that addressing auditory perception from the viewpoint of epistemology is more fruitful than the discussion on phenomenology which has thus far dominated the debates in the literature on sound. Secondly, it elaborates a concrete proposal pertaining to the cooperation of (...) sense-modalities. In so doing, a model for “Perceptual Coherence” is suggested. The first section of the paper critically reviews the problem of perception as it is usually understood in traditional epistemology. An ensuing section outlines the model of perceptual coherence. (shrink)

Whilst arguing for sounds as repeatable objects does not seem suitable to our auditory experience, considering them as events can then help us understand some of their main features. In this sense, sounds are events happening to material objects; they have a beginning and an end; they are ephemeral entities that we cannot grasp as ordinary objects. Nevertheless, supporters of event theory usually focus on the autonomous status that sounds manifest from the things in the world. Conversely, when we (...) hear sounds, we hear what and where they are sounding even in those theories that I will call detached-sound theories; in hearing them we hear how different materials create different sounds. Within the different positions of the event theory to pure-event or acousmatic proposal, the importance and role that the material has in the creation of diverse sounds does not always seem to be recognized. In this paper, I therefore aim to show how the materiality of resonating bodies and objects is given in all forms of auditory experience, not until analyzed the differences between object and event accounts in the philosophy of sound. (shrink)

Previous reports have demonstrated that the comprehension of sentences describing motion in a particular direction (toward, away, up, or down) is affected by concurrently viewing a stimulus that depicts motion in the same or opposite direction. We report 3 experiments that extend our understanding of the relation between perception and language processing in 2 ways. First, whereas most previous studies of the relation between perception and language processing have focused on visual perception, our data show that sentence (...) processing can be affected by the concurrent processing of auditory stimuli. Second, it is shown that the relation between the processing of auditory stimuli and the processing of sentences depends on whether the sentences are presented in the auditory or visual modality. (shrink)

Following in a psychological and musicological tradition beginning with Leonard Meyer, and continuing through David Huron, we present a functional, cognitive account of the phenomenon of expectation in music, grounded in computational, probabilistic modeling. We summarize a range of evidence for this approach, from psychology, neuroscience, musicology, linguistics, and creativity studies, and argue that simulating expectation is an important part of understanding a broad range of human faculties, in music and beyond.

Attention is often conceived as a gateway to consciousness . Although endogenous spatial attention may be independent of conscious perception , exogenous spatial orienting seems instead to be an important modulator of CP . Here, we investigate the role of auditory alerting in CP in normal observers. We used a behavioral task in which phasic alerting tones were presented either at unpredictable or at predictable time intervals prior to the occurrence of a near-threshold visual target. We find, for (...) the first time in neurologically intact observers, that phasic alertness increases CP, both objectively and subjectively. This result is consistent with evidence showing that phasic alerting can ameliorate the spatial bias exhibited by visual neglect patients . The alerting network may increase the activity of fronto-parietal networks involved in top-down amplification required to bring a stimulus into consciousness. (shrink)

Multisensory integration (MSI) allows us to link sensory cues from multiple sources and plays a crucial role in speech development. However, it is not clear whether humans have an innate ability or whether repeated sensory input while the brain is maturing leads to efficient integration of sensory information in speech. We investigated the integration of auditory and somatosensory information in speech processing in a bimodal perceptual task in 15 young adults (age 19–30) and 14 children (age 5–6). The participants (...) were asked to identify if the perceived target was the sound /e/ or /ø/. Half of the stimuli were presented under a unimodal condition with only auditory input. The other stimuli were presented under a bimodal condition with both auditory input and somatosensory input consisting of facial skin stretches provided by a robotic device, which mimics the articulation of the vowel /e/. The results indicate that the effect of somatosensory information on sound categorization was larger in adults than in children. This suggests that integration of auditory and somatosensory information evolves throughout the course of development. (shrink)

This study aimed to explore the psychophysical bases of multisensory surface stickiness perception by investigating how sensitively humans perceive different levels of stickiness intensity conveyed by auditory, tactile, and visual cues. First, we sorted five different sticky stimuli by perceived intensity in ascending order for each modality separately and evaluated the discrimination sensitivities of each participant using a fitted psychometric curve. Results showed that perceptual intensity orders were not identical to physical intensity order and that the sequential order (...) of perceived intensities for different modalities was inconsistent. Moreover, estimated perceptual sensitivities to surface stickiness indicated that auditory cues result in better discrimination sensitivity than tactile and visual cues. Second, we calculated the relative perceptual distances of stickiness intensities using multidimensional scaling. A follow-up statistical test demonstrated that the perceptual mapping of vision and touch are similar but that auditory perception is different. These results suggest that the discriminability of stickiness intensity is best served by auditory cues and that texture information processing in the auditory domain is distinctive from that of other modalities. (shrink)

Summary Recent studies explored the contribution of auditory information in ecological contexts to biological motion perception and its influence on movement execution. This work provides an overview of the most influential scientific contributions in this domain and analyzes the most recent findings, both in sport and motor rehabilitation. Overall, the literature indicates that ecological sounds associated with movements are relevant for perceiving some important features of sport movements. Auditory information is also relevant during performance execution, and can (...) be used to create training protocols. Also, similarly auditory information can be used in clinical contexts to provide rhythmic information to enhance the efficacy of motor rehabilitation protocols. In conclusion, we can say that the role of ecological sounds of movements is examined in conveying complexity of information from a gestalt perspective. (shrink)

This study investigated eye-movement patterns during emotion perception for children with hearing aids and hearing children. Seventy-eight participants aged from 3 to 7 were asked to watch videos with a facial expression followed by an oral statement, and these two cues were either consistent or inconsistent in emotional valence. Results showed that while normal-hearing children paid more attention to the upper part of the face, children with hearing aids paid more attention to the lower face after the oral statement (...) was presented. When there was an inconsistency between the visual and auditory cues, children with hearing aids were likely to increase attention to the upper face. The results revealed the underlying mechanism of deficits in emotion perception for hearing-impaired children. (shrink)

A period of exposure to trains of simultaneous but spatially offset auditory and visual stimuli can induce a temporary shift in the perception of sound location. This phenomenon, known as the 'ventriloquist aftereffect', reflects a realignment of auditory and visual spatial representations such that they approach perceptual alignment despite their physical spatial discordance. Such dynamic changes to sensory representations are likely to underlie the brain's ability to accommodate inter-sensory discordance produced by sensory errors (particularly in sound localization) (...) and variability in sensory transduction. It is currently unknown, however, whether these plastic changes induced by adaptation to spatially disparate inputs occurs automatically or whether they are dependent on selectively attending to the visual or auditory stimuli. Here, we demonstrate that robust auditory spatial aftereffects can be induced even in the presence of a competing visual stimulus. Importantly, we found that when attention is directed to the competing stimuli, the pattern of aftereffects is altered. These results indicate that attention can modulate the ventriloquist aftereffect. © 2010 Elsevier B.V. (shrink)

Similar to visual perception, auditory perception also has a clearly described “pop-out” effect, where an element with some extra feature is easier to detect among elements without an extra feature. This phenomenon is better known as auditory perceptual asymmetry. We investigated such asymmetry between shorter or longer duration, and level or falling of pitch of linguistic stimuli that carry a meaning in one language (Estonian), but not in another (Russian). For the mismatch negativity (MMN) experiment, we (...) created four different types of stimuli by modifying the duration of the first vowel [ɑ] (170, 290 ms) and pitch contour (level vs. falling pitch) of the stimuli words (‘SATA,’ ‘SAKI’). The stimuli were synthesized from Estonian words (‘SATA,’ ‘SAKI’) and follow the Estonian language three-way quantity system, which incorporates tonal features (falling pitch contour) together with temporal patterns. This made the meaning of the word dependent on the combination of both features and allows us to compare the relative contribution of duration and pitch contour in discrimination of language stimuli in the brain via MMN generation. The participants of the experiment were 12 Russian native speakers with little or no experience in Estonian and living in Estonia short-term, and 12 Estonian native speakers (age 18–27 years). We found that participants’ perception of the linguistic stimuli differed not only according to the physical features but also according to their native language, confirming that the meaning of the word interferes with the early automatic processing of phonological features. The GAMM and ANOVA analysis of the reversed design results showed that the deviant with longer duration among shorter standards elicited a MMN response with greater amplitude than the short deviant among long standards, while changes in pitch contour (falling vs. level pitch) produced neither strong MMN nor asymmetry. Thus, we demonstrate the effect of language background on asymmetric perception of linguistic stimuli that aligns with those of previous studies (Jaramillo et al., 2000), and contributes to the growing body of knowledge supporting auditory perceptual asymmetry. (shrink)