ABSTRACTBoth auditory and visual emotional memories can be made less emotional by loading working memory during memory recall. Taxing WM during recall can be modality specific (giving an audit...

Sound symbolism refers to non‐arbitrary mappings between the sounds of words and their meanings and is often studied by pairing auditory pseudowords such as “maluma” and “takete” with rounded and pointed visual shapes, respectively. However, it is unclear what auditory properties of pseudowords contribute to their perception as rounded or pointed. Here, we compared perceptual ratings of the roundedness/pointedness of large sets of pseudowords and shapes to their acoustic and visual properties using a novel application of representational similarity (...) analysis (RSA). Representational dissimilarity matrices (RDMs) of the auditory and visual ratings of roundedness/pointedness were significantly correlated crossmodally. The auditory perceptual RDM correlated significantly with RDMs of spectral tilt, the temporal fast Fourier transform (FFT), and the speech envelope. Conventional correlational analyses showed that ratings of pseudowords transitioned from rounded to pointed as vocal roughness (as measured by the harmonics‐to‐noise ratio, pulse number, fraction of unvoiced frames, mean autocorrelation, shimmer, and jitter) increased. The visual perceptual RDM correlated significantly with RDMs of global indices of visual shape (the simple matching coefficient, image silhouette, image outlines, and Jaccard distance). Crossmodally, the RDMs of the auditory spectral parameters correlated weakly but significantly with those of the global indices of visual shape. Our work establishes the utility of RSA for analysis of large stimulus sets and offers novel insights into the stimulus parameters underlying sound symbolism, showing that sound‐to‐shape mapping is driven by acoustic properties of pseudowords and suggesting audiovisual cross‐modal correspondence as a basis for language users' sensitivity to this type of sound symbolism. (shrink)

A number of recent studies have documented rapid changes in behavioural sensory acuity induced by aversive learning in the olfactory and auditory modalities. The effect of aversive learning on the discrimination of low-level features in the visual system of humans remains unclear. Here, we used a psychophysical staircase procedure to estimate discrimination thresholds for oriented grating stimuli, before and after differential aversive learning. We discovered that when a target grating orientation was conditioned with an aversive (...) loud noise, it subsequently led to an improvement of discrimination acuity in nearly all subjects. However, no such change was observed in a control group conditioned to an orientation shifted by ±90° from the target. Our findings cannot be explained by contextual learning or sensitisation factors. The results converge with those reported in the olfactory modality and provide further evidence that early sensory systems can be rapidly modified by recently experienced reinforcement histories. (shrink)

The auditory system is able to recognize auditory objects and is thought to form predictive models of them even though the acoustic information arriving at our ears is often imperfect, intermixed, or distorted. We investigated implicit regularity extraction for acoustically intact versus disrupted six-tone sound patterns via event-related potentials. In an exact-repetition condition, identical patterns were repeated; in two distorted-repetition conditions, one randomly chosen segment in each sound pattern was replaced either by white noise or by a wrong (...) pitch. In a roving-standard paradigm, sound patterns were repeated 1–12 times in a row before a new pattern occurred. The participants were not informed about the roving rule and had to detect rarely occurring loudness changes. Behavioral detectability of pattern changes was assessed in a subsequent behavioral task. Pattern changes elicited mismatch negativity and P3a, and were behaviorally detected above the chance level in all conditions, suggesting that the auditory system extracts regularities despite distortions in the acoustic input. However, MMN and P3a amplitude were decreased by distortions. At the level of MMN, both types of distortions caused similar impairments, suggesting that auditory regularity extraction is largely determined by the stimulus statistics of matching information. At the level of P3a, wrong-pitch distortions caused larger decreases than white-noise distortions. Wrong-pitch distortions likely prevented the engagement of restoration mechanisms and the segregation of disrupted from true pattern segments, causing stronger informational interference with the relevant pattern information. (shrink)

Voluntary stream segregation was investigated in cochlear implant users and normal-hearing listeners using a segregation-promoting objective approach which evaluated the role of spectral and amplitude-modulation rate separations on stream segregation and its build-up. Sequences of 9 or 3 pairs of A and B narrowband noise bursts were presented which differed in either center frequency of the noise band, the AM-rate, or both. In some sequences, the last B burst was delayed by 35 ms from their otherwise-steady temporal position. In the (...) other sequences, the last B bursts were temporally advanced from 0 to 10 ms. A single interval yes/no procedure was utilized to measure participants’ sensitivity in identifying delayed vs. no-delay sequences. A higher d′ value showed the higher ability to segregate the A and B subsequences. For NH listeners, performance improved with each spectral separation. However, for CI users, performance was only significantly better for the condition with the largest spectral separation. Additionally, performance was significantly poorer for the largest AM-rate separation than for the condition with no AM-rate separation for both groups. The significant effect of sequence duration in both groups indicated that listeners made more improvement with lengthening the duration of stimulus sequences, supporting the build-up effect. The results of this study suggest that CI users are less able than NH listeners to segregate NBN bursts into different auditory streams when they are moderately separated in the spectral domain. Contrary to our hypothesis, our results indicate that AM-rate separation may interfere with the segregation of streams of NBN. Additionally, our results add evidence to the literature that CI users build up stream segregation at a rate comparable to NH listeners, when the inter-stream spectral separations are adequately large. (shrink)

Wagering contingent on a previous decision, or post-decision wagering, has recently been proposed to measure conscious awareness. Whilst intuitively appealing, it remains unclear whether economic context interacts with subjective confidence and how such interactions might impact on the measurement of awareness. Here we propose a signal detection model which predicts that advantageous wagers placed on the identity of preceding stimuli are affected by loss aversion, despite stimulus visibility remaining constant. This pattern of predicted results was evident in a psychophysical (...) task where we independently manipulated perceptual and economic factors. Changes in wagering behaviour induced by changes in wager size were largely driven by changes in criterion, consistent with the model. However, for near-threshold stimuli, a reduction in wagering efficiency was also evident, consistent with an apparent but potentially illusory decrease in awareness of the stimulus. These findings challenge an assertion that post-decision wagering provides a direct index of subjective awareness. (shrink)

Background. Attending to goal-relevant information can leave us metaphorically ‘blind’ or ‘deaf’ to the next relevant information while searching among distracters. This temporal cost lasting for about a half a second on the human selective attention has been long explored using the attentional blink paradigm. Although there is evidence that certain visual stimuli relating to one’s area of expertise can be less susceptible to attentional blink effects, it remains unexplored whether the dynamics of temporal selective attention vary with expertise and (...) objects types in the auditory modality. Methods. Using the auditory version of the attentional blink paradigm, the present study investigates whether certain auditory objects relating to musical and perceptual expertise could have an impact on the transient costs of selective attention. In this study, expert cellists and novice participants were asked to first identify a target sound, and then to detect instrumental timbres of cello or organ, or human voice as a second target in a rapid auditory stream. Results. The results showed moderate evidence against the attentional blink effect for voices independent of participants’ musical expertise. Experts outperformed novices in their overall accuracy levels of target identification and detection, reflecting a clear benefit of musical expertise. Importanly, the musicianship advantage disappeared when the human voices served as the second target in the stream. Discussion. The results are discussed in terms of stimulus salience, the advantage of voice processing, as well as perceptual and musical expertise in relation to attention and working memory performances. (shrink)

The present commentary emphasizes that the acquisition of fear always involves complex changes in several quasi-independent response systems. Stimulus-specific electrodermal response differentiation as well as the bias to overestimate the belongingness of certain stimulus pairs mainly indicates cognitive processes of selective orienting and attention. Emotion, however, also involves the activation of subcortical motivational circuits. Why certain stimuli acquire rapid access to these basic motivational systems is not explained by the expectancy bias model.

According to the evaluativist theory of bodily pain, the overall phenomenology of a painful experience is explained by attributing to it two types of representational content—an indicative content that represents bodily damage or disturbance, and an evaluative content that represents that condition as bad for the subject. This paper considers whether evaluativism can offer a suitable explanation of aversive auditory phenomenology—the experience of awful noises—and argues that it can only do so by conceding that auditory evaluative content (...) would be guilty of widespread error. Defending such an error-theory, moreover, comes with several explanatory costs. (shrink)

Attention is often conceived as a gateway to consciousness . Although endogenous spatial attention may be independent of conscious perception , exogenous spatial orienting seems instead to be an important modulator of CP . Here, we investigate the role of auditory alerting in CP in normal observers. We used a behavioral task in which phasic alerting tones were presented either at unpredictable or at predictable time intervals prior to the occurrence of a near-threshold visual target. We find, for the (...) first time in neurologically intact observers, that phasic alertness increases CP, both objectively and subjectively. This result is consistent with evidence showing that phasic alerting can ameliorate the spatial bias exhibited by visual neglect patients . The alerting network may increase the activity of fronto-parietal networks involved in top-down amplification required to bring a stimulus into consciousness. (shrink)

Though dividing one’s attention between two input streams typically impairs performance, detecting a behaviorally relevant stimulus can sometimes enhance the encoding of unrelated information presented at the same time. Previous research has shown that selection of this kind boosts visual cortical activity and memory for concurrent items. An important unanswered question is whether such effects are reflected in processing quality and functional connectivity in visual regions and in the hippocampus. In this fMRI study, participants were asked to memorize a (...) stream of naturalistic images and press a button only when they heard a predefined target tone. Images could be presented with a target tone, with a distractor tone, or without a tone. Auditory target detection increased activity throughout the ventral visual cortex but lowered it in the hippocampus. Enhancements in functional connectivity between the ventral visual cortex and the hippocampus were also observed following auditory targets. Multi-voxel pattern classification of image category was more accurate on target tone trials than on distractor and no tone trials in the fusiform gyrus and parahippocampal gyrus. This effect was stronger in visual cortical clusters whose activity was more correlated with the hippocampus on target tone than on distractor tone trials. In agreement with accounts suggesting that subcortical noradrenergic influences play a role in the attentional boost effect, auditory target detection also caused an increase in locus coeruleus activity and phasic pupil responses. These findings outline a network of cortical and subcortical regions that are involved in the selection and processing of information presented at behaviorally relevant moments. (shrink)

Asymmetric distribution of function between the cerebral hemispheres has been widely investigated in the auditory modality. The current approach borrows heavily from visual local–global research in an attempt to determine whether, as in vision, local–global auditory processing is lateralised. In vision, lateralised local–global processing likely relies on spatial frequency information. Drawing analogies between visual spatial frequency and auditory dimensions, two sets of auditory stimuli were developed. In the high–low stimulus set we manipulate frequency information, and (...) in the fast–slow stimulus set we manipulate temporal information. The fast–slow stimuli additionally mimic visual hierarchical stimulus structure, in which the arrangement of local patterns determines the global pattern. Unlike previous auditory stimuli, the current stimulus sets contain the experimental flexibility of visual local–global hierarchical stimuli allowing independent manipulation of structural levels. Previous findings of frequency and temporal range priming were replicated. Additionally, by presenting stimuli monaurally, we found that priming of frequency ranges (but not temporal ranges) was found to vary by ear, supporting the contention that the hemispheres asymmetrically retain traces of prior frequency processing. These results contribute to the extensive literature revealing cerebral asymmetries for the processing of frequency information, and extend those results to the realm of priming. (shrink)

Many situations require the simultaneous processing of auditory and visual information, however, stimuli presented to one sensory modality can sometimes interfere with processing in a second sensory modality (i.e., modality dominance). The current study further investigated modality dominance by examining how task demands and bimodal presentation affect speeded auditory and visual discriminations. Participants in the current study had to quickly determine if two words, two pictures, or two word-picture pairings were the same or different, and we manipulated task (...) demands across three different conditions. In an immediate recognition task, there was only one second between the two stimuli/stimulus pairs and auditory dominance was found. Compared to the respective unimodal baselines, pairing pictures and words together slowed down visual responses and sped up auditory responses. Increasing the interstimulus interval to four seconds and blocking verbal rehearsal weakened auditory dominance effects, however, conflicting and redundant visual cues sped up auditory discriminations. Thus, simultaneously presenting pictures and words had different effects on auditory and visual processing, with bimodal presentation slowing down visual processing and speeding up auditory processing. These findings are consistent with a proposed mechanism underlying auditory dominance, which posits that auditory stimuli automatically grab attention and attenuate/delay visual processing. (shrink)

The Temporal-Order Judgment (TOJ) paradigm has been widely investigated in previous studies as an accurate measure of temporal resolution and sequencing abilities in the millisecond time range. Two auditory TOJ tasks are often used: (1) a spatial TOJ task, in which two identical stimuli are presented in rapid succession monaurally and the task is to indicate which ear received the first stimulus and which ear received the second one ( left-right or right-left ), and (2) a spectral TOJ (...) task, in which two tones of different frequencies are presented asynchronously to both ears binaurally and the task is to report the sequence of these tones ( low-high or high-low ). The previous literature studies conducted on young volunteers indicated that the measured temporal acuity on these two tasks depended on the procedure used. As considerable data are now available about age-related decline in temporal resolution ability, the aim of the present study was to compare in elderly subjects the pattern of performance on these two tasks. A total of 40 normal healthy volunteers aged from 62 to 78 years performed two TOJ tasks. The measurement was repeated in two consecutive sessions. Temporal resolution was indexed by the Auditory Temporal-Order Threshold (ATOT), i.e., the minimum time gap between successive stimuli necessary for a participant to report a before-after relation with 75% correctness. The main finding of the present study was the indication of differences in the elderly in performance on two tasks. In the spatial task, the distribution of obtained ATOT values did not deviate from the Gaussian distribution. In contrast, the distribution of data in the spectral task deviated significantly from the Gaussian and was spread more to the right. Although lower ATOT values were usually observed in Session 2 than in Session 1, such difference was significant only in the spectral task. We conclude that although temporal acuity and sequencing abilities in the millisecond time range are probably based in neuronal oscillatory activity, the measured ATOTs in the elderly seem to be stimulus-dependent, procedure-related, and influenced by the perceptual strategies used by participants. (shrink)