Three experiments examined repetition priming for meaningful environmental sounds in a sound stem identification paradigm using brief sound cues. Prior encoding of target sounds together with their associated names facilitated subsequent identification of sound stems relative to nonstudied controls. In contrast, prior exposure to names alone in the absence of the environmental sounds did not prime subsequent sound stem identification performance at all . Explicit and implicit memory were dissociated such that sound stem cued recall was higher (...) following semantic than nonsemantic encoding, whereas sound priming was insensitive to manipulations of depth encoding . These results extend the findings of long-term repetition priming into the auditory nonverbal domain and suggest that priming for environmental sounds is mediated primarily by perceptual processes. (shrink)

This study investigates the procedural learning, retention, and reactivation of temporal sensorimotor sequences in children with and without developmental coordination disorder. Twenty typically-developing children and 12 children with DCD took part in this study. The children were required to tap on a keyboard, synchronizing with auditory or visual stimuli presented as an isochronous temporal sequence, and practice non-isochronous temporal sequences to memorize them. Immediate and delayed retention of the audio-motor and visuo-motor non-isochronous sequences were tested by removing auditory (...) or visual stimuli immediately after practice and after a delay of 2 h. A reactivation test involved reintroducing the auditory and visual stimuli after the delayed recall. Data were computed via circular analyses to obtain asynchrony, the stability of synchronization and errors. Firstly, an overall deficit in synchronization with both auditory and visual isochronous stimuli was observed in DCD children compared to TD children. During practice, further improvements were found for the audio-motor non-isochronous sequence compared to the visuo-motor non-isochronous sequence in both TD children and children with DCD. However, a drastic increase in errors occurred in children with DCD during immediate retention as soon as the auditory stimuli were removed. Reintroducing auditory stimuli decreased errors in the audio-motor sequence for children with DCD. Such changes were not seen for the visuo-motor non-isochronous sequence, which was equally learned, retained and reactivated in DCD and TD children. All these results suggest that TD children benefit from both auditory and visual stimuli to memorize the sequence, whereas children with DCD seem to present a deficit in integrating an audio-motor sequence in their memory. The immediate effect of reactivation suggests a specific dependency on auditory information in DCD. Contrary to the audio-motor sequence, the visuo-motor sequence was both learned and retained in children with DCD. This suggests that visual stimuli could be the best information for memorizing a temporal sequence in DCD. All these results are discussed in terms of a specific audio-motor coupling deficit in DCD. (shrink)

A basic function of cognition is to detect regularities in sensory input to facilitate the prediction and recognition of future events. It has been proposed that these implicit expectations arise from an internal predictive coding model, based on knowledge acquired through processes such as statistical learning, but it is unclear how different types of statistical information affect listeners’ memory for auditory stimuli. We used a combination of behavioral and computational methods to investigate memory for non-linguistic auditory (...) sequences. Participants repeatedly heard tone sequences varying systematically in their information-theoretic properties. Expectedness ratings of tones were collected during three listening sessions, and a recognition memory test was given after each session. Information-theoretic measures of sequential predictability significantly influenced listeners’ expectedness ratings, and variations in these properties had a significant impact on memory performance. Predictable sequences yielded increasingly better memory performance with increasing exposure. Computational simulations using a probabilistic model of auditory expectation suggest that listeners dynamically formed a new, and increasingly accurate, implicit cognitive model of the information-theoretic structure of the sequences throughout the experimental session. (shrink)

Analyses of errors from a sequential auditory recall experiment indicated that perceptual factors influence the shape of the serial position curve of recall errors. The signal to noise ratio and presentation rate of the stimuli, as well as presentation rate during a prior training session, affected item and order errors. For experiments in which Ss simply monitored the auditory sequences for a preassigned critical item, and in which items were recalled in addition to monitoring, analyses (...) of montoring RTs provided evidence that the requirement to recall induces perceptual difficulties. (shrink)

The mere presence of irrelevant external stimuli results in interference with the fidelity of details retrieved from long-term memory (LTM). Recent studies suggest that distractibility during LTM retrieval occurs when the focus of resource-limited, top-down mechanisms that guide the selection of relevant mnemonic details is disrupted by representations of external distractors. We review findings from four studies that reveal distractibility during episodic retrieval. The approach cued participants to recall previously studied visual details when their eyes were closed, or (...) were open and irrelevant visual information was present. The results showed a negative impact of the distractors on the fidelity of details retrieved from LTM. An fMRI experiment using the same paradigm replicated the behavioral results and found that diminished episodic memory was associated with the disruption of functional connectivity in whole-brain networks. Specifically, network connectivity supported recollection of details based on visual imagery when eyes were closed, but connectivity declined in the presence of visual distractors. Another experiment using auditory distractors found equivalent effects for auditory and visual distraction during cued recall, suggesting that the negative impact of distractibility is a domain-general phenomenon in LTM. Comparisons between older and younger adults revealed an aging-related increase in the negative impact of distractibility on retrieval of LTM. Finally, a new study that compared categorization abilities between younger and older adults suggests a cause underlying age-related decline of visual details in LTM. The sum of our findings suggests that cognitive control resources, although limited, have the capability to resolve interference from distractors during tasks of moderate effort, but these resources are overwhelmed when additional processes associated with episodic retrieval, or categorization of complex prototypes, are required. (shrink)

Vocal music and spoken language both have important roles in human communication, but it is unclear why these two different modes of vocal communication exist. Although similar, speech and song differ in certain design features. One interesting difference is in the pitch intonation contour, which consists of discrete tones in song, vs. gliding intonation contours in speech. Here, we investigated whether vocal phrases consisting of discrete pitches (song-like) or gliding pitches (speech-like) are remembered better, conducting three studies implementing auditory (...) same-different tasks at three levels of difficulty. We tested two hypotheses: that discrete pitch contours aid auditory memory, independent of musical experience (“song memory advantage hypothesis”), or that the higher everyday experience perceiving and producing speech make speech intonation easier to remember (“experience advantage hypothesis”). We used closely matched stimuli, controlling for rhythm and timbre, and we included a stimulus intermediate between song-like and speech-like pitch contours (with partially gliding and partially discrete pitches). We also assessed participants' musicality to evaluate experience-dependent effects. We found that song-like vocal phrases are remembered better than speech-like vocal phrases, and that intermediate vocal phrases evoked a similar advantage to song-like vocal phrases. Participants with more musical experience were better in remembering all three types of vocal phrases. The precise roles of absolute and relative pitch perception and the influence of top-down vs. bottom-up processing should be clarified in future studies. However, our results suggest that one potential reason for the emergence of discrete pitch–a feature that characterises music across cultures–might be that it enhances auditory memory. (shrink)

There is evidence from neuropsychological and psychophysical measurements that conscious sensory information is processed in discrete time segments. The segmentation process may be described as neuronal activity at a frequency of 40 Hz. Stimulus-induced neuronal activities of this frequency are found in the middle latency range of the auditory evoked potential . First, we have studied the effects of different general anesthetics on MLAEP and auditory evoked 40-Hz activity. Second, we investigated MLAEP and explicit and implicit memory (...) for information presented during cardiac anesthesia. In the awake patients peak latencies of the MLAEP were in the normal range. An auditory evoked 40-Hz activity was present 20–100 ms poststimulus. Under nonspecific anesthetics MLAEP and the 40-Hz activity were suppressed, and under receptor-specific agents MLAEP and the 40-Hz activity were partly preserved. None of the cardiac patients had conscious explicit recall of the intraoperative events, whereas some patients showed unconscious implicit memory for an intraoperative tape message. The implicit memory could be related to midlatency auditory evoked potentials. No implicit memory was detectable when MLAEP and the primary cortical processing of the auditory stimuli and 40-Hz activity were blocked. Implicit memory could be detected in more than 50% of the cases when MLAEP, a 30-Hz activity, and the primary cortical stimulus processing were preserved. In conclusion, our observations support the view that a high frequency oscillatory mechanisms, recorded as a grouped neuronal activity in the MLAEP, may be part of a basic neuronal program for conscious sensory information processing. (shrink)

While we often talk about time using spatial terms, experimental investigation of space-time associations has focused primarily on the space in front of the participant. This has had two consequences: the disregard of the space behind the participant and the creation of potential task demands produced by spatialized manual button-presses. We introduce and test a new paradigm that uses auditory stimuli and vocal responses to address these issues. Participants made temporal judgments about deictic or sequential relationships presented auditorily (...) along a body-centered sagittal or transversal axis. Results involving the transversal axis replicated previous work while sagittal axis results were surprising. Deictic judgments did not use the sagittal axis but sequential judgments did, in a previously undocumented way. Participants associated earlier judgments with the space in front of them and later judgments with the space behind them. These findings, using a new approach, p.. (shrink)

Tactile exploration often involves sequential touches interspersed with stimulus-free durations. Whereas it is obvious that texture-related perceptual variables, irrespective of the encoding strategy, must be stored in memory for comparison, it is rather unclear which of those variables are held in memory. There are two established variables—“intensity” and “frequency”, which are “temporally global” variables because of the long stimulus integration interval required to average the signal or derive spectral components, respectively; on the other hand, a recently established (...) third contender is the “temporally local” variable that codes for kinematic profiles of very short, suprathreshold events in the vibrotactile signal. Here, we present the first psychophysical evidence that temporally local variables can be stored in memory. To that end, we asked participants to detect changes in pulsatile indentation stimuli at their fingertips with and without a gap of 1 s between stimulus presentations. The stimuli either contained global variables alone, or a mix of local and global variables. We found, first, that humans are much better at detecting a change in stimuli when local variables are available rather than global ones alone—as evident by the fact that 21 compared to only 6 participants out of 25 yielded a valid psychophysical curve, respectively. Second, this observation persists even when there is a gap between the stimuli, implying local variables must be stored in memory. Third, an extensive array of relevant intensity definitions failed to explain participants’ performance in any consistent manner, which implies that perceptual decisions were less likely to be driven by intensity coding. Taken together, our results suggest that humans perform pulsatile change detection utilizing local pulse shape, and to a lesser degree global pulse rate, and that both parameters can be stored in memory. (shrink)

Temporal stability and change in neutral contexts can transform continuous experiences into distinct and memorable events. However, less is known about how shifting emotional states influence these memory processes, despite ample evidence that emotion impacts non-temporal aspects of memory. Here, we examined if emotional stimuli influence temporal memory for recent event sequences. Participants encoded lists of neutral images while listening to auditory tones. At regular intervals within each list, participants heard emotional positive, negative, or neutral sounds, (...) which served as “emotional event boundaries” that divided each sequence into discrete events. Temporal order memory was tested for neutral item pairs that either spanned an emotional sound or were encountered within the same auditory event. Encountering a highly arousing event boundary led to faster response times for items encoded within the next event. Critically, we found that highly arousing sounds had different effects on binding ongoing versus ensuing sequential representations in memory. Specifically, highly arousing sounds were significantly more likely to enhance temporal order memory for ensuing information compared to information that spanned those boundaries, especially for boundaries with negative valence. These findings suggest that within aversive emotional contexts, fluctuations in arousal help shape the temporal organisation of events in memory. (shrink)

Language and speech depend on a relatively well defined neural circuitry, located predominantly in the left hemisphere. In this article, I discuss the origin of the speech circuit in early humans, as an expansion of an auditory-vocal articulatory network that took place after the last common ancestor with the chimpanzee. I will attempt to converge this perspective with aspects of the Mirror System Hypothesis, particularly those related to the emergence of a meaningful grammar in human communication. Basically, the (...) strengthening of auditory-vocal connectivity via the arcuate fasciculus and related tracts generated an expansion of working memory capacity for vocalizations, that was key for learning complex utterances. This process was concomitant with the development of a robust interface with visual working memory, both in the dorsal and ventral streams of auditory and visual processing. This enabled the bidirectional translation of sequential codes into hierarchical visual representations, through the development of a multimodal interface between both systems. (shrink)

A proliferation of tests exists for the assessment of auditory-verbal memory processes. However, from a clinical practice perspective, the situation is less clear when it comes to the ready availability of reliable and valid tests for the evaluation of visual/visuo-spatial memory processes. While, at face value, there appear to be a wide range of available tests of visual/visuo-spatial memory, utilizing different types of materials and assessment strategies, a number of criticisms have been, and arguably should be, (...) leveled at the majority of these tests. The criticisms that have been directed toward what are typically considered to be visual/visuo-spatial memory tests, such as the potential for verbal mediation, over-abstraction of stimuli, the requirement of a drawing response, and the lack of sensitivity to unilateral brain lesions, mean that, in reality, the number of readily available valid tests of visual/visuo-spatial memory is, at best, limited. This article offers a critical, historical review on the existing measures and resources for the neuropsychological assessment of visual/visuo-spatial memory, and it showcases some examples of newer tests that have aimed to overcome the challenges of assessing these important aspects of memory. The article also identifies new trends and examples of how technological advances such as virtual reality may add value to overcome previous obstacles to assessment, thereby offering professionals more reliable, accurate means to evaluate visual/visuo-spatial memory in clinical practice. (shrink)

Alexithymia is associated with emotion processing deficits, particularly for negative emotional information. However, also common are a high prevalence of somatic symptoms and the perception of somatic sensations as distressing. Although little research has yet been conducted on memory in alexithymia, we hypothesized a paradoxical effect of alexithymia on memory. Specifically, recall of negative emotional words was expected to be reduced in alexithymia, while memory for illness words was expected to be enhanced in alexithymia.Eighty-five high or (...) low alexithymia participants viewed and rated arousing illness-related , emotionally positive , negative , and neutral words . Recall was assessed 45 min later.High alexithymia participants recalled significantly fewer negative emotion words but also more illness-related words than low alexithymia participants. The results suggest that personal relevance can shape cognitive processing of stimuli, even to enhance retention of a subclass of stimuli whose retention is generally impaired in alexithymia. (shrink)

Consideration of affective dimensions beyond arousal may be useful for a more precise understanding of the effects of emotional events on episodic memory. As highlighted by Kensinger (2009), the valence of an event may differentially impact the accuracy of its recall. Paralleling work on attention, we propose that the relevance of an event or stimulus for survival may also importantly modulate memory accuracy. However, few memory studies to date have accounted for motivational relevance, and the stimuli (...) employed in most studies are not matched on this dimension. (shrink)

Over the last decade, attention has crawled from out of the shadows into the philosophical limelight with several important books and widely read articles. Carolyn Dicey Jennings has been a key player in the attention revolution, actively publishing in the area and promoting awareness. This book was much anticipated by insiders and does not disappoint. It is in no way redundant with respect to other recent monographs, covering both a different range of material and developing novel positions throughout. The book (...) might have been called The Attending Self, since Jennings defines attention as mental prioritization controlled by the self. This invocation of the self is among her central innovations, and may prove to be the main source of controversy. I will highlight points of contention here, but want to emphasize at the outset that the book is essential reading for anyone interested in attention. Jennings also contributes to a range of other debates, which will help a broader audience appreciate the importance this topic.After a brief introduction, Jennings provides “a philosophical landscape” of attention (chap. 2), tracing the concept through history. This is an invaluable achievement that will be welcomed by both newcomers and veterans. Jennings exhibits enormous breadth, covering areas that contemporary philosophers of mind tend to neglect: medieval philosophy, Buddhist thought, and phenomenology, to name a few. We also get perspectives on attention from core figures in the Western canon, such as Descartes, Locke, and Kant, as well as thinkers who gave the topic a more political inflection: Mary Wollstonecraft and W. E. B. DuBois. Jennings surveys contemporary literature as well, locating recent work in these older lineages. Some authors get more treatment later in the book (e.g., William James and Wayne Wu). Overall, Jennings provides the best overview of this history I have seen. She proves that attention is not a new topic, but one with deep roots and one that can inform current debates; Jennings draws on these roots throughout. I would love to see a companion piece surveying scientific theories, including “gain control” and “biased competition,” which get little airtime in the book. Some recent philosophical theories are under-explored as well, including Chris Mole’s concept of cognitive unison (Jennings discusses other aspects of his view), Carlos Montemayor and Harry Haladjian’s exploration of attention’s diversity (we get a touch of this), and my own proposal that attention is a gateway to working memory (not mentioned here). That said, no extant survey is more complete.Chapter 3 begins with the empirical claim that attention is regulated by slow brainwaves, and then takes up two issues. The first is mental causation. Endorsing moderate emergentism, Jennings argues that slow brain waves are causally efficacious even though they are not reducible to lower-level processes. (The metaphysics and neuroscience are presented accessibly, aided by three appendixes.) Second, Jennings argues that these slow brain waves indicate that attention is controlled by the self. As someone who was never moved by the mental causation problem—I don’t think overdetermination threatens efficacy—I would have welcomed more development of this second issue. For one thing, in linking attention to subjective control, Jennings eschews the idea that there can be purely “bottom-up” attention driven by stimulus features alone. This goes against the orthodoxy in attention science, and makes it hard for her to accommodate phenomena such as “pop-out,” or the commonsense idea that attention can be “captured” by a sudden flash or loud sound. For another thing, I wanted to hear more on why Jennings relates slow brain waves to the self. Does this include the slow waves that occur during deep sleep? Is there even such a thing as the self? Is there one self or many? How do slow brain waves reflect our interests, projects, values, self-conceptions, autobiographical narratives, or social identities? Does the social self invoked by Wollstonecraft and DuBois gain a foothold here? The whole chapter campaigns against metaphysical reductionism, but arrives at a perspective on the self that will strike some readers as highly reductive.In the fourth chapter, Jennings sheds further light on her conjecture that attention involves the self by advancing the thesis that attention endows sensory information with meaning. On the face of it, this may sound implausible. Object recognition, reading, and many other meaning-involving processes can take place outside of attention and outside of consciousness. But Jennings has a richer notion of “meaning” in mind. She develops the idea of “subject unity,” which is imposition of structure on perception that reflects the interests of the perceiving subject. This, she claims, is what brings perception into the space of reasons. Along the way, she has interesting observations about binding, feature integration, and demonstrative reference. The material is highly original, and Jennings’s postulation of interest-based perceptual organization is compelling. At the same time, one might wonder whether interests are really relegated to the ambit of attentional control. Consider the cocktail party effect, wherein one’s own name captures attention. This implies a preattentive filter that reflects our interests. Emotionally charged words, facial expressions, and dangerous objects also work this way, and social biases can operate preattentively as well. If these reflect our interests, then meaning may arise outside attention.Jennings’s fifth chapter explores the relationship between attention and consciousness. Some authors have argued that attention is necessary and sufficient for consciousness. Jennings focuses primarily on the necessity claim. She does not systematically review the empirical literature here, but she addresses some of the key findings, and effectively rebuts studies that allege to find consciousness outside attention. She does not rest her case there, however. Instead, she identifies a new class of examples that purport to establish the possibility of consciousness without attention. Her central example she calls “conscious entrainment,” which is what we experience when engaged in habitual or skilled activities. Other possible examples touched on in the chapter include hypervigilance in individuals with attention deficit hyperactivity disorder (ADHD), passive movie watching, dreaming, and “attentional neglect.” These states all involve intense focus, Jennings admits, but not attention. To some readers this may sound contradictory. Isn’t focus a kind of attention? Don’t these states of absorption involve stimulus selection and enhancement of relevant features, suppression of distractors, and other hallmarks of attention? Jennings says none of this is tantamount to attention. Recall that she thinks attention is controlled by the self. In these cases, we are invited to imagine that the self takes a passive role: control is either ceded to the world (movie watching) or to previously mastered routines (skills and habits). Thus, Jennings’s claim that there is no attention in these cases hangs on her contentious thesis that attention requires a controlling self. One might also push back by arguing that, in some of Jennings’s allegedly selfless examples, the self remains involved. Skilled activities and hypervigilance, for example, can reflect personal interests.Skills and hypervigilance get more airtime in chapter 6. There, Jennings turns to questions of responsibility—a neglected topic in attention research. The chapter begins with a manslaughter trial in which the teenage plaintiff was given a light sentence because the judge evidently believed that the teen’s ADHD compromised his ability to control his actions. The example may be a bit triggering for people who have a personal relationship with this diagnosis, but, putting that aside, Jennings uses it to introduce the important concept of attention-based control. With reduced control, Jennings argues, comes reduced responsibility. I am inclined to see ADHD as involving dysregulation of attention (difficulty disengaging and dividing attention, for example) rather than diminished attention, but that can still be characterized as an issue with control of attention; therefore ADHD still illustrates Jennings’s point that there is a link between responsibility and control of attention. This, it turns out, is only half of her story. Having argued for this link, one might expect Jennings to follow Wayne Wu, who contends that attention is necessary for action, and hence for responsibility. She does not. Instead, she says argues that responsibility can also arise in cases of “strategic automaticity.” This brings us back to skills. When skills are deployed, action is governed by learned pairings between stimuli and responses. The choice to exercise a skill requires attention, so attention is needed for being a responsible agent, but once a skill kicks in, attention is no longer required, and one can be held responsible for actions performed skillfully—thus attention is not required for responsibility tout court. Jennings addresses an opposing view (defended by Wu, Ellen Fridland, and Barbara Montero), according to which skills involve “automatic attention” rather than no attention. Jennings worries that this move will collapse the distinction between attention and other kinds of selection and filtering that occur throughout the nervous system, including the retina. She says that the attentional interpretation of skilled action is at odds with the lack of top-down reweighing of sensory inputs, regulated by lateral frontal cortex. These objections to automatic attention warrant response. My own view is that attention involves broadcasting to working memory, so retinal filtering is ruled out. Jennings’s insistence on top-down reweighing will not move those who believe attention can be purely bottom-up. For all that, I side with Jennings in wanting to allow for responsibility without attentional control. I think we can be responsible for implicit biases, for example. I also think attentional control is insufficient for responsibility, as when we act under duress.Jennings offers fresh perspective on the nature of attention, and its role in meaningful perception, consciousness, action, and responsibility. Each chapter can be read separately, but they hang together well, and each reflects her thesis that attention is essentially linked to the self. Though I am skeptical of that strong claim, we would do well to follow Jennings in regarding attention as interest-laden interface between mind and world. I look forward to a sequel in which attention is related to richer conceptions of identity, and where the political consequences of this link are actively explored. Meanwhile, one can hardly fault Jennings for covering too little. She tackles a remarkable range of topics, from metaphysics to ethics. Her arguments throughout demand response, repay careful study, and propel the field forward. (shrink)

Research has shown that gesture production supports learning across a number of tasks. It is unclear, however, whether gesture production during encoding can support narrative recall, who gesture production benefits most, and whether certain types of gestures are more beneficial than others. This study, therefore, investigated the effect of gesture production during the encoding of a narrative on subsequent narrative recall, and whether individuals’ levels of verbal and nonverbal memory moderated this effect. Additionally, this study investigated (...) whether producing certain types of gestures during encoding was more beneficial than others. Participants (N = 90, Mage = 20.43) read aloud a narrative while under instruction to produce gestures, under no specific instruction to produce gestures, or were required to keep their hands behind their back to prevent them from gesturing. Participants completed measures assessing verbal and nonverbal memory. While gesture production during encoding benefitted narrative recall (as measured through specific questions), verbal memory moderated the effect, such that gesture production was more beneficial for individuals with higher than lower verbal memory. Furthermore, producing representational gestures during encoding benefitted recall of points in the narrative at which those gestures were produced, while beat gestures had no effect. Findings have implications for understanding the mechanisms underlying the links between gesture and learning, as well as practical implications in instructional settings. (shrink)

Emotional stimuli are consistently better remembered than neutral stimuli. However, the reported effects of emotional stimuli on source memory are less consistent. In four experiments, we examined spatial and temporal source memory and free recall for emotional words previously studied in an fMRI experiment. In the fMRI experiment, the unpleasant but not the pleasant words were shown to activate the amygdala. In the experiments reported here, spatial and temporal source memory were reduced for the unpleasant words (...) compared to pleasant and neutral words. Reduced spatial memory for unpleasant words was observed across studies that varied the specific stimuli, task conditions, and incidental versus intentional encoding instructions. Free recall was enhanced for the pleasant and unpleasant words compared to neutral words. The results demonstrate reduced source memory for unpleasant words even when item recall is enhanced. Our findings are consistent with prior reports of amygdala-mediated amnestic effects evoked by unpleasant stimuli. (shrink)

This paper is divided into two parts. Part I focuses on the manner in which the components of the face recognition system work together so that a perceiver, within several hundred milliseconds after seeing a familiar face, is able to both identify the face of the perceived and recall elements of the history of past encounters with the perceived. Face recognition plays a crucial role in enabling both human and nonhuman primates to interact in collaborative social groups. This critical (...) function is accomplished through the unidirectional coded transfer of informational elements from one component to another. Although these informational elements themselves are not meaningful to the perceiving agent, they do nevertheless contain essential bits of information that are necessary for the final formation of the meaningful message. The structural components of the system are identified and the manner in which informational elements are coded and transferred sequentially from component to component in the brain of the perceiver is described. The independent, physically separated components in the face recognition system are bridged by an additional component, an “adaptor”, that mediates the transfer of informational elements from one component to another. The nature of the independent systems, and the manner by which the bridging or adaptor apparatus enables coded information transfer from one system to another is discussed. Part II focuses on the analysis of recognition in human-designed sign systems such as Braille and Morse code. Recognition in human-designed sign systems is notable for the stability of the link between sign and meaning. Face recognition is characterized as being subjective, indicating that the meaning of a sign to a perceiver is variable and dependent on context, whereas human-devised sign recognition is characterized as being objective, indicating that the meaning of a sign is context independent and invariant. Human-designed sign systems require the presence in brain of a referent world. An example of a referent world is the set of letters of the alphabet. Representations of this set are installed in the brain through social mediated learning. Human-designed sets of signs are created to correspond, via a code enabling adaptor structure, to referent worlds in the brain. Human-designed sign systems are the foundations for literacy, a capability only found in humans. (shrink)

Spatial region concepts such as “front,” “back,” “left,” and “right” reflect our typical interaction with space, and the corresponding surrounding regions have different statuses in memory. We examined the representation of spatial directions in the auditory space, specifically in how far natural response actions, such as orientation movements toward a sound source, would affect the categorization of egocentric auditory space. While standing in the middle of a circle with 16 loudspeakers, participants were presented acoustic stimuli coming from (...) the loudspeakers in randomized order, and verbally described their directions by using the concept labels “front,” “back,” “left,” “right,” “front-right,” “front-left,” “back-right,” and “back-left.” Response actions varied in three blocked conditions: (1) facing front, (2) turning the head and upper body to face the stimulus, and (3) turning the head and upper body plus pointing with the hand and outstretched arm toward the stimulus. In addition to a protocol of the verbal utterances, motion capture and video recording generated a detailed corpus for subsequent analysis of the participants’ behavior. Chi-square tests revealed an effect of response condition for directions within the left and right sides. We conclude that movement-based response actions influence the representation of auditory space, especially within the sides’ regions. Moreover, the representation of auditory space favors the front and the back regions in terms of resolution, which is possibly related to the physiological characteristics of the human auditory system, as well as to the ecological requirements of action control in the different regions. (shrink)

In a century where humans and machines—powered by artificial intelligence or not—increasingly work together, it is of interest to understand human processing of multi-sensory stimuli in relation to attention and working memory. This paper explores whether and when supporting visual information with rhythmic auditory stimuli can optimize multi-sensory information processing. In turn, this can make the interaction between humans or between machines and humans more engaging, rewarding and activating. For this purpose a novel working memory paradigm was (...) developed where participants are presented with a series of five target digits randomly interchanged with five distractor digits. Their goal is to remember the target digits and recall them orally. Depending on the condition support is provided by audio and/or rhythm. It is expected that the sound will lead to a better performance. It is also expected that this effect of sound is different in case of rhythmic and non-rhythmic sound. Last but not least, some variability is expected across participants. To make correct conclusions, the data of the experiment was statistically analyzed in a classic way, but also predictive models were developed in order to predict outcomes based on a range of input variables related to the experiment and the participant. The effect of auditory support could be confirmed, but no difference was observed between rhythmic and non-rhythmic sounds. Overall performance was indeed affected by individual differences, such as visual dominance or perceived task difficulty. Surprisingly a music education did not significantly affect the performance and even tended toward a negative effect. To better understand the underlying processes of attention, also brain activation data, e.g., by means of electroencephalography, should be recorded. This approach can be subject to a future work. (shrink)

Idiopathic Parkinson’s disease impairs working memory, but the exact nature of this deficit in terms of the underlying cognitive mechanisms is not well understood. In this study patients with mild clinical symptoms of PD were compared with matched healthy control subjects on a computerized battery of tests designed to assess spatial working memory and verbal working memory. In the spatial working memory task, subjects were required to recall a sequence of four locations. The verbal working (...) memory task was methodologically identical except for the modality of the stimuli used, requiring subjects to orally recall a sequence of six digits. In either case, half of the sequences were structured in a way that allowed ‘chunking’, while others were unstructured. This manipulation was designed to dissociate the strategic component of task performance from the memory-load component. Mild medicated patients with PD were impaired only on the structured versions of the verbal working memory tasks. The analogous deficit in the spatial working memory was less pronounced. These findings are in agreement with the hypothesis that working memory deficits in PD reflect mainly the executive component of the tasks and that the deficits may be at least partly modality-independent. (shrink)

Using a paradigm that allows a quasi-continuous tracking of memory performance over time, two experiments were designed to test the hypotheses that persons with a cognitively avoidant style of coping with threat manifest a dissociation between short-term and long-term retrieval of aversive information and persons with a vigilant coping style recall aversive information particularly well after long retention intervals, provided they are free to think about aversive events. Study 1 showed that avoiders manifest a poor memory for (...) aversive pictures after long retention intervals only. Study 2 replicated this finding. In addition, manipulation of the cognitive load during the retention interval influenced vigilants’ recall of aversive information in the predicted way. Results indicate that processes occurring during the retention interval are essential for individual difference in memory for aversive information and require similar attention as encoding, appraisal, and retrieval processes. (shrink)

Actions shape what we see and memorize. A previous study suggested the interaction between motor and memory systems by showing that memory encoding for task-irrelevant items was enhanced when presented with motor-response cues. However, in the studies on the attentional boost effect, it has been revealed that detection of the target stimulus can lead to memory enhancement without requiring overt action. Thus, the direct link between the action and memory remains unclear. To exclude the effect of (...) the target detection process as a potential confounder, this study assessed the benefit of action for memory by separating items from the response cue in time. In our pre-registered online experiment, participants responded to visual Go cues by pressing a key or counting while ignoring No-go cues. In each trial, two task-irrelevant images were sequentially presented after the cue disappearance. After encoding the Go/No-go tasks, participants performed a surprise recognition memory test for those images. Importantly, we quantified the impact of overt execution of the action by comparing memories with and without motor response and the impact of covert motor processes by comparing memory between the motor and cognitive tasks. The results showed no memory differences between Go and No-go trials in the motor task. This means that the execution itself was not critical for memory enhancement. However, the memory performance in the motor No-go trials was higher than that in the cognitive No-go trials, only for the items presented away from the cues in time. Therefore, engaging the motor task itself could increase incidental memory for the task-irrelevant items compared to a passive viewing situation. We added empirical evidence on the online interaction between action and memory encoding. These memory advantages could be especially brought in action preparation and planning. We believe this fact may expand our present understanding of everyday memory, such as active learning. (shrink)

Speech unfolds over time, and the cues for even a single phoneme are rarely available simultaneously. Consequently, to recognize a single phoneme, listeners must integrate material over several hundred milliseconds. Prior work contrasts two accounts: (a) a memory buffer account in which listeners accumulate auditory information in memory and only access higher level representations (i.e., lexical representations) when sufficient information has arrived; and (b) an immediate integration scheme in which lexical representations can be partially activated on the (...) basis of early cues and then updated when more information arises. These studies have uniformly shown evidence for immediate integration for a variety of phonetic distinctions. We attempted to extend this to fricatives, a class of speech sounds which requires not only temporal integration of asynchronous cues (the frication, followed by the formant transitions 150–350 ms later), but also integration across different frequency bands and compensation for contextual factors like coarticulation. Eye movements in the visual world paradigm showed clear evidence for a memory buffer. Results were replicated in five experiments, ruling out methodological factors and tying the release of the buffer to the onset of the vowel. These findings support a general auditory account for speech by suggesting that the acoustic nature of particular speech sounds may have large effects on how they are processed. It also has major implications for theories of auditory and speech perception by raising the possibility of an encapsulated memory buffer in early auditory processing. (shrink)

Four experiments were conducted to evaluate explanations of picture superiority effects previously found for several tasks. In a process dissociation procedure with word stem completion, picture fragment completion, and category production tasks, conscious and automatic memory processes were compared for studied pictures and words with an independent retrieval model and a generate-source model. The predictions of a transfer appropriate processing account of picture superiority were tested and validated in “process pure” latent measures of conscious and unconscious, or automatic and (...) source, memory processes. Results from both model fits verified that pictures had a conceptual processing advantage over words for all tasks. The effects of perceptual compatibility depended on task type, with pictorial tasks favoring pictures and linguistic tasks favoring words. Results show support for an explanation of the picture superiority effect that involves an interaction of encoding and retrieval processes. (shrink)

Recent evidence comparing recognition memory for famous faces and famous voices reveals an advantage for faces to elicit greater levels of episodic and semantic information than voices, even when overall levels of difficulty are matched between the two modalities. The paper by Barsics and Brédart makes a significant advance to this literature by demonstrating that even when encoding strategies are maximized to favor voice over face encoding by using personally familiar stimuli, facial cues continue to provide a more successful (...) means for associating episodic and semantic memories than voices. The implications of these findings are discussed in terms of the role of familiarity and its associated links to semantic memory as captured by person recognition memory models. (shrink)

Previous work suggests that threat-related stimuli are stored to a greater degree in working memory compared to neutral stimuli. However, most of this research has focused on stimuli with physically salient threat attributes, failing to account for how a “neutral” stimulus that has acquired threat-related associations through differential aversive conditioning influences working memory. The current study examined how differentially conditioned safe and threat stimuli are stored in working memory relative to a novel, non-associated stimuli. Participants completed a (...) differential fear conditioning task followed by a change detection task consisting of three conditions across two loads. Results revealed individuals successfully learned to distinguishing CS+ from CS– conditions during the differential aversive conditioning task. Our working memory outcomes indicated successful load manipulation effects, but no statistically significant differences in accuracy, response time, or Pashler’s K measures of working memory capacity between CS+, CS–, or N conditions. However, we observed significantly reduced RT difference scores for the CS+ compared to CS– condition, indicating greater RT differences between the CS+ and N condition vs. the CS– and N condition. These findings suggest that differentially conditioned stimuli have little impact on behavioral outcomes of working memory compared to novel stimuli that had not been associated with previous safe of aversive outcomes, at least in healthy populations. (shrink)

It has been well documented that the auditory system in the superior temporal cortex is responsible for processing basic auditory sound features, such as sound frequency and intensity, while the prefrontal cortex is involved in higher-order auditory functions, such as language processing and auditory episodic memory. The temporal auditory cortex has vast forward anatomical projections to the prefrontal auditory cortex, connecting with the lateral, medial, and orbital parts of the prefrontal cortex. The connections (...) between the auditory cortex and the prefrontal cortex thus help in localizing, recognizing, and comprehending external auditory inputs. In addition, the medial prefrontal cortex (MPFC) is believed to be a core region of episodic memory retrieval and is one of the most important regions in the default mode network (DMN). However, previous neural evidence with regard to the comparison between basic auditory processing and auditory episodic memory retrieval mainly comes from fMRI studies. The specific neural networks and the corresponding critical frequency bands of neuronal oscillations underlying the two auditory functions remain unclear. In the present study, we reported results of direct cortical stimulations during stereo-electro-encephalography (SEEG) recording in a patient with drug-resistant epilepsy. Electrodes covered the superior temporal gyrus, the operculum and the insula cortex of bilateral hemispheres, the prefrontal cortex, the parietal lobe, the anterior and middle cingulate cortex, and the amygdala of the left hemisphere. Two types of auditory hallucinations were evoked with direct cortical stimulations, which were consistent with the habitual seizures. The noise hallucinations, i.e., “I could hear buzzing noises in my head,” were evoked with the stimulation of the superior temporal gyrus. The episodic memory hallucinations “I could hear a young woman who was dressed in a red skirt saying: What is the matter with you?,” were evoked with the stimulation of MPFC. The patient described how she had met this young woman when she was young and that the woman said the same sentence to her. Furthermore, by analyzing the high gamma power (HGP) induced by direct electrical stimulation, two dissociable neural networks underlying the two types of auditory hallucinations were localized. Taken together, the present results confirm the hierarchical processing of auditory information by showing the different involvements of the primary auditory cortex vs. the prefrontal cortex in the two types of auditory hallucinations. (shrink)

This study investigated visual statistical learning (VSL) in 24 deaf signers and 24 hearing non‐signers. Previous research with hearing individuals suggests that SL mechanisms support literacy. Our first goal was to assess whether VSL was associated with reading ability in deaf individuals, and whether this relation was sustained by a link between VSL and sign language skill. Our second goal was to test the Auditory Scaffolding Hypothesis, which makes the prediction that deaf people should be impaired in sequential (...) processing tasks. For the VSL task, we adopted a modified version of the triplet learning paradigm, with stimuli presented sequentially across space and time. Results revealed that measures of sign language skill (sentence comprehension/repetition) did not correlate with VSL scores, possibly due to the sequential nature of our VSL task. Reading comprehension scores (PIAT‐R) were a significant predictor of VSL accuracy in hearing but not deaf people. This finding might be due to the sequential nature of the VSL task and to a less salient role of the sequential orthography‐to‐phonology mapping in deaf readers compared to hearing readers. The two groups did not differ in VSL scores. However, when reading ability was taken into account, VSL scores were higher for the deaf group than the hearing group. Overall, this evidence is inconsistent with the Auditory Scaffolding Hypothesis, suggesting that humans can develop efficient sequencing abilities even in the absence of sound. (shrink)

People often remember what they attend to in the world. Such memory can be cast as a kind of mental catalog or index of attended objects. To investigate how such an index is acquired and used, protocol data were collected from a programmer who scrolled to off‐screen objects from time to time as she worked. These protocol data were modeled using Soar, which constrains how the index is constructed. In the model, an index entry is an episodic trace encoded (...) during attention. The trace associates the attention event with a time symbol denoting the event's occurrence. Later, the model can ask itself whether it saw that object by calling to mind an image of the attention event. If this image retrieves a time symbol, then the model infers that the object exists and can reason about bringing the object back into view. Episodic indexing is a theory of these encoding and retrieval processes. It posits that information about attention events is encoded automatically, but that retrieval requires effort and knowledge. Episodic indexing is congruent with a range of results on episodic and temporal codes and recognition and recall processes. It incorporates source monitoring (Johnson, Hashtroudi, & Lindsay, 1993) and is a simple and pervasive form of long‐term working memory (Ericsson & Kintsch, 1995). (shrink)

Are idioms stored in memory in ways that preserve their surface form or language or are they represented amodally? We examined this question using an inci- dental cued recall paradigm in which two word idiomatic expressions were presented to adult bilinguals proficient in Russian and English. Stimuli included phrases with idiomat- ic equivalents in both languages (e.g. “empty words/пycтыe cлoвa”) or in one language only (English—e.g. “empty suit/пycтoй кocтюм” or Russian—e.g. “empty sound/пycтoй звyк”), or in neither language (e.g. (...) “empty rain/пycтoй дoждь”). If idioms are stored in a language-specific format, then phrases with idiomatic equivalents in both languages would have dual representation, and should therefore be more easily recalled than phrases with idiomatic meaning in only one language. This result was obtained. As such, the findings support the dual-coding theory of memory and are also compatible with models of the bilingual lexicon that include language tags or nodes. (shrink)

The computations involved in statistical learning have long been debated. Here, we build on work suggesting that a basic memory process, chunking, may account for the processing of statistical regularities into larger units. Drawing on methods from the memory literature, we developed a novel paradigm to test statistical learning by leveraging a robust phenomenon observed in serial recall tasks: that short‐term memory is fundamentally shaped by long‐term distributional learning. In the statistically induced chunking recall (SICR) (...) task, participants are exposed to an artificial language, using a standard statistical learning exposure phase. Afterward, they recall strings of syllables that either follow the statistics of the artificial language or comprise the same syllables presented in a random order. We hypothesized that if individuals had chunked the artificial language into word‐like units, then the statistically structured items would be more accurately recalled relative to the random controls. Our results demonstrate that SICR effectively captures learning in both the auditory and visual modalities, with participants displaying significantly improved recall of the statistically structured items, and even recall specific trigram chunks from the input. SICR also exhibits greater test–retest reliability in the auditory modality and sensitivity to individual differences in both modalities than the standard two‐alternative forced‐choice task. These results thereby provide key empirical support to the chunking account of statistical learning and contribute a valuable new tool to the literature. (shrink)

In an item-method directed forgetting paradigm, participants were required to attend to one of two colored words presented on opposite sides of a central fixation stimulus; they were instructed to Remember or Forget the attended item. On a subsequent recognition test, the Attended words showed a typical directed forgetting effect with better recognition of Remember words than Forget words. Our interest was in the fate of the Unattended words. When the study display disappeared before the memory instruction, there was (...) no effect of that instruction on unattended words; when the study display remained visible during presentation of the memory instruction, there was a reverse directed forgetting effect with better recognition of unattended words from Forget trials than from Remember trials. Incidental encoding of task-irrelevant stimuli occurs following presentation of a Forget instruction – but only when those task-irrelevant stimuli are still visible in the external environment. (shrink)

The purpose of this study is to take preliminary steps to unify psychoacoustic techniques with reaction-time methodologies to address the perceptual mechanisms responsible for the detection of one vs. multiple sounds. We measured auditory redundancy gains for auditory detection of pure tones widely spaced in frequency using the tools of Systems Factorial Technology to evince the system architecture and workload capacity in two different scenarios. We adopted an experimental design in which the presence or absence of a target (...) at each of two frequencies was combined factorially with two stimulus levels. Replicating previous work, results did not allow an assessment of system architecture due to a failure to observe factor influence at the level of distribution ordering for dual-target stimuli for both SOFT and LOUD scenarios. All subjects demonstrated very modest redundancy gains for the dual-target compared to the single-target stimuli, and results were similar for both LOUD and SOFT. We propose that these results can be predicted by a mental architecture that falls into the class of integrated subadditive parallel systems, using a well-supported assumption that reaction time is driven by loudness. We demonstrate that modeled loudness of the experimental sounds is highly correlated with mean reaction time, and we provide a proof-of-concept model based on Steven’s Power law that predicts both a failure of distributional ordering for dual-target stimuli and very modest redundancy gains. (shrink)