To investigate the underlying mechanism of the relationship between visual working memory (VWM) and Chinese character recognition, and the moderation effect of processing efficiency on this relationship, 154 first-grade students were administered a battery of tasks for VWM, rapid temporal processing, and Chinese character reading. In the VWM task, the children were asked to remember the jumping routes of a frog and report these routes in reverse sequence. The longest span for which each participant could respond correctly at (...) least four times out of six was the VWM index. In the task of temporal order judgement, the participants were asked to select which of two balls was presented first, with stimulus onset asynchronies varying from 8 to 492 ms according to an adaptive psychophysical procedure. Visual temporal order threshold (VTOT) was utilized as an indicator of processing efficiency. The participants were asked to read 100 characters aloud to measure their word-level reading abilities in Chinese character recognition. After controlling age, non-verbal intelligence, visual short-term memory, morphological awareness, and orthographic awareness, the results of a moderation effect analysis showed that (1) both VWM and visual VTOT predicted Chinese character reading, and (2) the moderation effect of VTOT on the VWM-reading link was significant ( p = 0.001). The correlation between VWM and Chinese character reading was positive and significant when VTOTs were above average (i.e., smaller than 87.14 ms); however, the correlation was negative at relatively poor levels of VTOTs (i.e., larger than 231.44 ms). (shrink)

We assessed how synchronous speech listening and lipreading affects speech recognition in acoustic noise. In simple audiovisual perceptual tasks, inverse effectiveness is often observed, which holds that the weaker the unimodal stimuli, or the poorer their signal-to-noise ratio, the stronger the audiovisual benefit. So far, however, inverse effectiveness has not been demonstrated for complex audiovisual speech stimuli. Here we assess whether this multisensory integration effect can also be observed for the recognizability of spoken words. To that end, we presented (...) audiovisual sentences to 18 native-Dutch normal-hearing participants, who had to identify the spoken words from a finite list. Speech-recognition performance was determined for auditory-only, visual-only (lipreading) and auditory-visual conditions. To modulate acoustic task difficulty, we systematically varied the auditory signal-to-noise ratio. In line with a commonly-observed multisensory enhancement on speech recognition, audiovisual words were more easily recognized than auditory-only words (recognition thresholds of -15 dB and -12 dB, respectively). We here show that the difficulty of recognizing a particular word, either acoustically or visually, determines the occurrence of inverse effectiveness in audiovisual word integration. Thus, words that are better heard or recognized through lipreading, benefit less from bimodal presentation. Audiovisual performance at the lowest acoustic signal-to-noise ratios (45%) fell below the visual recognition rates (60%), reflecting an actual deterioration of lipreading in the presence of excessive acoustic noise. This suggests that the brain may adopt a strategy in which attention has to be divided between listening and lipreading. (shrink)

Early vision provides general information about the environment that can be used for motor control or navigation and more specialized information that can be used for object recognition. The general information is likely to be insensitive to cognitive factors, but this may not be entirely true for the information used in model-based recognition.

Individuals with Down syndrome (DS) are widely believed to possess considerable socialization strengths. However, the findings on social cognition capabilities are controversial. In the present study, we investigated whether individuals with DS exhibit shortage in face tuning, one of the indispensable components of social cognition. For this purpose, we implemented a recently developed Face-n-Food paradigm with food-plate images composed of food ingredients such as fruits and vegetables. The key benefit of such ‘face like non-face’ images is that single elements do (...) not facilitate face processing. In a spontaneous recognition task, 25 children with DS aged 9 to 18 years were presented with a set of Face-n-Food images bordering on the Giuseppe Arcimboldo style. The set of images was administered in a predetermined order from the least to most resembling a face. In DS individuals, thresholds for recognition of the Face-n-Food images as a face were drastically higher as compared not only with typically developing controls, but also with individuals with autistic spectrum disorders and Williams-Beuren syndrome. This outcome represents a significant step towards better conceptualization of visual social world in DS and neurodevelopmental disorders in general. (shrink)

This study examined self-recognition processing in both the auditory and visual modalities by determining how comparable hearing a recording of one’s own voice was to seeing photograph of one’s own face. We also investigated whether the simultaneous presentation of auditory and visual self-stimuli would either facilitate or inhibit self-identification. Ninety-one participants completed reaction-time tasks of self-recognition when presented with their own faces, own voices, and combinations of the two. Reaction time and errors made when responding with (...) both the right and left hand were recorded to determine if there were lateralization effects on these tasks. Our findings showed that visual self-recognition for facial photographs appears to be superior to auditory self-recognition for voice recordings. Furthermore, a combined presentation of one’s own face and voice appeared to inhibit rather than facilitate self-recognition and there was a left-hand advantage for reaction time on the combined-presentation tasks. (shrink)

This article reviews recent cognitive and neurological approaches to the study of attention. It argues that such research is based on the notion that attention has a positive cognitive function selecting, like a sieve or a filter, elements from the background and foreground, to then be processed by the brain and made conscious when required. These approaches fail to explain cognitive overload and recent findings demonstrating that recognition and understanding—sensory, visual and semantic—also occur prior to attention. Merleau-Ponty and (...) Freud offer a different model: a negative distractive attention. Negative distractive attention serves as a threshold for stimuli excluded by neurological processes regulating overload and ensuring that consciousness can concentrate on the singularity of its objects. Such approach to attention explains how one can drive and talk. It is not a positive multi-tasking model but a negative distractive one. (shrink)

Making recognition decisions often requires us to reference the contents of working memory, the information available for ongoing cognitive processing. As such, understanding how recognition decisions are made when based on the contents of working memory is of critical importance. In this work we examine whether recognition decisions based on the contents of visual working memory follow a continuous decision process of graded information about the correct choice or a discrete decision process reflecting only knowing and (...) guessing. We find a clear pattern in favor of a continuous latent strength model of visual working memory–based decision making, supporting the notion that visual recognition decision processes are impacted by the degree of matching between the contents of working memory and the choices given. Relation to relevant findings and the implications for human information processing more generally are discussed. (shrink)