Eye gaze plays an important role in communication but understanding of its actual function or functions and the methods used to elucidate this have varied considerably. This systematized review was undertaken to summarize both the proposed functions of eye gaze in conversations of healthy adults and the methodological approaches employed. The eligibility criteria were restricted to a healthy adult population and excluded studies that manipulated eye gaze behavior. A total of 29 articles—quantitative, qualitative and mixed methods were (...) returned, with a wide range of methodological designs. The main areas of variability related to number of conversants, their familiarity and status, conversation topic, data collection tools—video and eye tracking—and definitions of eye gaze. The findings confirm that eye gaze facilitates turn yielding, plays a role in speech monitoring, prevents and repairs conversation breakdowns and facilitates intentional and unintentional speech interruptions. These findings were remarkably consistent given the variability in methods across the 29 articles. However, in relation to turn initiation, the results were less consistent, requiring further investigation. This review provides a starting point for future studies to make informed decisions about study methods for examining eye gaze and selecting variables of interest. (shrink)

ABSTRACTFractions are defined by numerical relationships, and comparing two fractions’ magnitudes requires within-fraction and/or between-fraction relational comparisons. To better understand how individuals spontaneously reason about fractions, we collected eye-tracking data while they performed a fraction comparison task with conditions that promoted or obstructed different types of comparisons. We found evidence for both componential and holistic processing in this mixed-pairs task, consistent with the hybrid theory of fraction representation. Additionally, making within-fraction eye movements on trials that promoted a between-fraction comparison strategy (...) was associated with slower responses. Finally, participants who performed better on a non-numerical test of reasoning took longer to respond to the most difficult fraction trials, which suggests that those who had greater facility with non-numerical reasoning attended more to numerical relationships. These findings extend pri... (shrink)

Previous research has shown that angry and happy faces are perceived as less emotionally intense when shown with averted versus direct gaze. Other work reports that long-term memory for angry faces was poorer when they were encoded with averted versus direct gaze, suggesting that threat signals are diluted when eye contact is not engaged. The current study examined whether gaze modulates working memory for angry and happy faces. In stark contrast to LTM effects, WM for angry faces (...) was not significantly modulated by gaze direction. However, WM for happy faces was significantly enhanced when gaze was averted versus direct. These findings suggest that in WM – when rapid processing and an immediate response is required – averted gaze may alter the meaning behind a smile, and make this kind of expression particularly salient for short-term processing. (shrink)

Niedenthal et al. discuss the importance of eye gaze in embodied simulation and, more globally, in the processing of emotional visual stimulation (such as facial expression). In this commentary, we illustrate the relationship between oriented eye movements, consciousness, and emotion by using the case of severely brain-injured patients recovering from coma (i.e., vegetative and minimally conscious patients).

Journal Name: Cognitive Linguistics Issue: Ahead of print.

Eye-tracking is increasingly studied as a cognitive and biological marker for the early signs of neuropsychological and psychiatric disorders. However, in order to make further progress, a more comprehensive understanding of the age-related effects on eye-tracking is essential. The antisaccade task requires participants to make saccadic eye movements away from a prepotent stimulus. Speculation on the cause of the observed age-related differences in the antisaccade task largely centers around two sources of cognitive dysfunction: inhibitory control (IC) and working memory (WM). (...) The IC account views cognitive slowing and task errors as a direct result of the decline of inhibitory cognitive mechanisms. An alternative theory considers that a deterioration of WM is the cause of these age-related effects on behavior. The current study assessed IC and WM processes underpinning saccadic eye movements in young and older participants. This was achieved with three experimental conditions that systematically varied the extent to which WM and IC were taxed in the antisaccade task: a memory-guided task was used to explore the effect of increasing the WM load; a Go/No-Go task was used to explore the effect of increasing the inhibitory load; a ‘standard’ antisaccade task retained the standard WM and inhibitory loads. Saccadic eye movements were also examined in a control condition: the standard prosaccade task where the load of WM and IC were minimal or absent. Saccade latencies, error rates and the spatial accuracy of saccades of older participants were compared to the same measures in healthy young controls across the conditions. The results revealed that aging is associated with changes in both IC and WM. Increasing the inhibitory load was associated with increased reaction times in the older group, while the increased WM load and the inhibitory load contributed to an increase in the antisaccade errors. These results reveal that aging is associated with changes in both IC and WM. (shrink)

The well-known impairments in the social use of eye-gaze by children with autism have been chiefly explored through experimental methods. The present study aims to contribute to the naturalistic analysis of social eye-gaze by applying Conversation Analysis to video recordings of three Finnish children with a diagnosis of autism, each interacting with familiar others in ordinary settings . The analysis identifies two interactional environments where some children with autism show eye-gaze related competence with respect to gazing at (...) their co-participants: these are when the child carries out an initiating action or a responsive action . We discuss how this qualitative analysis of interactional structure could be extended using quantitative methods and eye-tracking technology in order to develop a better understanding of the disorder. Keywords: Autism; eye-gaze; conversation analysis; social interaction; interactional competence. (shrink)

Young children often treat robots as social agents after they have witnessed interactions that can be interpreted as social. We studied in three experiments whether four-year-olds from three cultures and adults from two cultures will attribute ownership of objects to a robot that engages in social gaze with a human. Participants watched videos of robot-human interactions, in which objects were possessed or new objects were created. Children and adults applied the same ownership rules to humans and robots – irrespective (...) of whether the robot engaged in social gaze or not. However, there was cultural variation in the types of ownership rules used. In Experiment 3, we removed further social cues, finding that just showing a pair of self-propelled robot-arms elicited ownership attributions. The role of social gaze in social attributions to robots and cross-cultural differences in ownership understanding are discussed. (shrink)

Eye gaze is a ubiquitous cue in child–caregiver interactions, and infants are highly attentive to eye gaze from very early on. However, the question of why infants show gaze-sensitive behavior, and what role this sensitivity to gaze plays in their language development, is not yet well-understood. To gain a better understanding of the role of eye gaze in infants' language learning, we conducted a broad systematic review of the developmental literature for all studies that investigate (...) the role of eye gaze in infants' language development. Across 77 peer-reviewed articles containing data from typically developing human infants in the domain of language development, we identified two broad themes. The first tracked the effect of eye gaze on four developmental domains: vocabulary development, word–object mapping, object processing, and speech processing. Overall, there is considerable evidence that infants learn more about objects and are more likely to form word–object mappings in the presence of eye gaze cues, both of which are necessary for learning words. In addition, there is good evidence for longitudinal relationships between infants' gaze following abilities and later receptive and expressive vocabulary. However, many domains are understudied; further work is needed to decide whether gaze effects are specific to tasks, such as word–object mapping or whether they reflect a general learning enhancement mechanism. The second theme explored the reasons why eye gaze might be facilitative for learning, addressing the question of whether eye gaze is treated by infants as a specialized socio-cognitive cue. We concluded that the balance of evidence supports the idea that eye gaze facilitates infants' learning by enhancing their arousal, memory, and attentional capacities to a greater extent than other low-level attentional cues. However, as yet, there are too few studies that directly compare the effect of eye gaze cues and non-social, attentional cues for strong conclusions to be drawn. We also suggest that there might be a developmental effect, with eye gaze, over the course of the first 2 years of life, developing into a truly ostensive cue that enhances language learning across the board. (shrink)

The capacity to extract socially relevant information from faces is fundamental to normal reciprocal social interactions and communication. The psychophysical evidence reviewed here demonstrates that humans possess a perceptual apparatus sensitive enough to detect the visual features which are informative of gaze in many face-to-face situations. This article provides evidence for the existence of three functionally and neuroanatomically dissociable eye gaze processing systems. Eye gaze also represents a class of biological motion cues, which engage the posterior superior (...) temporal sulcus for the analysis of intentions and psychological dispositions. Outputs from the anterior superior temporal sulcus constrain processing in the pSTS, linking the observed direction of gaze towards an object or person in the environment with the mentalistic information provided by the gaze shift. A few promising research directions for the field are highlighted. (shrink)

Observing averted eye gaze results in the automatic allocation of attention to the gazed-at location. The role of the orientation of the face that produces the gaze cue was investigated. The eyes in the face could look left or right in a head-centred frame, but the face itself could be oriented 90 degrees clockwise or anticlockwise such that the eyes were gazing up or down. Significant cueing effects to targets presented to the left or right of the screen (...) were found in these head orientation conditions. This suggests that attention was directed to the side to which the eyes would have been looking towards, had the face been presented upright. This finding provides evidence that head orientation can affect gaze following, even when the head orientation alone is not a social cue. It also shows that the mechanism responsible for the allocation of attention following a gaze cue can be influenced by intrinsic object-based (i.e. head-centred) properties of the task-irrelevant cue. (shrink)

The Passive Eye is a revolutionary and historically rich account of Berkeley's theory of vision. In this formidable work, the author considers the theory of the embodied subject and its passions in light of a highly dynamic conception of infinity. Arsic shows the profound affinities between Berkeley and Spinoza, and offers a highly textual reading of Berkeley on the concept of an "exhausted subjectivity." The author begins by following the Renaissance universe of vision, particularly the paradoxical elusive nature of mirrors, (...) then shows how this conception of vision was translated into the optical devices and in what way the various ways of deception could be conceived. Reading Berkeley against the backdrop of competing theories, in relation to Leibniz, Spinoza, Newton, Malebranche, Hume, Locke, Molyneux and others, this book gives a meticulous historic reconstruction of Berkeley's theory. This excellent scholarly work presents Berkeley's theory in a new and radical light. The book, presented in three parts, begins by presenting the conceptions of vision prior to Berkeley's intervention. In the second part, the author moves through a careful study of Descartes' theory of vision to arrive at Berkeley. The third part addresses the author's version of Berkeley in which the eye and the image become inseparable due to the collapse of the universe of representation. The problem of vision becomes not that of representation, but of presentation. Through an erudite historic reading of Berkeley's theory and astute comparative assessments, the author uncovers Berkeley's place as a contemporary theoretician, corresponding with such thinkers as Deleuze, Lacan, Foucault, and Derrida. (shrink)

In two eye-tracking studies we investigated the influence of Mandarin numeral classifiers – a grammatical category in the language – on online overt attention. Mandarin speakers were presented with simple sentences through headphones while their eye-movements to objects presented on a computer screen were monitored. The crucial question is what participants look at while listening to a pre-specified target noun. If classifier categories influence Mandarin speakers' general conceptual processing, then on hearing the target noun they should look at objects that (...) are members of the same classifier category – even when the classifier is not explicitly present. The data show that when participants heard a classifier they shifted overt attention significantly more to classifiermatch objects than to distractor objects, but when the classifier was not explicitly presented in speech, overt attention to classifier-match objects and distractor objects did not differ. This suggests that although classifier distinctions do influence eye-gaze behavior, they do so only during linguistic processing of that distinction and not in moment-to-moment general conceptual processing. (shrink)

Our brains readily decode facial movements and changes in social attention, reflected in earlier and larger N170 event-related potentials (ERPs) to viewing gaze aversions vs. direct gaze in real faces (Puce et al. 2000). In contrast, gaze aversions in line-drawn faces do not produce these N170 differences (Rossi et al., 2014), suggesting that physical stimulus properties or experimental context may drive these effects. Here we investigated the role of stimulus-induced context on neurophysiological responses to dynamic gaze. (...) Sixteen healthy adults viewed line-drawn and real faces, with dynamic eye aversion and direct gaze transitions, and control stimuli (scrambled arrays and checkerboards) while continuous electroencephalographic (EEG) activity was recorded. EEG data from 2 temporo-occipital clusters of 9 electrodes in each hemisphere where N170 activity is known to be maximal were selected for analysis. N170 peak amplitude and latency, and temporal dynamics from event-related spectral perturbations (ERSPs) were measured in 16 healthy subjects. Real faces generated larger N170s for averted vs. direct gaze motion, however, N170s to real and direct gaze were as large as those to respective controls. N170 amplitude did not differ across line-drawn gaze changes. Overall, bilateral mean gamma power changes for faces relative to control stimuli occurred between 150-350 ms, potentially reflecting signal detection of facial motion. Our data indicate that experimental context does not drive N170 differences to viewed gaze changes. Low-level stimulus properties, such as the high sclera/iris contrast change in real eyes likely drive the N170 changes to viewed aversive movements. (shrink)

Despite the importance of knowing the cognitive capabilities of children with neurodevelopmental conditions, less than one-third of children with cerebral palsy participate in standardized assessments. Globally, approximately 50% of people with cerebral palsy have an intellectual disability and there is significant risk for domain-specific cognitive impairments for the majority of people with cerebral palsy. However, standardized cognitive assessment tools are not accessible to many children with cerebral palsy, as they require manual manipulation of objects, verbal response and/or speeded response. As (...) such, standardised assessment may result in an underestimation of abilities for children with significant motor and/or speech impairment. The overall aim of the project is to examine and compare the psychometric properties of standardised cognitive assessment tools that have been accommodated for use with either a switch device or eye-gaze control technologies, with the specific aims to: Examine the psychometric properties of accommodated assessment tools by comparing the performance of typically developing children on six cognitive assessment tools administered via standardised versus accommodated administration; Describe and compare the performance and user experience of children with cerebral palsy on six accommodated cognitive assessments administered via switch or eye-gaze control technologies. Secondary aims are to: Describe the completion rates and time to complete assessments of participants in each group; Within the group with cerebral palsy, examine the effects of condition-specific characteristics and demographics on participation. This protocol paper describes a two-phase validation and acceptability study that utilizes a mixed-model design. This study will collect concurrent data from 80 typically developing children and 40 children with cerebral palsy, who use switch or eye-gaze control technology as alternate access communication methods. The set of instruments will measure receptive vocabulary, fluid reasoning, sustained attention, vision perception, visuospatial working memory and executive functions. Data analyses will be conducted using SPSS v. 25 and R v 4.1.0. SPSS Sample Power 3 was used for power computation and allows for a 10% drop out rate. Quantitative descriptive statistics, measurement agreement data plotting, bivariate and multiple regressions analysis will be conducted using appropriate methods. (shrink)

According to the shared signal hypothesis the impact of facial expressions on emotion processing partially depends on whether the gaze is directed toward or away from the observer. In autism spectrum disorder several aspects of face processing have been found to be atypical, including attention to eye gaze and the identification of emotional expressions. However, there is little research on how gaze direction affects emotional expression processing in typically developing individuals and in those with ASD. This question (...) is investigated here in two multimodal experiments. Experiment 1 required processing eye gaze direction while faces differed in emotional expression. Forty-seven children participated. Their Autism Diagnostic Observation Schedule scores ranged from 0 to 6 in the experiment. Event-related potentials were sensitive to gaze direction and emotion, but emotion processing did not depend on gaze direction. However, for angry faces the gaze direction effect on the N170 amplitude, as typically observed in TD individuals, diminished with increasing ADOS score. For neutral expressions this correlation was not significant. Experiment 2 required explicit emotion classifications in a facial emotion composite task while eye gaze was manipulated incidentally. A group of 22 children with ASD was compared to a propensity score-matched group of TD children. The same comparison was carried out for a subgroup of nine children with ASD who were less trained in social cognition, according to clinician’s report. The ASD group performed overall worse in emotion recognition than the TD group, independently of emotion or gaze direction. However, for disgust expressions, eye tracking data revealed that TD children fixated relatively longer on the eyes of the stimulus face with a direct gaze as compared with averted gaze. In children with ASD we observed no such modulation of fixation behavior as a function of gaze direction. Overall, the present findings from ERPs and eye tracking confirm the hypothesis of an impaired sensitivity to gaze direction in children with ASD or elevated autistic traits, at least for specific emotions. Therefore, we conclude that multimodal investigations of the interaction between emotional processing and stimulus gaze direction are promising to understand the characteristics of individuals differing along the autism trait dimension. (shrink)

Since social skills are highly significant to the evolutionary success of humans, we should expect these skills to be efficient and reliable. For many Evolutionary Psychologists efficiency entails encapsulation: the only way to get an efficient system is via information encapsulation. But encapsulation reduces reliability in opaque epistemic domains. And the social domain is darkly opaque: people lie and cheat, and deliberately hide their intentions and deceptions. Modest modularity [Currie and Sterelny (2000) Philos Q 50:145–160] attempts to combine efficiency and (...) reliability. Reliability is obtained by placing social skills in un-encapsulated central cognition; efficiency by having the social system sensitive to encapsulated socially tagged cues. In this paper, I argue that this approach fails. I focus on eye-gaze as a plausible example of a socially significant encapsulated cue. I demonstrate contra modest modularity that eye-gaze is subject to influence from central cognition. (shrink)

Referential gaze has been shown to benefit language processing in situated communication in terms of shifting visual attention and leading to shorter reaction times on subsequent tasks. The present study simultaneously assessed both visual attention and, importantly, the immediate cognitive load induced at different stages of sentence processing. We aimed to examine the dynamics of combining visual and linguistic information in creating anticipation for a specific object and the effect this has on language processing. We report evidence from three (...) visual‐world eye‐tracking experiments, showing that referential gaze leads to a shift in visual attention toward the cued object, which consequently lowers the effort required for processing the linguistic reference. Importantly, perceiving and following the gaze cue did not prove costly in terms of cognitive effort, unless the cued object did not fit the verb selectional preferences. (shrink)

Previous long-term memory research found that angry faces were more poorly recognised when encoded with averted vs. direct gaze, while memory for happy faces was unaffected by gaze. Contrasti...

In order for artificial intelligent systems to interact naturally with human users, they need to be able to learn from human instructions when actions should be imitated. Human tutoring will typically consist of action demonstrations accompanied by speech. In the following, the characteristics of human tutoring during action demonstration will be examined. A special focus will be put on the distinction between two kinds of motion events: path-oriented actions and manner-oriented actions. Such a distinction is inspired by the literature pertaining (...) to cognitive linguistics, which indicates that the human conceptual system can distinguish these two distinct types of motion. These two kinds of actions are described in language by more path-oriented or more manner-oriented utterances. In path-oriented utterances, the source, trajectory, or goal is emphasized, whereas in manner-oriented utterances the medium, velocity, or means of motion are highlighted. We examined a video corpus of adult–child interactions comprised of three age groups of children—pre-lexical, early lexical, and lexical—and two different tasks, one emphasizing manner more strongly and one emphasizing path more strongly. We analyzed the language and motion of the caregiver and the gazing behavior of the child to highlight the differences between the tutoring and the acquisition of the manner and path concepts. The results suggest that age is an important factor in the development of these action categories. The analysis of this corpus has also been exploited to develop an intelligent robotic behavior—the tutoring spotter system—able to emulate children's behaviors in a tutoring situation, with the aim of evoking in human subjects a natural and effective behavior in teaching to a robot. The findings related to the development of manner and path concepts have been used to implement new effective feedback strategies in the tutoring spotter system, which should provide improvements in human–robot interaction. (shrink)

The visual behaviour of consumers buying products in a supermarket was measured and used to analyse the stages of their decision process. Traditionally metrics used to trace decision-making processes are difficult to use in natural environments that often contain many options and unstructured information. Unlike previous attempts in this direction, our methodology reveals differences between a decision-making task and a search task. In particular the second stage of a decision task contains more re-dwells than the second stage of a comparable (...) search task. This study addresses the growing concern of taking eye movement research from the laboratory into the ‘real-world’, so findings can be better generalised to natural situations. (shrink)

Crying is an ubiquitous human behavior through which an emotion is expressed on the face together with visible tears and constitutes a slippery riddle for researchers. To provide an answer to the question “How our gaze reacts to another person’s tears?,” we made use of eye tracking technology to study a series of visual stimuli. By presenting an illustrative example through an experimental setting specifically designed to study the “tearing effect,” the present work aims to offer methodological insight on (...) how to use eye-tracking technology to study non-verbal cues. A sample of 30 healthy young women with normal visual acuity performed a within-subjects task in which they evaluated images of real faces with and without tears while their eye movements were tracked. Tears were found to be a magnet for visual attention in the task of facial attribution, facilitating a greater perception of emotional intensity. Moreover, the inspection pattern changed qualitatively and quantitatively, with our participants becoming fully focused on the tears when they were visible. The mere presence of a single tear running down a cheek was associated with an increased emotional inference and greater perception of sincerity. Using normalized and validated tools (Reading the Eyes in the Mind Test and the SALAMANCA screening test for personality disorders), we measured the influence of certain characteristics of the participants on their performance of the experimental task. On the one hand, a higher level of cognitive empathy helped to classify tearful faces with higher emotional intensity and tearless faces with less emotional intensity. On the other hand, we observed that less sincerity was attributed to the tearful faces as the SALAMANCA test scores rose in clusters A (strange and extravagant) and B (immature and emotionally unstable) of our sample. The present findings highlight the advantages of using eye tracking technology to study non-verbal cues and draw attention to methodological issues that should be taken into account. Further exploration of the relationship between empathy and tear perception could be a fruitful avenue of future research using eye tracking. (shrink)

Background: Individuals with Autism Spectrum Disorder (ASD) have pronounced difficulties in attending to relevant visual information during social interactions. Method: We designed and evaluated the feasibility of a novel method to train this ability, by exposing participants to virtual human characters displayed on a screen which was entirely blurred, except for a gaze-contingent viewing window that followed participants’ eyes direction. The goal was to incite participants to direct their gaze towards the facial expressions of the virtual characters. Twenty-one (...) adolescents with ASD who attended ordinary school were randomized to either an experimental group, who was trained during a month and a half, or to a control group. Social communicative abilities were assessed during pre, post and follow-up tests. Results: After training, the experimental group showed significantly more interest in facial expressions on a test which involved understanding a dialogue. Significant differences were not found for the other tests used. Conclusions: This outcome suggests that the training method fostered participants’ awareness of the relevance of facial expressions. (shrink)

Social attention is thought to require detecting the eyes of others and following their gaze. To be effective, observers must also be able to infer the person's thoughts and feelings about what he or she is looking at, but this has only rarely been investigated in laboratory studies. In this study, participants' eye movements were recorded while they chose which of four patterns they preferred. New observers were subsequently able to reliably guess the preference response by watching a replay (...) of the fixations. Moreover, when asked to mislead the person guessing, participants changed their looking behavior and guessing success was reduced. In a second experiment, naïve participants could also guess the preference of the original observers but were unable to identify trials which were lies. These results confirm that people can spontaneously use the gaze of others to infer their judgments, but also that these inferences are open to deception. (shrink)

Pupillary responses and associated vergence eye movements were monitored during imagery of objects of differing sizes (“large” or “small”) from varying distances (“near” or “far”). Objects’ imagined size and distance affected oculomotor behavior. Objects visualized as “far” resulted in the larger pupil dilations and smaller visual angle, while small objects imagined “near” were associated with smaller pupils in contrast to relatively larger pupils when imagined as “far” away. Furthermore, near objects resulted in larger visual angle, and particularly, vergence adjustments were (...) observed that were dependent on imagined size and distance of the small objects. The findings are consistent with the idea that imagery emulates perception, also at the embodied level of oculomotor behaviors. (shrink)

In everyday interactions, humans naturally exhibit behavioral cues, such as gaze and head movements, that signal their intentions while interpreting the behavioral cues of others to predict their intentions. Such intention prediction enables each partner to adapt their behaviors to the intent of others, serving a critical role in joint action where parties work together to achieve a common goal. Among behavioral cues, eye gaze is particularly important in understanding a person's attention and intention. In this work, we (...) seek to quantify how gaze patterns may indicate a person's intention. Our investigation was contextualized in a dyadic sandwich-making scenario in which a “worker” prepared a sandwich by adding ingredients requested by a “customer.” In this context, we investigated the extent to which the customers' gaze cues serve as predictors of which ingredients they intend to request. Predictive features were derived to represent characteristics of the customers' gaze patterns. We developed a support vector machine-based (SVM-based) model that achieved 76% accuracy in predicting the customers' intended requests based solely on gaze features. Moreover, the predictor made correct predictions approximately 1.8 s before the spoken request from the customer. We further analyzed several episodes of interactions from our data to develop a deeper understanding of the scenarios where our predictor succeeded and failed in making correct predictions. These analyses revealed additional gaze patterns that may be leveraged to improve intention prediction. This work highlights gaze cues as a significant resource for understanding human intentions and informs the design of real-time recognizers of user intention for intelligent systems, such as assistive robots and ubiquitous devices, that may enable more complex capabilities and improved user experience. (shrink)