Researchers are able to estimate what subjects attend to by using eye tracking systems. Existing approaches for analyzing eye movements are very useful to estimate attention to still objects. But they are inadequate to estimate attention to moving objects, although paying attention to moving objects is usual human behavior. Thus, we propose a novel approach and algorithm to estimate attention to moving objects more precisely. Our approach is to extract "eye tracking movements". We phrase both saccadic eye (...) class='Hi'>movements and smooth pursuit eye movements as "eye tracking movements". Because previous works reveal that humans often track a moving object by the eye movements when they pay attention to the object, our approach seems to be appropriate. Our algorithm used for extracting eye tracking movements is called Path Stitching (PS) algorithm. The PS algorithm is a kind of Longest Common Subsequence (LCS) discovery algorithms using Dynamic Time Warping (DTW) as a similarity measurement procedure. Eye tracking movements can be regarded as a situation that a subsequence of eye movements' trajectory is similar to a subsequence of the target's trajectory with a small or no time-difference. Because humans track a moving object by the eye movements with locally fluctuated time difference, we think the use of DTW is very appropriate. In addition, to make outputs more comprehensible, we employ the LCS discovery approach for the PS algorithm. The experimental results show that the PS algorithm is more able to extract eye tracking movements than the fixation extracting approach. The fixation extracting approach is the most popular and the strongest approach to analyze eye movements. Therefore, we conclude that our novel approach will advance the analysis of human behavior by the eye movements and human-computer interaction systems they utilize user's eye movements. (shrink)

Dual task is known to affect postural stabilty in children. We explored the effect of visual tasks on postural control in dyslexic and in age-matched non-dyslexic children. Thirty dyslexic children (mean age: 9.80 ± 0.28 years) were compared with thirty non-dyslexic children (mean age: 9.92 ± 0.35 years). All children underwent ophthalmologic and optometric evaluation. Eye movements were recorded by a video-oculography system (EyeBrain ® T2) and postural sway was recorded simultaneously by a force platform (TechnoConept®). Both groups of (...) children performed fixations, pursuits, pro- and anti-saccades tasks. Dyslexic children showed significantly poor near fusional vergence ranges (convergence and divergence) with respect to the non-dyslexic children. During the postural task, quality of fixation and anti-saccade performance in dyslexic children were significantly worse compared to non-dyslexic children. In contrast, the number of catch-up saccades during pursuits and the latency of pro-and anti-saccades were similar in both groups of children examined. Concerning postural quality, dyslexic children were more unstable than age-matched non-dyslexic children. For both groups of children tested we also observed that executing saccades (pro- and anti-saccades) reduced postural values significantly in comparison with fixation and pursuit tasks. The impairment in convergence and divergence fusional capabilities could be due to an immaturity in cortical structures controlling the vergence system. The poor oculomotor performance reported in dyslexic children suggested a deficit in allocating visual attention and their postural instability observed is in line with the cerebellar impairment previously reported in dyslexic children. Finally, pro- or anti-saccades reduce postural values compared to fixation and pursuit tasks in both groups of children tested, suggesting a different influence of visual tasks on postural control according to their attentional demand. (shrink)

Is discomfort intrinsic to wonder? The author pursues this question by showing how early visitors to the Niagara Falls found that efforts to improve the view eliminated the difficulty that made viewing the falls rewarding in the first place. Visitors’ experiences accord with eighteenth-century accounts that suggest that wonder thrives on difficulty and desire thrives on inaccessibility. This aesthetic effect finds expression in The Arabian Nights and other texts that both represent and enact narrative withholding, and also in the visual (...) form of the arabesque, which beguiles the eye with movement but does not go anywhere. The essay concludes by connecting these insights into aesthetic difficulty to present-day concerns that attempts to bring the humanities to a broader audience may “dumb down” art. I conclude that such concerns miss the point that aesthetic experiences depend upon a tension between legibility and illegibility that artworks continue to generate in new and unforeseen ways. (shrink)

Engineers use neural networks to control systems too complex for conventional engineering solutions. To examine the behavior of individual hidden units would defeat the purpose of this approach because it would be largely uninterpretable. Yet neurophysiologists spend their careers doing just that! Hidden units contain bits and scraps of signals that yield only arcane hints about network function and no information about how its individual units process signals. Most literature on single-unit recordings attests to this grim fact. On the other (...) hand, knowing a system's function and describing it with elegant mathematics tell one very little about what to expect of interneuronal behavior. Examples of simple networks based on neurophysiology are taken from the oculomotor literature to suggest how single-unit interpretability might decrease with increasing task complexity. It is argued that trying to explain how any real neural network works on a cell-by-cell, reductionist basis is futile and we may have to be content with trying to understand the brain at higher levels of organization. (shrink)

Wijdicks and colleagues1 recently presented the Full Outline of UnResponsiveness (FOUR) scale as an alternative to the Glasgow Coma Scale (GCS)2 in the evaluation of consciousness in severely brain-damaged patients. They studied 120 patients in an intensive care setting (mainly neuro-intensive care) and claimed that “the FOUR score detects a locked-in syndrome, as well as the presence of a vegetative state.”1 We fully agree that the FOUR is advantageous in identifying locked-in patients given that it specifically tests for eye (...) class='Hi'>movements or blinking on command. This is welcomed given that misdiagnosis of the locked-in syndrome has been shown to occur in more than half of the cases (see Laureys and colleagues3 for review). As for the diagnosis of the vegetative state, the scale explicitly tests for visual pursuit, and hence can disentangle the vegetative state from the minimally conscious state (MCS). The diagnostic criteria for MCS have been proposed4 only recently, but Wijdicks and colleagues1 do not mention the existence of this clinical entity in their article. As for the vegetative state, MCS can be encountered in the acute or subacute setting as a transitional state on the way to further recovery, or it can be a more chronic or even permanent condition. The MCS refers to patients showing inconsistent, albeit clearly discernible, minimal behavioral evidence of consciousness (eg, localization of noxious stimuli, eye fixation or tracking, reproducible movement to command, or nonfunctional verbalization).4 The FOUR scale does not test for all of the behavioral criteria required to diagnose MCS.4 It is known from the literature (see Majerus and colleagues5 for review) that about a third of patients diagnosed with vegetative state are actually in MCS, and this misdiagnosis can lead to major clinical, therapeutic, and ethical consequences. We tested the ability of the newly proposed FOUR scale to correctly diagnose the vegetative state in an acute (intensive care and neurology ward) and chronic (neurorehabilitation) setting.. (shrink)

We know that reading involves coordination between textual characteristics and visual attention, but research linking eye movements during reading and comprehension assessed after reading is surprisingly limited, especially for reading long connected texts. We tested two competing possibilities: (a) the weak association hypothesis: Links between eye movements and comprehension are weak and short‐lived, versus (b) the strong association hypothesis: The two are robustly linked, even after a delay. Using a predictive modeling approach, we trained regression models to predict (...) comprehension scores from global eye movement features, using participant‐level cross‐validation to ensure that the models generalize across participants. We used data from three studies in which readers (Ns = 104, 130, 147) answered multiple‐choice comprehension questions ~30 min after reading a 6,500‐word text, or after reading up to eight 1,000‐word texts. The models generated accurate predictions of participants' text comprehension scores (correlations between observed and predicted comprehension: 0.384, 0.362, 0.372, ps <.001), in line with the strong association hypothesis. We found that making more, but shorter fixations, consistently predicted comprehension across all studies. Furthermore, models trained on one study's data could successfully predict comprehension on the others, suggesting generalizability across studies. Collectively, these findings suggest that there is a robust link between eye movements and subsequent comprehension of a long connected text, thereby connecting theories of low‐level eye movements with those of higher order text processing during reading. (shrink)

Background: Eye movement desensitization and reprocessing [EMDR] is an innovative, evidence-based and effective psychotherapy for post-traumatic stress disorder [PTSD]. As with other psychotherapies, the effectiveness of EMDR contrasts with a limited knowledge of its underlying mechanism of action. In its relatively short life as a therapeutic option, EMDR has not been without controversy, in particular regarding the role of the bilateral stimulation as an active component of the therapy. The high prevalence of EMDR in clinical practice and the dramatic increase (...) in EMDR research in recent years, with more than 26 randomized controlled trials published to date, highlight the need for a better understanding of its mechanism of action. Methods: We conducted a thorough systematic search of studies published until October 2017, using PubMed, ScienceDirect, Web of Knowledge and Scopus databases that examined the mechanism of action of EMDR or provided conclusions within the framework of current theoretical models of EMDR functioning. Results: Seventy-five studies were selected for review and classified into three overarching models; (i) psychological models (ii) psychophysiological models and (iii) neurobiological models. The evidence available from each study was analysed and discussed. Results demonstrated a reasonable empirical support for the working memory hypothesis and for the physiological changes associated with successful EMDR therapy. Recently, more sophisticated structural and functional neuroimaging studies using high resolution structural and temporal techniques are starting to provide preliminary evidence into the neuronal correlates before, during and after EMDR therapy. Discussion: Despite the increasing number of studies that published in recent years, the research into the mechanisms underlying EDMR therapy are still in its infancy. Studies in well-defined clinical and non-clinical populations, larger sample sizes and tighter methodological control are further needed in order to establish firm conclusions. (shrink)

A controversial claim in recent dual process accounts of reasoning is that intuitive processes not only lead to bias but are also sensitive to the logical status of an argument. The intuitive logic hypothesis draws upon evidence that reasoners take longer and are less confident on belief–logic conflict problems, irrespective of whether they give the correct logical response. In this paper, we examine conflict detection under conditions in which participants are asked to either judge the logical validity or believability of (...) a presented conclusion, accompanied by measures of eye movement and pupil dilation. The findings show an effect of conflict, under both types of instruction, on accuracy, latency, gaze shifts, and pupil dilation. Importantly, these effects extend to conflict trials in which participants give a belief‐based response (incorrectly under logic instructions or correctly under belief instructions) demonstrating both behavioral and physiological evidence in support of the logical intuition hypothesis. (shrink)

People often make use of a spatial “mental time line” to represent events in time. We investigated whether the eyes follow such a mental time line during online language comprehension of sentences that refer to the past, present, and future. Participants' eye movements were measured on a blank screen while they listened to these sentences. Saccade direction revealed that the future is mapped higher up in space than the past. Moreover, fewer saccades were made when two events are simultaneously (...) taking place at the present moment compared to two events that are happening in different points in time. This is the first evidence that oculomotor correlates reflect mental looking along an abstract invisible time line during online language comprehension about time. Our results support the idea that observing eye movements is likely to “detect” invisible spatial scaffoldings which are involved in cognitively processing abstract meaning, even when the abstract meaning lacks an explicit spatial correlate. Theoretical implications of these findings are discussed. (shrink)

This study investigates how speed of motion is processed in language. In three eye-tracking experiments, participants were presented with visual scenes and spoken sentences describing fast or slow events (e.g., The lion ambled/dashed to the balloon). Results showed that looking time to relevant objects in the visual scene was affected by the speed of verb of the sentence, speaking rate, and configuration of a supporting visual scene. The results provide novel evidence for the mental simulation of speed in language and (...) show that internal dynamic simulations can be played out via eye movements toward a static visual scene. (shrink)

Perception is a first-person internal sensation induced within the nervous system at the time of arrival of sensory stimuli from objects in the environment. Lack of access to the first-person properties has limited viewing perception as an emergent property and it is currently being studied using third-person observed findings from various levels. One feasible approach to understand its mechanism is to build a hypothesis for the specific conditions and required circuit features of the nodal points where the mechanistic operation of (...) perception take place for one type of sensation in one species and to verify it for the presence of comparable circuit properties for perceiving a different sensation in a different species. The present work explains visual perception in mammalian nervous system from a first-person frame of reference and provides explanations for the homogeneity of perception of visual stimuli above flicker fusion frequency, the perception of objects at locations different from their actual position, the smooth pursuit and saccadic eye movements, the perception of object borders, and perception of pressure phosphenes. Using results from temporal resolution studies and the known details of visual cortical circuitry, explanations are provided for (a) the perception of rapidly changing visual stimuli, (b) how the perception of objects occurs in the correct orientation even though, according to the third-person view, activity from the visual stimulus reaches the cortices in an inverted manner and (c) the functional significance of well-conserved columnar organization of the visual cortex. A comparable circuitry detected in a different nervous system in a remote species-the olfactory circuitry of the fruit fly Drosophila melanogaster-provides an opportunity to explore circuit functions using genetic manipulations, which, along with high-resolution microscopic techniques and lipid membrane interaction studies, will be able to verify the structure-function details of the presented mechanism of perception. (shrink)

When we read narrative texts such as novels and newspaper articles, we segment information presented in such texts into discrete events, with distinct boundaries between those events. But do our eyes reflect this event structure while reading? This study examines whether eye movements during the reading of discourse reveal how readers respond online to event structure. Participants read narrative passages as we monitored their eye movements. Several measures revealed that event structure predicted eye movements. In two experiments, (...) we found that both early and overall reading times were longer for event boundaries. We also found that regressive saccades were more likely to land on event boundaries, but that readers were less likely to regress out of an event boundary. Experiment 2 also demonstrated that tracking event structure carries a working memory load. Eye movements provide a rich set of online data to test the cognitive reality of event segmentation during reading. (shrink)

Remote interpreting via video-link is increasingly being employed in investigative interviews chiefly due to its apparent increased accessibility and efficiency. However, risks of miscommunication have been shown to be magnified in remote interpreting and empirical research specifically on video-link remote interpreting is in its infancy which greatly limits the evidence base available to inform and direct evidence-based policy and best practice, particularly in the identification of the optimal mode of interpreting to be used, namely consecutive and simultaneous. Consecutive interpreting refers (...) to a process in which the interpreter transfers short segments of speech from one language into the other as each person speaks in managed turn-taking, while simultaneous interpreting refers to the transfer of natural speech from one language into another in a concurrent manner without the need for speakers to segment their speech. This study provides novel empirical evidence by using eye tracking to compare the overt visual attention of interpreters working in a remote setting in which an English-speaking Interviewer interacts with a non-English-speaking Suspect in person, for whom interpretation is provided via video-link in real time. Using a within-subject design, we analyze eye-movement data from 28 professionally accredited interpreters who interpreted via video-link an investigative interview in which consecutive and simultaneous interpreting modes were counterbalanced. Taking interpreting performance into account, our results showed that, the consecutive mode yielded significantly less gaze time and therefore significantly less on-screen overt visual attention due to off-screen notetaking, an essential component of the consecutive interpreting mode. Relative to gaze time, the consecutive mode also resulted in significantly more and longer fixations and shifts of attention. Participants also allocated significantly more overt visual attention to the Interviewer than the Suspect, particularly in the consecutive mode. Furthermore, we found informative significant correlations between eye tracking measures and interpreting performance: accuracy, verbal rapport, and management. Finally, we found no significant differences between the three language pairs tested. We conclude with a discussion of limitations and the contributions of the study and an outline for future work on this topic of growing importance. (shrink)

The neural correlates of rapid eye movements (REMs) in sleep are extraordinarily robust; including REM-locked activation in the retrosplenial cortex, the supplementary eye field and areas overlapping cholinergic basal nucleus. The phenomenology of REMs speaks to the notion that perceptual experience in both sleep and wakefulness is a constructive process – in which we generate predictions of sensory inputs and then test those predictions through actively sampling the sensorium with eye movements. On this view, REMs during sleep may (...) index an internalized active sampling or ‘scanning’ of self-generated visual constructs that are not constrained by visual input. If this view is correct, it renders REMs an ideal probe to study consciousness as “an exclusively internal affair” (Metzinger 2009). In other words, REMs offer a probe of active inference – in the sense of predictive coding – when the brain is isolated from the sensorium in virtue of the natural blockade of sensory input during REM sleep. REMs are temporally precise events that enable powerful inferences based on timeseries analyses. As a natural, task-free probe, [REMs] could be used in non-compliant subjects, including infants and animals. In short, REM constitutes a promising probe to study the ontogenetic and phylogenetic development of consciousness and perhaps its abnormal development in schizophrenia and autism, which have been considered in terms of aberrant predictive coding. (shrink)

E-Z Reader fits key parameters from one corpus of eye movement data, but has not really been tested with new data sets. More critically, it is argued that the key mechanism driving eye movements – a serial process involving a proportion of word recognition time – is implausible on the basis of a broad range of experimental findings.

In isolated English word reading, readers have the optimal performance when their initial eye fixation is directed to the area between the beginning and word center, that is, the optimal viewing position (OVP). Thus, how well readers voluntarily direct eye gaze to this OVP during isolated word reading may be associated with reading performance. Using Eye Movement analysis with Hidden Markov Models, we discovered two representative eye movement patterns during lexical decisions through clustering, which focused at the OVP and the (...) word center, respectively. Higher eye movement similarity to the OVP-focusing pattern predicted faster lexical decision time in addition to cognitive abilities and lexical knowledge. However, the OVP-focusing pattern was associated with longer isolated single letter naming time, suggesting conflicting visual abilities required for identifying isolated letters and multi-letter words. In contrast, in both word and pseudoword naming, although clustering did not reveal an OVP-focused pattern, higher consistency of the first fixation as measured in entropy predicted faster naming time in addition to cognitive abilities and lexical knowledge. Thus, developing a consistent eye movement pattern focusing on the OVP is essential for word orthographic processing and reading fluency. This finding has important implications for interventions for reading difficulties. (shrink)

Earthquakes, which can cause widespread territorial and socio-economic destruction, are life-threatening, unexpected, unpredictable and uncontrollable events caused by the shaking of the surface of the earth. The psychological consequences, such as PTSD, anxiety, depression, and suicidal ideation, are well-known to clinicians and researchers. This study was conducted with the aim of evaluating the use of the Eye Movement Desensitization and Reprocessing (EMDR) Integrative Group Treatment Protocol (IGTP) on a sample of adolescents, after the earthquake in Central Italy on 24 August (...) 2016. The objective of the EMDR intervention was to reduce PTSD symptoms. Before and after EMDR, specific assessment to find changes in PTSD symptoms was made using the IES-R (Impact of Event Scale Revised) and through the analyses of the Subjective Units of Disturbance (SUD). The EMDR treatment was given in three sessions (T1, T2, T3), each lasting 90 minutes, and the results at follow-up phase (T4) were also monitored. The results are very encouraging, showing significantly reduced PTSD symptoms in the majority of the subjects. The clinical implications and limitations will be discussed. (shrink)

Abstnn Eye movements were monitored while subjects performed parallel and serial sarah tasks. In Experiment la, subjects searched for an “O' among "X"s (parallel condition) and for a 'T" among "L"s (serial condition). In the parallel condition of Eqcriment lb, “q)" was the target and “O"s were distractors; in the serial condition, time..

The hypothesis that word representations are emotionally impoverished in a second language (L2) has variable support. However, this hypothesis has only been tested using tasks that present words in isolation or that require laboratory-specific decisions. Here, we recorded eye movements for 34 bilinguals who read sentences in their L2 with no goal other than comprehension, and compared them to 43 first language readers taken from our prior study. Positive words were read more quickly than neutral words in the L2 (...) across first-pass reading time measures. However, this emotional advantage was absent for negative words for the earliest measures. Moreover, negative words but not positive words were influenced by concreteness, frequency and L2 proficiency in a manner similar to neutral words. Taken together, the findings suggest that only negative words are at risk of emotional disembodiment during L2 reading, perhaps because a positivity bias in L2 experiences ensures that positive words are emotionally grounded. (shrink)

Background: Neurotypical young adults show task-based modulation and stability of their eye movements across tasks. This study aimed to determine whether persons with aphasia (PWA) modulate their eye movements and show stability across tasks similarly to control participants. Methods: Forty-eight PWA and age-matched control participants completed four eye-tracking tasks: scene search, scene memorization, text-reading, and pseudo-reading. Results: Main effects of task emerged for mean fixation duration, saccade amplitude, and standard deviations of each, demonstrating task-based modulation of eye (...) class='Hi'>movements. Group by task interactions indicated that PWA produced shorter fixations relative to controls. This effect was most pronounced for scene memorization and for individuals who recently suffered a stroke. PWA produced longer fixations, shorter saccades, and less variable eye movements in reading tasks compared to controls. Three-way interactions of group, aphasia subtype, and task also emerged. Text-reading and scene memorization were particularly effective at distinguishing aphasia subtype. Persons with anomic aphasia showed a reduction in reading saccade amplitudes relative to their respective control group and other PWA. Persons with conduction/Wernicke’s aphasia produced shorter scene memorization fixations relative to controls or PWA of other subtypes, suggesting a memorization specific effect. Positive correlations across most tasks emerged for fixation duration and did not significantly differ between controls and PWA. Conclusions: PWA generally produced shorter fixations and smaller saccades relative to controls particularly in scene memorization and text-reading respectively. The effect was most pronounced recently after a stroke. Selectively in reading tasks, PWA produced longer fixations and shorter saccades relative to controls, consistent with reading difficulty. PWA showed task-based modulation of eye movements, though the pattern of results was somewhat abnormal relative to controls. All subtypes of PWA also demonstrated task-based modulation of eye movements. However, persons with anomic aphasia showed reduced modulation of saccade amplitude and smaller reading saccades, possibly to improve reading comprehension. Controls and PWA generally produced stabile fixation durations across tasks and did not differ in their relationship across tasks. Overall, these results suggest there is potential to differentiate among PWA with varying subtypes and from controls using eye movement measures of task-based modulation, especially reading and scene memorization tasks. (shrink)

In two experiments, participants solved anagram problems while their eye movements were monitored. Each problem consisted of a circular array of five letters: a scrambled four-letter solution word containing three consonants and one vowel, and an additional randomly-placed distractor consonant. Viewing times on the distractor consonant compared to the solution consonants provided an online measure of knowledge of the solution. Viewing times on the distractor consonant and the solution consonants were indistinguishable early in the trial. In contrast, several seconds (...) prior to the response, viewing times on the distractor consonant decreased in a gradual manner compared to viewing times on the solution consonants. Importantly, this pattern was obtained across both trials in which participants reported the subjective experience of insight and trials in which they did not. These findings are consistent with the availability of partial knowledge of the solution prior to such information being accessible to subjective phenomenal awareness. (shrink)