Our target article discussed how emerging knowledge of the physiological processes involved in the control of saccadic eye movements provided the basis for a functional framework in which to understand the programming of such movements. The commentators raised many interesting issues in their varied responses that ranged from detailed discussion of the physiological substrate through issues of saccade control in reading. New evidence at the physiological level demonstrates that some elaborations are needed to the framework we proposed. Most (...) clearly, the spatial selection process operates in a manner different from our suggestion of an increase in activity in the salience map. Some commentators make the interesting and welcome proposal that the functional processes we outline may in fact be implemented with an even more unified physiological substrate (continuity between collicular fixation and build-up cells) than we envisaged. Extensions to the framework are discussed involving the planning of sequential saccades, saccades made in crossmodal situations, the influences of learning and memory, and binocular saccades. We consider carefully the commentaries proposing explicit attentional and/or executive processes in the programming of saccades. We integrate the comments of researchers investigating saccade control in neurological and neuropsychiatric patients and finally discuss whether the framework can account for saccades made in the course of reading. (shrink)

Involuntary eye movement during gaze fixation, referred to as fixational eye movement, consists of two types of components: a Brownian motion like component called drifts-tremor and a ballistic component called microsaccade with a mean saccadic amplitude of about 0.3° and a mean inter-MS interval of about 0.5 s. During GZ fixation in healthy people in an eccentric position, typically with an eccentricity more than 30°, eyes exhibit oscillatory movements alternating between centripetal drift and centrifugal saccade with a (...) mean saccadic amplitude of about 1° and a period in the range of 0.5–1.0 s, which has been known as the physiological gaze-evoked nystagmus. Here, we designed a simple experimental paradigm of GZ fixation on a target shifted horizontally from the front-facing position with fewer eccentricities. We found a clear tendency of centripetal DRT and centrifugal MS as in GEN, but with more stochasticity and with slower drift velocity compared to GEN, even during FEM at GZ positions with small eccentricities. Our results showed that the target shift-dependent balance between DRT and MS achieves the GZ bounded around each of the given targets. In other words, GZ relaxes slowly with the centripetal DRT toward the front-facing position during inter-MS intervals, as if there always exists a quasi-stable equilibrium posture in the front-facing position, and MS actions pull GZ intermittently back to the target position in the opposite direction to DRT. (shrink)

In a realistic steady-state visual evoked potential (SSVEP) based brain-computer interface (BCI) application like driving a car or controlling a quadrotor, observing the surrounding environment while simultaneously gazing at the stimulus is necessary. This kind of application inevitably could cause head movements and variation of the accompanying gaze fixation point, which might affect the SSVEP and BCI’s performance. However, few papers studied the effects of head movements and gaze fixation switch on SSVEP response, and the corresponding (...) BCI performance. This study aimed to explore these effects by designing a new ball tracking paradigm in a virtual reality (VR) environment with two different moving tasks, i.e., the following and free moving tasks, and three moving patterns, pitch, yaw, and static. Sixteen subjects were recruited to conduct a BCI VR experiment. The offline data analysis showed that head moving patterns [F(2, 30) = 9.369, p = 0.001, effect size = 0.384] resulted in significantly different BCI decoding performance but the moving tasks had no effect on the results [F(1, 15) = 3.484, p = 0.082, effect size = 0.188]. Besides, the canonical correlation analysis (CCA) and filter bank canonical correlation analysis (FBCCA) accuracy were better than the PSDA and MEC methods in all of the conditions. These results implied that head movement could significantly affect the SSVEP performance but it was possible to switch gaze fixation to interact with the surroundings in a realistic BCI application. (shrink)

We know that reading involves coordination between textual characteristics and visual attention, but research linking eye movements during reading and comprehension assessed after reading is surprisingly limited, especially for reading long connected texts. We tested two competing possibilities: (a) the weak association hypothesis: Links between eye movements and comprehension are weak and short‐lived, versus (b) the strong association hypothesis: The two are robustly linked, even after a delay. Using a predictive modeling approach, we trained regression models to predict (...) comprehension scores from global eye movement features, using participant‐level cross‐validation to ensure that the models generalize across participants. We used data from three studies in which readers (Ns = 104, 130, 147) answered multiple‐choice comprehension questions ~30 min after reading a 6,500‐word text, or after reading up to eight 1,000‐word texts. The models generated accurate predictions of participants' text comprehension scores (correlations between observed and predicted comprehension: 0.384, 0.362, 0.372, ps <.001), in line with the strong association hypothesis. We found that making more, but shorter fixations, consistently predicted comprehension across all studies. Furthermore, models trained on one study's data could successfully predict comprehension on the others, suggesting generalizability across studies. Collectively, these findings suggest that there is a robust link between eye movements and subsequent comprehension of a long connected text, thereby connecting theories of low‐level eye movements with those of higher order text processing during reading. (shrink)

We replicated and extended the findings of Yao et al. [(2018). Differential emotional processing in concrete and abstract words. Journal of Experimental Psychology: Learning, Memory, and Cognition, 44(7), 1064–1074] regarding the interaction of emotionality, concreteness, and imageability in word processing by measuring eye fixation times on target words during normal reading. A 3 (Emotion: negative, neutral, positive) × 2 (Concreteness: abstract, concrete) design was used with 22 items per condition, with each set of six target words matched across conditions (...) in terms of word length and frequency. Abstract (e.g. shocking, reserved, fabulous) and concrete (e.g. massacre, calendar, treasure) target words appeared (separately) within contextually neutral, plausible sentences. Sixty-three participants each read all 132 experimental sentences while their eye movements were recorded. Analyses using Gamma generalised linear mixed models revealed significant effects of both Emotion and Concreteness on all fixation measures, indicating faster processing for emotional and concrete words. Additionally, there was a significant Emotion × Concreteness interaction which, critically, was modulated by Imageability in early fixation time measures. Emotion effects were significantly larger in higher-imageability abstract words than in lower-imageability ones, but remained unaffected by imageability in concrete words. These findings support the multimodal induction hypothesis and highlight the intricate interplay of these factors in the immediate stages of word processing during fluent reading. (shrink)

Inferring an individual's preferences from their observable behavior is a key step in the development of assistive decision-making technology. Although machine learning models such as neural networks could in principle be deployed toward this inference, a large amount of data is required to train such models. Here, we present an approach in which a cognitive model generates simulated data to augment limited human data. Using these data, we train a neural network to invert the model, making it possible to infer (...) preferences from behavior. We show how this approach can be used to infer the value that people assign to food items from their eye movements when choosing between those items. We demonstrate first that neural networks can infer the latent preferences used by the model to generate simulated fixations, and second that simulated data can be beneficial in pretraining a network for predicting human-reported preferences from real fixations. Compared to inferring preferences from choice alone, this approach confers a slight improvement in predicting preferences and also allows prediction to take place prior to the choice being made. Overall, our results suggest that using a combination of neural networks and model-simulated training data is a promising approach for developing technology that infers human preferences. (shrink)

The E-Z Reader model (Reichle et al. 1998; 1999) provides a theoretical framework for understanding how word identification, visual processing, attention, and oculomotor control jointly determine when and where the eyes move during reading. In this article, we first review what is known about eye movements during reading. Then we provide an updated version of the model (E-Z Reader 7) and describe how it accounts for basic findings about eye movement control in reading. We then review several alternative models (...) of eye movement control in reading, discussing both their core assumptions and their theoretical scope. On the basis of this discussion, we conclude that E-Z Reader provides the most comprehensive account of eye movement control during reading. Finally, we provide a brief overview of what is known about the neural systems that support the various components of reading, and suggest how the cognitive constructs of our model might map onto this neural architecture. Key Words: attention; eye-movement control; E-Z Reader; fixations; lexical access; models; reading; regressions; saccades. (shrink)

This commentary focuses on two aspects of eye movement behaviour that E-Z Reader 7 currently makes no attempt to explain: the influence of higher order psycholinguistic processes on fixation durations, and orthographic influences on initial and refixation locations on words. From our understanding of the current version of the model, it is not clear how it may be readily modified to account for existing empirical data.

An important question about eye-movement behavior is when the decision is made to terminate a fixation and program the following saccade. Different approaches have found converging evidence in favor of a mixed-control account, in which there is some overlap between processing information at fixation and planning the following saccade. We examined one interesting instance of mixed control in visual search: lag-2 revisits, during which observers fixate a stimulus, move to a different stimulus, and then revisit the first stimulus (...) on the next fixation. Results show that the probability of lag-2 revisits occurring increased with the number of target-similar stimuli, and revisits were preceded by a brief fixation on the intervening distractor stimulus. We developed the Efficient Visual Sampling computational model to simulate our findings and to provide insight into mixed control of fixations and the perceptual, cognitive, and motor processes that produce lag-2 revisits. (shrink)

Numerous studies have focused on the understanding of rapid automatized naming, which can be applied to predict reading abilities and developmental dyslexia in children. Eye tracking technique, characterizing the essential ocular activities, might have the feasibility to reveal the visual and cognitive features of RAN. However, traditional measures of eye movements ignore many dynamical details about the visual and cognitive processing of RAN, and are usually associated with the duration of time spent on some particular areas of interest, (...) class='Hi'>fixation counts, revisited fixation counts, saccadic velocities, or saccadic amplitudes. To cope with this drawback, we suggested an entropy-based method to measure eye movements for the first time, which first mapped eye movements during RAN in a time-series and then analyzed the time-series by a proper definition of entropy from the perspective of information theory. Our findings showed that the entropy was more sensitive to reflect small perturbation of eye movements, and thus gained better performance than traditional measures. We also verified that the entropy of eye movements significantly deceased with the age and the task complexity of RAN, and significantly correlated with traditional eye-movement measures [e.g., total time of naming ] and the RAN-related skills [e.g., selective attention, cognitive speed, and visual-motor integration]. Our findings may bring some new insights into the understanding of both RAN and eye tracking technique itself. (shrink)

The present study examined whether cinematographic editing density affects viewers’ perception of time. As a second aim, based on embodied models that conceive time perception as strictly connected to the movement, we tested the hypothesis that the editing density of moving images also affects viewers’ eye movements and that these later mediate the effect of editing density on viewers’ temporal judgments. Seventy participants watched nine video clips edited by manipulating the number of cuts (slow‐ and fast‐paced editing against a (...) master shot, unedited condition). For each editing density, multiple video clips were created, representing three different kinds of routine actions. The participants’ eye movements were recorded while watching the video, and the participants were asked to report duration judgments and subjective passage of time judgments after watching each clip. The results showed that participants subjectively perceived that time flew more while watching fast‐paced edited videos than slow‐paced or unedited videos; by contrast, concerning duration judgments, participants overestimated the duration of fast‐paced videos compared to the master‐shot videos. Both the slow‐ and the fast‐paced editing generated shorter fixations than the master shot, and the fast‐paced editing led to shorter fixations than the slow‐paced editing. Finally, compared to the unedited condition, editing led to an overestimation of durations through increased eye mobility. These findings suggest that the editing density of moving images by increasing the number of cuts effectively altered viewers’ experience of time and add further evidence to prior research showing that performed eye movement is associated with temporal judgments. (shrink)

The target article retains the traditional account of saccades as conjugate eye movements. However, recent single-unit recordings of premotor cells in the saccade pathway (excitatory burster neurons [EBNs]) found that they do not encode conjugate eye velocity, but rather, monocular eye velocity. These data argue against the traditional concept of saccades as inherently conjugate. Instead, they suggest a monocular mechanism in the sensorimotor transformation stage of saccade generation. This commentary will discuss the implications of these data for the saccade (...) generation model proposed in Findlay & Walker's target article. (shrink)

We demonstrate “economies of experience” in eye-movement patterns—that is, optimization of eye-movement patterns aimed at more efficient and less costly visual processing, similar to the priming-induced formation of sparser cortical representations or reduced reaction times. Participants looked at Mooney-type, degraded stimuli that were difficult to recognize without prior experience, but easily recognizable after exposure to their undegraded versions. As predicted, eye-movement dispersion, velocity, and the number of fixations decreased with each stimulus presentation. Further analyses showed that this effect was contingent (...) on recognition, and the selection of information from the stimulus could be informed by the identity of the presented object. Finally, our study demonstrates that after exposure to the undegraded version of the stimulus, eye-movement patterns associated with its degraded and undegraded versions become more similar. This suggests that eye-movement patterns can evolve to facilitate the optimal processing of a given stimulus via experience-driven perceptual learning. (shrink)

In isolated English word reading, readers have the optimal performance when their initial eye fixation is directed to the area between the beginning and word center, that is, the optimal viewing position (OVP). Thus, how well readers voluntarily direct eye gaze to this OVP during isolated word reading may be associated with reading performance. Using Eye Movement analysis with Hidden Markov Models, we discovered two representative eye movement patterns during lexical decisions through clustering, which focused at the OVP and (...) the word center, respectively. Higher eye movement similarity to the OVP-focusing pattern predicted faster lexical decision time in addition to cognitive abilities and lexical knowledge. However, the OVP-focusing pattern was associated with longer isolated single letter naming time, suggesting conflicting visual abilities required for identifying isolated letters and multi-letter words. In contrast, in both word and pseudoword naming, although clustering did not reveal an OVP-focused pattern, higher consistency of the first fixation as measured in entropy predicted faster naming time in addition to cognitive abilities and lexical knowledge. Thus, developing a consistent eye movement pattern focusing on the OVP is essential for word orthographic processing and reading fluency. This finding has important implications for interventions for reading difficulties. (shrink)

Remote interpreting via video-link is increasingly being employed in investigative interviews chiefly due to its apparent increased accessibility and efficiency. However, risks of miscommunication have been shown to be magnified in remote interpreting and empirical research specifically on video-link remote interpreting is in its infancy which greatly limits the evidence base available to inform and direct evidence-based policy and best practice, particularly in the identification of the optimal mode of interpreting to be used, namely consecutive and simultaneous. Consecutive interpreting refers (...) to a process in which the interpreter transfers short segments of speech from one language into the other as each person speaks in managed turn-taking, while simultaneous interpreting refers to the transfer of natural speech from one language into another in a concurrent manner without the need for speakers to segment their speech. This study provides novel empirical evidence by using eye tracking to compare the overt visual attention of interpreters working in a remote setting in which an English-speaking Interviewer interacts with a non-English-speaking Suspect in person, for whom interpretation is provided via video-link in real time. Using a within-subject design, we analyze eye-movement data from 28 professionally accredited interpreters who interpreted via video-link an investigative interview in which consecutive and simultaneous interpreting modes were counterbalanced. Taking interpreting performance into account, our results showed that, the consecutive mode yielded significantly less gaze time and therefore significantly less on-screen overt visual attention due to off-screen notetaking, an essential component of the consecutive interpreting mode. Relative to gaze time, the consecutive mode also resulted in significantly more and longer fixations and shifts of attention. Participants also allocated significantly more overt visual attention to the Interviewer than the Suspect, particularly in the consecutive mode. Furthermore, we found informative significant correlations between eye tracking measures and interpreting performance: accuracy, verbal rapport, and management. Finally, we found no significant differences between the three language pairs tested. We conclude with a discussion of limitations and the contributions of the study and an outline for future work on this topic of growing importance. (shrink)

While positive psychology has drawn increasing interests among researchers in the SLA literature recently, little is known with respect to the relationship between positive psychology and mental processes during L2 reading. To bridge the gap, the present study investigated whether and how positive psychology (self-efficacy) influences word reading strategies during L2 sentence reading. Based on previous studies, eye-movement patterns with first-fixation locations closer to the beginning of a word can be characterized as an attempt to process the word with (...) a local strategy, whereas first-fixation locations farther away from the beginning and closer to the center of a word can be considered as an attempt to use a global strategy. Eye movements of a group of Japanese learners of English (N = 59) were monitored, and L2 reading self-efficacy was used to assess the participants’ positive belief towards their L2 reading skills. Based on B. L. Fredrickson’s (1998) broaden-and-build theory, we predicted an effect of L2 reading self-efficacy on participants’ first-fixation locations. Results from mixed-effects regression showed that while reading strategies depended in part on other factors such as L2 reading proficiency and word properties, L2 self-efficacy influenced reading strategy. The present data suggest that while more self-efficacious L2 readers prefer a more efficient global strategy, attempting to read the word as a whole word, less self-efficacious L2 readers tend to employ a local strategy, focusing more on sublexical information. These findings lend support to the broaden-and-build theory in the context of L2 processing. The present study has implications for how positive psychology works along with L2 proficiency in the development of strategic selection during reading. (shrink)

In order to investigate whether addressees can make immediate use of speaker‐based constraints during reference resolution, participant addressees' eye movements were monitored as they helped a confederate cook follow a recipe. Objects were located in the helper's area, which the cook could not reach, and the cook's area, which both could reach. Critical referring expressions matched one object (helper's area) or two objects (helper's and cook's areas), and were produced when the cook's hands were empty or full, which defined (...) the cook's reaching ability constraints. Helper's first and total fixations showed that they restricted their domain of interpretation to their own objects when the cook's hands were empty, and widened it to include the cook's objects only when the cook's hands were full. These results demonstrate that addressees can quickly take into account task‐relevant constraints to restrict their referential domain to referents that are plausible given the speaker's goals and constraints. (shrink)

Despite the importance of effective observational analysis in the technical aspects of climbing performance, limited research informs this aspect of climbing coach education. Thus, the purpose of the present research was to explore cognitive-perceptual mechanisms underpinning visual search strategies of expert and novice climbing coaches through the novel combination of eye-tracking technology and retrospective think-aloud methodology. Analysis of gaze data revealed expert climbing coaches to demonstrate fewer fixations of greater duration, and fixate on distinctly different areas of the visual display, (...) than their novice counterparts. Retrospective think-aloud interviews further demonstrated differences in the cognitive-perceptual mechanisms underpinning these visual search strategies, with expert coaches more cognisant of their visual search strategy. To expand, the gaze behaviour of expert climbing coaches was underpinned by hierarchical and complex knowledge structures relating to principles of climbing movement. This enabled expert coaches to actively focus on the most relevant aspects of a climber’s performance for analysis. Findings demonstrate the utility of combining eye tracking and retrospective think-aloud interviewing as a new, efficient methodology of capturing the cognitive-perceptual processes of climbing coaches to inform coaching education/strategies. (shrink)

Eye movements were recorded during the display of two images of a real-world scene that were inspected to determine whether they were the same or not . In the displays where the pictures were different, one object had been changed, and this object was sometimes taken from another scene and was incongruent with the gist. The experiment established that incongruous objects attract eye fixations earlier than the congruous counterparts, but that this effect is not apparent until the picture has (...) been displayed for several seconds. By controlling the visual saliency of the objects the experiment eliminates the possibility that the incongruency effect is dependent upon the conspicuity of the changed objects. A model of scene perception is suggested whereby attention is unnecessary for the partial recognition of an object that delivers sufficient information about its visual characteristics for the viewer to know that the object is improbable in that particular scene, and in which full identification requires foveal inspection. (shrink)

ABSTRACT Present-day fixations on “embodied minds,” and “enactive” assessments of life fail to recognize alive, moving bodies, precisely as James Joyce implicitly shows in his experience-anchored descriptions of the ineluctable modality of the visual and of the audible. Joyce's experience-anchored descriptions accord with Edmund Husserl's renditions of “the kinestheses” and their integral relationship to perception and to the development of agency. They furthermore accord with John Dewey's writing on aesthetics that describe the immediacy of motion into sense and sense into (...) motion in both nonhuman animal life and aesthetic experience. William James's connection of the stream of thinking with the stream of breathing is in further accord. Such accords show that animate forms of life are essentially mindful bodies sensuously and affectively attuned to their surrounding world. Cave art, both its creation and appreciation, is further testimony to mindful bodies as is internationally known musician Roger Sessions eloquent descriptions documenting the integrality of movement to all the arts. All such accords testify to the central and essential presence of the sense modality of movement—kinesthesia—and its bodily engaged dynamics in animate life and in art. (shrink)

The role of titles in perception of visual art is a topic of interesting discussions that brings together artists, curators, and researchers. Titles provide contextual cues and guide perception. They can be particularly useful when paintings include semantic violations that make them challenging for viewers, especially viewers lacking expert knowledge. The aim of this study is to investigate the effects of titles and semantic violations on eye movements. A total of 127 participants without expertise in visual art viewed 40 (...) paintings with and without semantic violations in one of three conditions: untitled, consistent titles and inconsistent titles. After each painting was viewed participants also rated liking and understanding. Our results suggest that titles affect the way paintings are viewed: both titled conditions were associated with shorter first fixation duration, longer saccade durations, and amplitudes and higher dynamic entropy than the untitled conditions. Titles were fixated on more frequently when presented alongside paintings with semantic violations than paintings without violations, and the percentage of fixations to titles was particularly high in the case of paintings with double inconsistencies. Also, we found that semantic violations attracted attention early on, whereas titles received attention later and inconsistencies in titles were processed even later. Finally, semantic violations were associated with higher dynamic entropy than paintings without violations. Our results demonstrate the importance of titles for processing of artworks, especially artworks that present a challenge for the viewers. (shrink)

We identify two aspects of the problem of maintaining perceptual stability despite an observer's eye movements. The first, visual direction constancy, is the (egocentric) stability of apparent positions of objects in the visual world relative to the perceiver. The second, visual position constancy, is the (exocentric) stability of positions of objects relative to each other. We analyze the constancy of visual direction despite saccadic eye movements.Three information sources have been proposed to enable the visual system to achieve stability: (...) the structure of the visual field, proprioceptive inflow, and a copy of neural efference or outflow to the extraocular muscles. None of these sources by itself provides adequate information to achieve visual direction constancy; present evidence indicates that all three are used.Our final question concerns how information processing operations result in a stable world. The three traditionally suggested means have been elimination, translation, or evaluation. All are rejected. From a review of the physiological and psychological evidence we conclude that no subtraction, compensation, or evaluation need take place. The problem for which these solutions were developed turns out to be a false one. We propose a “calibration” solution: correct spatiotopic positions are calculated anew for each fixation. Inflow, outflow, and retinal sources are used in this calculation: saccadic suppression of displacement bridges the errors between these sources and the actual extent of movement. (shrink)

We explore the idea that eye-movement strategies in reading are precisely adapted to the joint constraints of task structure, task payoff, and processing architecture. We present a model of saccadic control that separates a parametric control policy space from a parametric machine architecture, the latter based on a small set of assumptions derived from research on eye movements in reading (Engbert, Nuthmann, Richter, & Kliegl, 2005; Reichle, Warren, & McConnell, 2009). The eye-control model is embedded in a decision architecture (...) (a machine and policy space) that is capable of performing a simple linguistic task integrating information across saccades. Model predictions are derived by jointly optimizing the control of eye movements and task decisions under payoffs that quantitatively express different desired speed-accuracy trade-offs. The model yields distinct eye-movement predictions for the same task under different payoffs, including single-fixation durations, frequency effects, accuracy effects, and list position effects, and their modulation by task payoff. The predictions are compared to—and found to accord with—eye-movement data obtained from human participants performing the same task under the same payoffs, but they are found not to accord as well when the assumptions concerning payoff optimization and processing architecture are varied. These results extend work on rational analysis of oculomotor control and adaptation of reading strategy (Bicknell & Levy, ; McConkie, Rayner, & Wilson, 1973; Norris, 2009; Wotschack, 2009) by providing evidence for adaptation at low levels of saccadic control that is shaped by quantitatively varying task demands and the dynamics of processing architecture. (shrink)

Reichle et al. argue that the mechanism that determines where to fixate the eyes is controlled mostly by low-level processes. Therefore, unlike other competing models (e.g., the SWIFT model), the E-Z Reader model cannot account for “global” regressions as a result of linguistic difficulties. We argue that the model needs to be extended to account for regressive saccades.

It is argued here that a critical prediction of the E-Z Reader model is that experimental manipulations that disrupt early encoding of visual and orthographic features of the fixated word without affecting subsequent lexical processing should influence the processing difficulty of the fixated word without producing any processing effect on the next word. This prediction is explained and illustrated.

The use of visual attention for evaluating consumer behavior has become a relevant field in recent years, allowing researchers to understand the decision-making processes beyond classical self-reports. In our research, we focused on using eye-tracking as a method to understand consumer preferences in children. Twenty-eight subjects with ages between seven and twelve years participated in the experiment. Participants were involved in two consecutive phases. The initial phase consisted of the visualization of a set of stimuli for decision-making in an eight-position (...) layout called Alternative Forced-choice. Then the subjects were asked to freely analyze the set of stimuli, they needed to choose the best in terms of preference. The sample was randomly divided into two groups balanced by gender. One group visualized a set of icons and the other a set of toys. The final phase was an independent assessment of each stimulus viewed in the initial phase in terms of liking/disliking using a 7-point Likert scale. Sixty-four stimuli were designed for each of the groups. The visual attention was measured using a non-obstructive eye-tracking device. The results revealed two novel insights. Firstly, the time of fixation during the last 4 visits to each stimulus before the decision-making instant allows us to recognize the icon or toy chosen from the eight alternatives with a 71.2% and 67.2% of accuracy respectively. The result supports the use of visual attention measurements as an implicit tool to analyze decision-making and preferences in children. Secondly, eye movement and the choice of liking/disliking choice are influenced by stimuli design dimensions. The icon observation results revealed how gender samples have different fixation and different visit times which depend on stimuli design dimension. The toy observations results revealed how the materials determinate the largest amount fixations, also, the visit times were differentiated by gender. This research presents a relevant empirical data to understand the decision-making phenomenon by analyzing eye movement behavior. The presented method can be applied to recognize the choice likelihood between several alternatives. Finally, children's opinions represent an extra difficulty judgment to be determined, and the eye-tracking technique seen as an implicit measure to tackle it. (shrink)

In order to solve the problem of unsmooth and inefficient human-computer interaction process in the information age, a method for human-computer interaction intention prediction based on electroencephalograph signals and eye movement signals is proposed. This approach is different from previous methods where researchers predict using data from human-computer interaction and a single physiological signal. This method uses the eye movements and EEG signals that clearly characterized the interaction intention as the prediction basis. In addition, this approach is not only (...) tested with multiple human-computer interaction intentions, but also takes into account the operator in different cognitive states. The experimental results show that this method has some advantages over the methods proposed by other researchers. In Experiment 1, using the eye movement signal fixation point abscissa Position X, fixation point ordinate Position Y, and saccade amplitude to judge the interaction intention, the accuracy reached 92%, In experiment 2, only relying on the pupil diameter, pupil size and fixed time, fixed time of eye movement signals can not achieve higher accuracy of the operator’s cognitive state, so EEG signals are added. The cognitive state was identified separately by combining the screened EEG parameters Rα/β with the eye movement signal pupil diameter and fixation time, with an accuracy of 91.67%. The experimental combination of eye movement and EEG signal features can be used to predict the operator’s interaction intention and cognitive state. (shrink)

Nothing could be more helpful to present philosophizing than a “Back to Plato” movement; but it would have to be back to the dramatic, restless, cooperatively inquiring Plato of the Dialogues, trying one mode of attack after another to see what it might yield; back to the Plato whose highest flight of metaphysics always terminated with a social and practical turn, and not to the artificial Plato constructed by unimaginative commentators who treat him as the original university professor. The suggestion (...) that pragmatism must return to the Platonic dialogues is an interesting one. Dewey suggests that pragmatism, and philosophy on the whole, would benefit from revisiting the “dramatic, restless,... inquiring.. (shrink)

Background: Neurotypical young adults show task-based modulation and stability of their eye movements across tasks. This study aimed to determine whether persons with aphasia (PWA) modulate their eye movements and show stability across tasks similarly to control participants. Methods: Forty-eight PWA and age-matched control participants completed four eye-tracking tasks: scene search, scene memorization, text-reading, and pseudo-reading. Results: Main effects of task emerged for mean fixation duration, saccade amplitude, and standard deviations of each, demonstrating task-based modulation of eye (...) movements. Group by task interactions indicated that PWA produced shorter fixations relative to controls. This effect was most pronounced for scene memorization and for individuals who recently suffered a stroke. PWA produced longer fixations, shorter saccades, and less variable eye movements in reading tasks compared to controls. Three-way interactions of group, aphasia subtype, and task also emerged. Text-reading and scene memorization were particularly effective at distinguishing aphasia subtype. Persons with anomic aphasia showed a reduction in reading saccade amplitudes relative to their respective control group and other PWA. Persons with conduction/Wernicke’s aphasia produced shorter scene memorization fixations relative to controls or PWA of other subtypes, suggesting a memorization specific effect. Positive correlations across most tasks emerged for fixation duration and did not significantly differ between controls and PWA. Conclusions: PWA generally produced shorter fixations and smaller saccades relative to controls particularly in scene memorization and text-reading respectively. The effect was most pronounced recently after a stroke. Selectively in reading tasks, PWA produced longer fixations and shorter saccades relative to controls, consistent with reading difficulty. PWA showed task-based modulation of eye movements, though the pattern of results was somewhat abnormal relative to controls. All subtypes of PWA also demonstrated task-based modulation of eye movements. However, persons with anomic aphasia showed reduced modulation of saccade amplitude and smaller reading saccades, possibly to improve reading comprehension. Controls and PWA generally produced stabile fixation durations across tasks and did not differ in their relationship across tasks. Overall, these results suggest there is potential to differentiate among PWA with varying subtypes and from controls using eye movement measures of task-based modulation, especially reading and scene memorization tasks. (shrink)

With only two to five slots of visual working memory (VWM), humans are able to quickly solve complex visual problems to near optimal solutions. To explain the paradox between tightly constrained VWM and impressively complex human visual problem‐solving ability, we propose several principles for dynamic VWM allocation. In particular, we propose that complex visual information is represented in a temporal manner using only a few slots of VWM that include global and local visual chunks. We built a model of human (...) traveling salesman problem solving based on these principles of VWM allocation and tested the model with eye‐movement data. Exactly as the model predicted, human eye movements during traveling salesman problem solving have precise quantitative regularities with regard to both the general statistical pattern of attentional fixations and how they vary across individuals with different VWM capacities. Even though VWM capacity is very limited, eye movements dynamically allocate VWM resources to both local and global information, enabling attention to fine details without loss of the big picture. (shrink)

Inattentional Blindness occurs when observers engaged in resource-consuming tasks fail to see unexpected stimuli that appear in their visual field. Eye movements were recorded in a dynamic IB task where participants tracked targets amongst distractors. During the task, an unexpected stimulus crossed the screen for several seconds. Individuals who failed to report the unexpected stimulus were deemed to be IB. Being IB was associated with making more fixations and longer gaze times on distractor stimuli, being less likely to fixate (...) the unexpected stimulus, and having lower working memory capacity than those who were not IB. Noticing the unexpected stimulus was not contingent upon fixating it, suggesting that some individuals processed the unexpected stimulus via covert attention. The findings support earlier research on working memory and IB. In addition, IBs were less efficient attentional allocators than those who were not IB, as reflected in their eye tracking of irrelevant distractors. (shrink)

In the last decade, we have observed a continuous increase of interest in eye movement research. According to a recent investigation, eye movements are discussed in over one million publications. The number of publications with eye movement in the title or abstract has been steadily increasing over the years, with over 1,200 papers published alone in 2013. The last decade has also witnessed the emergence of many new sub-disciplines in the field of neuroscience and cognition - one of them (...) is neuroaesthetics, which refers to the [neuro-]science of aesthetic perception of art.The title and contents of our book have been inspired by a very influential research article. It is one of the most cited scientific papers of all time, published in 1959 by a team of neurophysiologists and engineers, Lettvin, McCulloch and Pitts who are considered to be the founders of modern cybernetics. Their article, "What the Frog's Eye Tells the Frog's Brain," refers to the role of internal cortical models in the communication or interfacing of the information in the outside world with the practical contextual task of the viewer. It shows how eye movements are the modality of this communication. The same duality between eye movements and internal models plays a fundamental role in humans. When we look, for example, at art, it explains those neurological processes involved in neuroaesthetics. Our book undertakes this innovative approach to neuroaesthetics. It explains this duality and discusses the communication between the artist and the viewer's aesthetic perception. It is structured into five chapters.Chapter One discusses the neurology of aesthetics, the idea of art as a form of communication, and explains perception as an active matching between a "top" (the viewer's mind) and a "down" (the viewer's sensorial machinery). It goes deep into the philosophical quandary of what beauty is in terms of art. Chapter Two is about eye movements and the scanpath theory of vision perception. It discusses the role of visual attention for controlling active vision, the meaning of mental binding and the analysis of eye movements as the key to understanding aesthetic processes. Chapter Three introduces Claude Shannon's information theory using it as a matrix into which to embed the top down active vision scanpath theory. The authors explain the main concept of neuroaesthetics as a form of communication mediated by the sequence of eye fixations. Chapter Four discusses art critique: The role of the viewer's training and expectation, the dilemma of the aesthetics of art versus non-art and how all of this affects the viewing mode. Finally, Chapter Five treats the intimacy of the artistic process, showing the unique implementation of the communicative experience between the artist and the viewer - the relation between a pictorial representation defined by the artist and modes of AWE generated in the viewer during active looking. (shrink)

The present study used eye tracking methodology to examine rereading benefits for spatially transformed text. Eye movements were monitored while participants read the same target word twice, in two different low-constraint sentence frames. The congruency of perceptual processing was manipulated by either applying the same type of transformation to the word during the first and second presentations , or employing two different types of transformations across the two presentations of the word . Perceptual specificity effects were demonstrated such that (...) fixation times for the second presentation of the target word were shorter for the congruent condition compared to the incongruent condition. Moreover, we demonstrated an additional perceptually non-specific effect such that second reading fixation times were shorter for the incongruent condition relative to a baseline condition that employed a normal typography during the first presentation and a transformation during the second presentation. Both of these effects were similar in magnitude for high and low frequency words, and both effects persisted across a 1 week lag between the first and second readings. We discuss the present findings in the context of the distinction between conscious and unconscious memory, and the distinction between perceptually versus conceptually driven processing. (shrink)

The results of two experiments are analyzed to find out how artistic expertise influences visual search. Experiment I comprised survey data of 1,065 students on self-reported visual memory skills and their ability to find three targets in four images of artwork. Experiment II comprised eye movement data of 50 Visual Literacy experts and non-experts whose eye movements during visual search were analyzed for nine images of artwork as an external validation of the assessment tasks performed in Sample I. No (...) time constraint was set for completion of the visual search task. A latent profile analysis revealed four typical solution patterns for the students in Sample I, including a mainstream group, a group that completes easy images fast and difficult images slowly, a fast and erroneous group, and a slow working student group, depending on task completion time and on the probability of finding all three targets. Eidetic memory, performance in art education and visual imagination as self-reported visual skills have significant impact on latent class membership probability. We present a hidden Markov model approach to uncover underlying regions of attraction that result from visual search eye-movement behavior in Experiment II. VL experts and non-experts did not significantly differ in task time and number of targets found but they did differ in their visual search process: compared to non-experts, experts showed greater precision in fixating specific prime and target regions, assessed through hidden state fixation overlap. Exploratory analysis of HMMs revealed differences between experts and non-experts in image locations of attraction. Experts seem to focus their attention on smaller image parts whereas non-experts used wider parts of the image during their search. Differences between experts and non-experts depend on the relative saliency of targets embedded in images. HMMs can determine the effect of expertise on exploratory eye movements executed during visual search tasks. Further research on HMMs and art expertise is required to confirm exploratory results. (shrink)

Punning is an important means of creating humorous effects by intentionally exploiting semantic ambiguity. Previous psycholinguistic research on puns has mainly focused on the process of meaning retrieval in homograph puns, while it is still not entirely clear how readers dynamically utilize contextual information to understand homophone puns. In the current investigation, 68 native Chinese participants were recruited to read three types of experimental sentences while their eye movements were recorded: the homophone-pun sentences where the less salient homophone was (...) visually presented, the homophone-salient sentences where the salient homophone was used, and the homophone-error sentences where the critical context noun in the homophone puns was replaced with an unrelated word. Humor rating results of the homophone puns and the homophone-salient sentences demonstrated that the less salient homophones rather than the salient ones elicited much larger humor responses when presented visually in the same potential pun context. In addition, the reverse fixation pattern in the homophone area and the spill-over region also suggested that meanings of the salient homophones were more recoverable even when not presented visually. Statistical analyses of the homophone puns and the homophone-error sentences showed that the semantic relatedness between the critical context noun and the less salient homophone could significantly predict the humor rating scores of Chinese readers. Taken together, less salient homophones need to receive more contextual support to balance out the advantages of salient homophones before generating a humorous pun interpretation. (shrink)