Our brains readily decode facial movements and changes in social attention, reflected in earlier and larger N170 event-related potentials (ERPs) to viewing gaze aversions vs. direct gaze in real faces (Puce et al. 2000). In contrast, gaze aversions in line-drawn faces do not produce these N170 differences (Rossi et al., 2014), suggesting that physical stimulus properties or experimental context may drive these effects. Here we investigated the role of stimulus-induced context on neurophysiological responses to dynamic gaze. Sixteen healthy adults (...) viewed line-drawn and real faces, with dynamic eye aversion and direct gaze transitions, and control stimuli (scrambled arrays and checkerboards) while continuous electroencephalographic (EEG) activity was recorded. EEG data from 2 temporo-occipital clusters of 9 electrodes in each hemisphere where N170 activity is known to be maximal were selected for analysis. N170 peak amplitude and latency, and temporal dynamics from event-related spectral perturbations (ERSPs) were measured in 16 healthy subjects. Real faces generated larger N170s for averted vs. direct gaze motion, however, N170s to real and direct gaze were as large as those to respective controls. N170 amplitude did not differ across line-drawn gaze changes. Overall, bilateral mean gamma power changes for faces relative to control stimuli occurred between 150-350 ms, potentially reflecting signal detection of facial motion. Our data indicate that experimental context does not drive N170 differences to viewed gaze changes. Low-level stimulus properties, such as the high sclera/iris contrast change in real eyes likely drive the N170 changes to viewed aversive movements. (shrink)

The artistic work of photographer Gudio Baselgia focuses on landscapes formed by nature s forces and, more recently, on the sky with the stellar and solar movements and phenomena as we see them from earth. Celestial mechanics have fascinated mankind in all known cultures, the Babylonians and ancient Egyptians as well as the Greek and Celts, the Maya, or the ancient Indians and Chinese. Until the present day we look at the sky and keep being amazed, and try to (...) read what it tells us. Many artists throughout history have been captivated by the spectacle we observe above us day and night. The modern term astrodynamics describes all movements of celestial bodies, in particular the solar system including the moon and other satellites, asteroids and comets, but also movements of stars within a stellar system or galaxy, or of galaxies towards each other. They are well understood today and depicted in coordinate systems and elaborate visualizations. Guido Baselgia s artistic project on astrodynamics and celestial phenomena has no scientific or didactic ambition. His analogue camera is used as a recorder inscribing the movement of stars on the light-sensitive surface of photographic paper. Thus Baselgia s images make traceable the trajectory of celestial bodies invisible to the human eye and show us astounding occurrences of light and shadow. Baselgia has been captivated in particular also by the phenomenon of the umbra, planet earth s shadow thrown into space. It becomes visible occasionally on a clear evening at sunset when a slight mist lies at the horizon: looking in opposite direction to the sun, a dark and sharply marked band of shadow can be seen rising while sun sets behind the observer. But also by recording sunrise and sunset at the polar circle or the tropic, Baselgia visualizes the geometry of celestial mechanics and the concurrence of forces, as well as the miracle of light as such that leaves us awestruck today as much as it did our ancestors. The new book "Guido Baselgia Light Fall" presents 80 outstanding black-and-white images from the artist s Light Fall project taken in Norway, the Tierra del Fuego archipelago in Argentina, in Ecuador, and the Swiss Alps. The brilliant tritone plates are complemented with essays by the German scholar Andrea Gnam and Swiss photography critic Nadine Olonetzky. ". (shrink)

The focus of this chapter is the relationship between synaesthesia, attention and eye movements. The measurement of eye movements as a core experimental tool for gaining insight into complex cognitive processes in general and attentional mechanisms more specifically, is now firmly established. By means of eye movements, the neural basis of higher cognitive processes, such as target selection, working memory, and response suppression, can be investigated. It therefore seems logical that eye movement recordings can also be used (...) to investigate a complex phenomenon like synaesthesia. In this chapter, we will start with a section summarizing the relationship between eye movements and attention in general. Then the focus moves to synaesthesia and what we currently know about synaesthesia based on the method of measuring eye movements. Finally, we discuss pupillometry which provides a window on changes in the 'allocation' of attention and the 'consolidation' of perception. Consequently, it offers a useful technique for probing 'changes' in mental states due synaesthetic perceptions. (shrink)

We investigated the coupling between a speaker's and a listener's eye movements. Some participants talked extemporaneously about a television show whose cast members they were viewing on a screen in front of them. Later, other participants listened to these monologues while viewing the same screen. Eye movements were recorded for all speakers and listeners. According to cross‐recurrence analysis, a listener's eye movements most closely matched a speaker's eye movements at a delay of 2 sec. Indeed, the (...) more closely a listener's eye movements were coupled with a speaker's, the better the listener did on a comprehension test. In a second experiment, low‐level visual cues were used to manipulate the listeners' eye movements, and these, in turn, influenced their latencies to comprehension questions. Just as eye movements reflect the mental state of an individual, the coupling between a speaker's and a listener's eye movements reflects the success of their communication. (shrink)

Inattentional Blindness occurs when observers engaged in resource-consuming tasks fail to see unexpected stimuli that appear in their visual field. Eye movements were recorded in a dynamic IB task where participants tracked targets amongst distractors. During the task, an unexpected stimulus crossed the screen for several seconds. Individuals who failed to report the unexpected stimulus were deemed to be IB. Being IB was associated with making more fixations and longer gaze times on distractor stimuli, being less likely to fixate (...) the unexpected stimulus, and having lower working memory capacity than those who were not IB. Noticing the unexpected stimulus was not contingent upon fixating it, suggesting that some individuals processed the unexpected stimulus via covert attention. The findings support earlier research on working memory and IB. In addition, IBs were less efficient attentional allocators than those who were not IB, as reflected in their eye tracking of irrelevant distractors. (shrink)

How important is the ability to freely control eye movements for reading comprehension? And how does the parser make use of this freedom? We investigated these questions using coregistration of eye movements and event‐related brain potentials (ERPs) while participants read either freely or in a computer‐controlled word‐by‐word format (also known as RSVP). Word‐by‐word presentation and natural reading both elicited qualitatively similar ERP effects in response to syntactic and semantic violations (N400 and P600 effects). Comprehension was better in free (...) reading but only in trials in which the eyes regressed to previous material upon encountering the anomaly. A more fine‐grained ERP analysis revealed that these regressions were strongly associated with the well‐known P600 effect. In trials without regressions, we instead found sustained centro‐parietal negativities starting at around 320 ms post‐onset; however, these negativities were only found when the violation occurred in sentence‐final position. Taken together, these results suggest that the sentence processing system engages in strategic choices: In response to words that don't match built‐up expectations, it can either explore alternative interpretations (reflected by regressions, P600 effects, and good comprehension) or pursue a “good‐enough” processing strategy that tolerates a deficient interpretation (reflected by progressive saccades, sustained negativities, and relatively poor comprehension). (shrink)

ABSTRACTThe present study examined the effects of emotions on eye movements, head motion, and iPad motion during reading. Thirty-one participants read neutral, emotionally negative texts and emotio...

Punning is an important means of creating humorous effects by intentionally exploiting semantic ambiguity. Previous psycholinguistic research on puns has mainly focused on the process of meaning retrieval in homograph puns, while it is still not entirely clear how readers dynamically utilize contextual information to understand homophone puns. In the current investigation, 68 native Chinese participants were recruited to read three types of experimental sentences while their eye movements were recorded: the homophone-pun sentences where the less salient homophone was (...) visually presented, the homophone-salient sentences where the salient homophone was used, and the homophone-error sentences where the critical context noun in the homophone puns was replaced with an unrelated word. Humor rating results of the homophone puns and the homophone-salient sentences demonstrated that the less salient homophones rather than the salient ones elicited much larger humor responses when presented visually in the same potential pun context. In addition, the reverse fixation pattern in the homophone area and the spill-over region also suggested that meanings of the salient homophones were more recoverable even when not presented visually. Statistical analyses of the homophone puns and the homophone-error sentences showed that the semantic relatedness between the critical context noun and the less salient homophone could significantly predict the humor rating scores of Chinese readers. Taken together, less salient homophones need to receive more contextual support to balance out the advantages of salient homophones before generating a humorous pun interpretation. (shrink)

The article reflects upon the observational practices and methods developed by the early exponents of ethology committed to naturalistic field study and explores how their approaches and techniques influenced a wider field of popular natural-history filmmaking and photography. In doing so, my focus is upon three aspects of ethological field studies: the socio-technical devices used by ethologists to bring birds closer to them, the distinctive observational and representational practices which they forged, and the analogies they used to codify behaviour. This (...) assemblage of elements included hides or screens from which to watch wild birds without disturbing them, optics to extend human vision, pens and paper to sketch and fix patterns of behaviour, watches to record timings, photography to capture action and freeze movement, and illustration and photographs to visualize behaviour. Carried through natural-history networks, the practices, methods and theories of ethologists like Huxley and Tinbergen influenced popular natural-history filmmaking and photography more broadly from the 1940s, driving a behavioural turn in these cultural practices. This popularization of the ‘ethological eye’ was further facilitated by the convergence of socio-technical devices, forms of observation and dramatization in the work of the early exponents of naturalistic field studies of birds and the popular filmmakers. (shrink)

Frontiers Events is a rapidly growing calendar management system dedicated to the scheduling of academic events. This includes announcements and invitations, participant listings and search functionality, abstract handling and publication, related events and post-event exchanges. Whether an organizer or participant, make your event a Frontiers Event!

The American Indian Movement, founded in 1968 in Minneapolis, burst into that turbulent time with passion, anger, and radical acts of resistance. Spurred by the Civil Rights movement, Native people began to protest the decades--centuries--of corruption, racism, and abuse they had endured. They argued for political, social, and cultural change, and they got attention. The photographs of activist Dick Bancroft, a key documentarian of AIM, provide a stunningly intimate view of this major piece of American history from 1970 to 1981. (...) Veteran journalist Laura Waterman Wittstock, who participated in events in Washington, DC, has interviewed a host of surviving participants to tell the stories behind the images. The words of Russell Means, Dennis Banks, Clyde Bellecourt, Eddie Benton Banai, Pat Bellanger, Elaine Salinas, Winona LaDuke, Bill Means, Ken Tilsen, Larry Leventhal, Jose Barreiro, and others tell the stories: the takeovers of federal buildings and the Winter Dam in Wisconsin, the founding of survival schools in the Twin Cities, the Wounded Knee trials, international conferences for indigenous rights, the Trail of Broken Treaties Caravan and the Longest Walk for Survival, powwows and camps and United Nations actions. This is the inside record of a movement that began to change a nation. Dick Bancroft has been the unofficial photographer for the American Indian Movement since 1970. He has traveled the world to take these photographs. Laura Waterman Wittstock, a writer and media consultant, covered the early years of the American Indian Movement as a journalist. Rigoberta Menchú Tum, recipient of the 1992 Nobel Peace Prize, is an activist for indigenous rights in Guatemala. (shrink)

We present a visual world eye-tracking study on Tseltal (a Mayan language) and investigate whether verbal information can be used to anticipate an upcoming referent. Basic word order in transitive sentences in Tseltal is Verb–Object–Subject (VOS). The verb is usually encountered first, making argument structure and syntactic information available at the outset, which should facilitate anticipation of the post-verbal arguments. Tseltal speakers listened to verb-initial sentences with either an object-predictive verb (e.g., “eat”) or a general verb (e.g., “look for”) (e.g., (...) “Ya slo’/sle ta stukel on te kereme,” Is eating/is looking (for) by himself the avocado the boy/ “The boy is eating/is looking (for) an avocado by himself”) while seeing a visual display showing one potential referent (e.g., avocado) and three distractors (e.g., bag, toy car, coffee grinder). We manipulated verb type (predictive vs. general) and recorded participants' eye movements while they listened and inspected the visual scene. Participants’ fixations to the target referent were analyzed using multilevel logistic regression models. Shortly after hearing the predictive verb, participants fixated the target object before it was mentioned. In contrast, when the verb was general, fixations to the target only started to increase once the object was heard. Our results suggest that Tseltal hearers pre-activate semantic features of the grammatical object prior to its linguistic expression. This provides evidence from a verb-initial language for online incremental semantic interpretation and anticipatory processing during language comprehension. These processes are comparable to the ones identified in subject-initial languages, which is consistent with the notion that different languages follow similar universal processing principles. (shrink)

People often make use of a spatial “mental time line” to represent events in time. We investigated whether the eyes follow such a mental time line during online language comprehension of sentences that refer to the past, present, and future. Participants' eye movements were measured on a blank screen while they listened to these sentences. Saccade direction revealed that the future is mapped higher up in space than the past. Moreover, fewer saccades were made when two events are simultaneously (...) taking place at the present moment compared to two events that are happening in different points in time. This is the first evidence that oculomotor correlates reflect mental looking along an abstract invisible time line during online language comprehension about time. Our results support the idea that observing eye movements is likely to “detect” invisible spatial scaffoldings which are involved in cognitively processing abstract meaning, even when the abstract meaning lacks an explicit spatial correlate. Theoretical implications of these findings are discussed. (shrink)

To evoke the impression of movement in the “immobile” image is one of the central motivations of the visual art, and the activating effect of images has been discussed in art psychology already some hundred years ago. However, this topic has up to now been largely neglected by the researchers in cognitive psychology and neuroscience. This study investigates – from an interdisciplinary perspective – the formation of lateralised instances of motion when an observer perceives movement in an image. A first (...) step was to identify images that evoke a perception of movement in a certain direction and to give this a rating. Reaction times leading to the engagement of a joystick following the presentation of images are used to evidence the postulated movement occasioned by the perception of movement in an image. Where the required direction of joystick moves matched the expected perception of movement direction in the image, considerably shorter reaction times were recorded. The experiment was able to prove a “movement-image compatibility effect” in observers of images. Based on this, the paper revisits and brings up to date the theses on motor sensory response to images which were developed in art psychology at the beginning of the 20th century. It furthermore contributes an embodiment theory interpretation to the prevalent representational explanation of compatibility effects. (shrink)

The neural correlates of rapid eye movements (REMs) in sleep are extraordinarily robust; including REM-locked activation in the retrosplenial cortex, the supplementary eye field and areas overlapping cholinergic basal nucleus. The phenomenology of REMs speaks to the notion that perceptual experience in both sleep and wakefulness is a constructive process – in which we generate predictions of sensory inputs and then test those predictions through actively sampling the sensorium with eye movements. On this view, REMs during sleep may (...) index an internalized active sampling or ‘scanning’ of self-generated visual constructs that are not constrained by visual input. If this view is correct, it renders REMs an ideal probe to study consciousness as “an exclusively internal affair” (Metzinger 2009). In other words, REMs offer a probe of active inference – in the sense of predictive coding – when the brain is isolated from the sensorium in virtue of the natural blockade of sensory input during REM sleep. REMs are temporally precise events that enable powerful inferences based on timeseries analyses. As a natural, task-free probe, [REMs] could be used in non-compliant subjects, including infants and animals. In short, REM constitutes a promising probe to study the ontogenetic and phylogenetic development of consciousness and perhaps its abnormal development in schizophrenia and autism, which have been considered in terms of aberrant predictive coding. (shrink)

A controversial claim in recent dual process accounts of reasoning is that intuitive processes not only lead to bias but are also sensitive to the logical status of an argument. The intuitive logic hypothesis draws upon evidence that reasoners take longer and are less confident on belief–logic conflict problems, irrespective of whether they give the correct logical response. In this paper, we examine conflict detection under conditions in which participants are asked to either judge the logical validity or believability of (...) a presented conclusion, accompanied by measures of eye movement and pupil dilation. The findings show an effect of conflict, under both types of instruction, on accuracy, latency, gaze shifts, and pupil dilation. Importantly, these effects extend to conflict trials in which participants give a belief‐based response (incorrectly under logic instructions or correctly under belief instructions) demonstrating both behavioral and physiological evidence in support of the logical intuition hypothesis. (shrink)

In two experiments, participants solved anagram problems while their eye movements were monitored. Each problem consisted of a circular array of five letters: a scrambled four-letter solution word containing three consonants and one vowel, and an additional randomly-placed distractor consonant. Viewing times on the distractor consonant compared to the solution consonants provided an online measure of knowledge of the solution. Viewing times on the distractor consonant and the solution consonants were indistinguishable early in the trial. In contrast, several seconds (...) prior to the response, viewing times on the distractor consonant decreased in a gradual manner compared to viewing times on the solution consonants. Importantly, this pattern was obtained across both trials in which participants reported the subjective experience of insight and trials in which they did not. These findings are consistent with the availability of partial knowledge of the solution prior to such information being accessible to subjective phenomenal awareness. (shrink)

Roughly 1.7 million people died in Cambodia from untreated disease, starvation, and execution during the Khmer Rouge reign of less than four years in the late 1970s. The regime’s brutality has come to be symbolized by the multitude of black-and-white mug shots of prisoners taken at the notorious Tuol Sleng prison, where thousands of “enemies of the state” were tortured before being sent to the Killing Fields. In Archiving the Unspeakable, Michelle Caswell traces the social life of these photographic (...) records through the lens of archival studies and elucidates how, paradoxically, they have become agents of silence and witnessing, human rights and injustice as they are deployed at various moments in time and space. From their creation as Khmer Rouge administrative records to their transformation beginning in 1979 into museum displays, archival collections, and databases, the mug shots are key components in an ongoing drama of unimaginable human suffering. Winner, Waldo Gifford Leland Award, Society of American Archivists Longlist, ICAS Book Prize, International Convention of Asia Scholars. (shrink)

The study of eye movements is a common way to non-invasively understand and analyze human behavior. However, eye-tracking techniques are very hard to scale, and require expensive equipment and extensive expertise. In the context of web browsing, these issues could be overcome by studying the link between the eye and the computer mouse. Here, we propose new analysis methods, and a more advanced characterization of this link. To this end, we recorded the eye, mouse, and scroll movements of (...) 151 participants exploring 18 dynamic web pages while performing free viewing and visual search tasks for 20 s. The data revealed significant differences of eye, mouse, and scroll parameters over time which stabilize at the end of exploration. This suggests the existence of a task-independent relationship between eye, mouse, and scroll parameters, which are characterized by two distinct patterns: one common pattern for movement parameters and a second for dwelling/fixation parameters. Within these patterns, mouse and eye movements remained consistent with each other, while the scrolling behaved the opposite way. (shrink)

The use of visual attention for evaluating consumer behavior has become a relevant field in recent years, allowing researchers to understand the decision-making processes beyond classical self-reports. In our research, we focused on using eye-tracking as a method to understand consumer preferences in children. Twenty-eight subjects with ages between seven and twelve years participated in the experiment. Participants were involved in two consecutive phases. The initial phase consisted of the visualization of a set of stimuli for decision-making in an eight-position (...) layout called Alternative Forced-choice. Then the subjects were asked to freely analyze the set of stimuli, they needed to choose the best in terms of preference. The sample was randomly divided into two groups balanced by gender. One group visualized a set of icons and the other a set of toys. The final phase was an independent assessment of each stimulus viewed in the initial phase in terms of liking/disliking using a 7-point Likert scale. Sixty-four stimuli were designed for each of the groups. The visual attention was measured using a non-obstructive eye-tracking device. The results revealed two novel insights. Firstly, the time of fixation during the last 4 visits to each stimulus before the decision-making instant allows us to recognize the icon or toy chosen from the eight alternatives with a 71.2% and 67.2% of accuracy respectively. The result supports the use of visual attention measurements as an implicit tool to analyze decision-making and preferences in children. Secondly, eye movement and the choice of liking/disliking choice are influenced by stimuli design dimensions. The icon observation results revealed how gender samples have different fixation and different visit times which depend on stimuli design dimension. The toy observations results revealed how the materials determinate the largest amount fixations, also, the visit times were differentiated by gender. This research presents a relevant empirical data to understand the decision-making phenomenon by analyzing eye movement behavior. The presented method can be applied to recognize the choice likelihood between several alternatives. Finally, children's opinions represent an extra difficulty judgment to be determined, and the eye-tracking technique seen as an implicit measure to tackle it. (shrink)

The issues the commentators have raised and which we address, include: the debate over how attention is allocated during reading; our distinction between early and late stages of lexical processing; our assumptions about saccadic programming; the determinants of skipping and refixations; and the role that higher-level linguistic processing may play in influencing eye movements during reading. In addition, we provide a discussion of model development and principles for evaluating and comparing models. Although we acknowledge that E-Z Reader is incomplete, (...) we maintain that it provides a good framework for systematically trying to understand how the cognitive, perceptual, and motor systems influence the eyes during reading. (shrink)

Eye-tracking technology has become a powerful tool for biomedical-related applications due to its simplicity of operation and low requirements on patient language skills. This study aims to use the machine-learning models and deep-learning networks to identify key features of eye movements in Alzheimer's Disease (AD) under specific visual tasks, thereby facilitating computer-aided diagnosis of AD. Firstly, a three-dimensional (3D) visuospatial memory task is designed to provide participants with visual stimuli while their eye-movement data are recorded and used to build (...) an eye-tracking dataset. Then, we propose a novel deep-learning-based model for identifying patients with Alzheimer's Disease (PwAD) and healthy controls (HCs) based on the collected eye-movement data. The proposed model utilizes a nested autoencoder network to extract the eye-movement features from the generated fixation heatmaps and a weight adaptive network layer for the feature fusion, which can preserve as much useful information as possible for the final binary classification. To fully verify the performance of the proposed model, we also design two types of models based on traditional machine-learning and typical deep-learning for comparison. Furthermore, we have also done ablation experiments to verify the effectiveness of each module of the proposed network. Finally, these models are evaluated by four-fold cross-validation on the built eye-tracking dataset. The proposed model shows 85% average accuracy in AD recognition, outperforming machine-learning methods and other typical deep-learning networks. (shrink)

E-Z Reader fits key parameters from one corpus of eye movement data, but has not really been tested with new data sets. More critically, it is argued that the key mechanism driving eye movements – a serial process involving a proportion of word recognition time – is implausible on the basis of a broad range of experimental findings.

From the 1910s through the 1930s, the American naturalist and photographer Arthur C. Pillsbury made time-lapse and microscopic films documenting what he, in common parlance, called the “miracles of plant life”. While these films are now mostly lost, they were part of Pillsbury’s prolific work as a conservationist and traveling film lecturer who used his cameras everywhere from Yosemite National Park to Samoa to promote both public understanding of plants and a desire to protect the natural world. Guiding this work (...) was Pillsbury’s belief that the nonhuman optics of the film camera, which revealed the animacy of plants, could also incite viewers to sympathize with them. In the context of the early American conservation movement, that sympathy stemmed in complicated ways from longstanding transcendental and pastoral ideas of nature that were entangled with imperialist visions of controlling nature. With an eye to that context, I show that Pillsbury’s filmmaking was not simply about using motion picture technologies to shape attitudes toward plants and nature more broadly; it was also about using nature to think through the techno-scientific possibilities of the cinema in the early part of the twentieth century. (shrink)