Using cinema to explore the visual aspects of alterity, Randall Halle analyzes how we become cognizant of each other and how we perceive and judge another person in a visual field. Halle draws on insights from philosophy and recent developments in cognitive and neuroscience to argue that there is no pure "natural" sight. We always see in a particular way, from a particular vantage point, and through a specific apparatus, and Halle shows how human beings have used cinema (...) to experiment with the apparatus of seeing for over a century. Visual alterity goes beyond seeing difference to being conscious of how one sees difference. Investigating the process allows us to move from mere perception to apperception, or conscious perception. Innovative and insightful, Visual Alterity merges film theory with philosophy and cutting-edge science to propose new ways of perceiving and knowing. (shrink)

This paper focuses on whether static images can depict motion. It is natural to say that pictures depicting objects caught in the middle of a dynamic action—such as Henri Cartier-Bresson’s (1932) Behind the Gare St. Lazare—are pictures of movement, but, given that pictures themselves do not move, can we make sense of such an idea? Drawing on results from experimental psychology and cognitive sciences, I show that we can. Psychological studies on implicit motion and representational (...) momentum indicate that motion is really perceived in some static images: our visual system is built in order to detect motion, even where it is only implied, and to anticipate the probable outcomes of others’ actions—even when the ‘others’ are only the subject matters of pictures’. I argue that, consequently, a range of popular depiction theories—perceptualist theories of depiction—can accommodate depicted motion. (shrink)

Can static pictures depict motion and temporal properties? This is an open question that is becoming increasingly discussed in both aesthetics and the philosophy of mind. Theorists working on this issue have mainly focused on static pictures of dynamic scenes and streaky images – such as futurists’ paintings or long-exposure photographs. And yet, we could ask: if there is some success in creating an illusory impression of movement in a static image - as is the case in (...) optical illusions of movement, such as Bridget Riley’s Fall (1963: Tate, London), or Kitaoka’s Rotating Snakes Illusion - is this to say that such static images depict movement? As far as I know, no one working on the depiction of motion has specifically and systematically tackled motion-based illusions nor tried to answer this question. This paper considers two cases of optical illusions of movement and concludes that one of them is involved in the depiction of movement. While the declared goal of my analysis is to answer a quite circumscribed question, it is also the occasion to tackle motion-based illusions tout court - to account for the complex visual experiences they elicit and related phenomenology. Moreover, this account has interesting consequences for theorizing depiction and pictorial experience in general. In particular, it constitutes a counterexample to resemblance theories of depiction. (shrink)

Research over the past half century has produced extensive evidence that observers cannot report or retain all of the details of their visual world from one moment to the next. During the past decade, a new set of studies has illustrated just how pervasive these limits are. For example, early evidence for the failure to detect changes to simple dot patterns (Phillips, 1974) and arrays of letters (Pashler, 1988) generalizes to more naturalistic displays such as photographs and motion (...) pictures (e.g., Levin & Simons, 1997; Rensink, O’Regan, & Clark, 1997; see Rensink, 2002 for a recent review). This failure to report changes (change blindness) can be induced in both simple and naturalistic displays, whenever the change co-occurs with a visual disruption such as an eye movement (Currie, McConkie, Carlson-Radvansky, & Irwin, 1995; Hollingworth, Schrock, & Henderson, 2001), image shift (Blackmore, Brelstaff, Nelson, & Troscianko, 1995), flashed blank screen (Rensink et al., 1997), blink (O’Regan, Deubel, Clark, & Rensink, 2000), transient (O’Regan, Rensink, & Clark, 1999; Rensink, O’Regan, & Clark, 2000), movie cut or pan (Levin & Simons, 1997; Simons, 1996), or an occlusion event (Levin, Simons, Angelone, & Chabris, 2002; Simons & Levin, 1998). Change blindness can also occur in the absence of a disruption, provided the change occurs gradually enough that it does not attract attention (Simons, Franconeri, & Reimer, 2000). -/- Failures of visual awareness have been induced in a number of ways. For example, observers often fail to report a visible but unexpected stimulus when attention is focused on some other object or event in the display (inattentional blindness). As for change blindness, inattentional blindness occurs for both simple (Mack & Rock, 1998; Most et al., 2001) and naturalistic stimuli (Simons & Chabris, 1999). Similarly, repeated instances of an item often go undetected when embedded in a rapid sequence (repetition blindness), a phenomenon that occurs for both words and pictures (Kanwisher, 1987; Kanwisher & Potter, 1990). Observers can also fail to detect a stimulus in a rapid stream of stimuli provided they had to perform an attention-demanding task shortly before the stimulus appeared (Shapiro, Arnell, & Raymond, 1997). The surprisingly large variety of conditions that induce failures of conscious perception reinforces the broad conclusion that we are often unaware of what would otherwise be fully-visible stimuli. -/- Along with an increased appreciation of the limitations of visual awareness has come a renewed interest in using these limitations to explore the nature of the representations and processes underlying our visual experience. Are these limitations due to failures of perception? Of attention? Of memory? What is preserved with and without awareness? -/- The papers in this special issue of the Journal of Vision provide examples of exciting new work on induced failures of visual awareness and the mechanisms that underlie them. For example, several papers examine whether observers are drawn to parts of a display by the stimulus features or whether top-down control or semantic comprehension influence search through a display. Others investigate the nature of and limits on the information that is preserved from one view to the next and how much information needs to be retained for effective perception and action. As guest editors, we hope that this special issue will illustrate how studying the relationship between visual awareness and visual representations can lead to important new insights into the nature of seeing. (shrink)

According to the received view in the philosophical literature on pictorial perception, when perceiving an object in a picture, we perceive both the picture’s surface and the depicted object, but the surface is only unconsciously represented. Furthermore, it is suggested, such unconscious representation does not need attention. This poses a crucial problem, as empirical research on visual attention shows that there can hardly be any visual representation, conscious or unconscious, without attention. Secondly, according to such a received (...) view, when looking at a picture aesthetically, one both consciously represents and visually attends to both the depicted object and the picture’s surface simultaneously. Thus, contra the empirical research on attention, only conscious visual representations are coupled, by such current view, with attention. And this clearly poses a second problem, as this philosophical account is not in tune with what vision science tells us about the functioning of our visual system. Furthermore, this raises another crucial problem, namely, that of explaining why aesthetic experience of pictures does not feel odd or conflicting, since, as previously noted in the philosophical literature, and contra the received view, if we are simultaneously consciously perceiving both the picture’s surface and the depicted object, there seems to be two things, at the same time, in the foreground of one’s visual consciousness. But, if so, as suggested, this would lead to a conflicting spatial visual experience. This paper offers a new description of the role of visual attention in picture perception, which explains the difference between the usual and the aesthetic way of perceiving a depicted object, without facing the problems reported above. A crucial role in our new account is played by the notion of unconscious attention, the distinction between focal and distributed, as well as top-down and bottom-up visual attention and the relationship between visual attention and visual consciousness. The paper, thus, offers the first theory concerning the exercise of visual attention in pictorial perception that is both philosophically rigorous and empirically reliable. (shrink)

This book explores Gilles Deleuze's contribution to film theory. According to Deleuze, we have come to live in a universe that could be described as metacinematic. His conception of images implies a new kind of camera consciousness, one that determines our perceptions and sense of selves: aspects of our subjectivities are formed in, for instance, action-images, affection-images and time-images. We live in a matrix of visual culture that is always moving and changing. Each image is always connected to an (...) assemblage of affects and forces. This book presents a model, as well as many concrete examples, of how to work with Deleuze in film theory. It asks questions about the universe as metacinema, subjectivity, violence, feminism, monstrosity, and music. Among the contemporary films it discusses within a Deleuzian framework are Strange Days, Fight Club, and Dancer in the Dark. (shrink)

This comprehensively updated and expanded revision of the successful second edition continues to provide detailed coverage of the ever-growing range of research topics in vision. In Part I, the treatment of visual physiology has been extensively revised with an updated account of retinal processing, a new section explaining the principles of spatial and temporal filtering which underlie discussions in later chapters, and an up-to-date account of the primate visual pathway. Part II contains four largely new chapters which cover (...) recent psychophysical evidence and computational model of early vision: edge detection, perceptual grouping, depth perception, and motion perception. The models discussed are extensively integrated with physiological evidence. All other chapters in Parts II, III, and IV have also been thoroughly updated. (shrink)

Action is a means of acquiring perceptual information about the environment. Turning around, for example, alters your spatial relations to surrounding objects and, hence, which of their properties you visually perceive. Moving your hand over an object’s surface enables you to feel its shape, temperature, and texture. Sniffing and walking around a room enables you to track down the source of an unpleasant smell. Active or passive movements of the body can also generate useful sources of perceptual information (Gibson 1966, (...) 1979). The pattern of optic flow in the retinal image produced by forward locomotion, for example, contains information about the direction in which you are heading, while motion parallax is a “cue” used by the visual system to estimate the relative distances of objects in your field of view. In these uncontroversial ways and others, perception is instrumentally dependent on action. According to an explanatory framework that Susan Hurley (1998) dubs the “Input-Output Picture”, the dependence of perception on action is purely instrumental: "Movement can alter sensory inputs and so result in different perceptions… changes in output are merely a means to changes in input, on which perception depends directly" (1998: 342). -/- The action-based theories of perception, reviewed in this entry, challenge the Input-Output Picture. They maintain that perception can also depend in a noninstrumental or constitutive way on action (or, more generally, on capacities for object-directed motor control). This position has taken many different forms in the history of philosophy and psychology. Most action-based theories of perception in the last 300 years, however, have looked to action in order to explain how vision, in particular, acquires either all or some of its spatial representational content. Accordingly, these are the theories on which we shall focus here. -/- We begin in Section 1 by discussing George Berkeley’s Towards a New Theory of Vision (1709), the historical locus classicus of action-based theories of perception, and one of the most influential texts on vision ever written. Berkeley argues that the basic or “proper” deliverance of vision is not an arrangement of voluminous objects in three-dimensional space, but rather a two-dimensional manifold of light and color. We then turn to a discussion of Lotze, Helmholtz, and the local sign doctrine. The “local signs” were felt cues for the mind to know what sort of spatial content to imbue visual experience with. For Lotze, these cues were “inflowing” kinaesthetic feelings that result from actually moving the eyes, while, for Helmholtz, they were “outflowing” motor commands sent to move the eyes. -/- In Section 2, we discuss sensorimotor contingency theories, which became prominent in the 20thcentury. These views maintain that an ability to predict the sensory consequences of self-initiated actions is necessary for perception. Among the motivations for this family of theories is the problem of visual direction constancy—why do objects appear to be stationary even though the locations on the retina to which they reflect light change with every eye movement?—as well as experiments on adaptation to optical rearrangement devices (ORDs) and sensory substitution. -/- Section 3 examines two other important 20th century theories. According to what we shall call the motor component theory, efference copies generated in the oculomotor system and/or proprioceptive feedback from eye-movements are used together with incoming sensory inputs to determine the spatial attributes of perceived objects. Efferent readiness theories, by contrast, look to the particular ways in which perceptual states prepare the observer to move and act in relation to the environment. The modest readiness theory, as we shall call it, claims that the way an object’s spatial attributes are represented in visual experience can be modulated by one or another form of covert action planning. The bold readiness theory argues for the stronger claim that perception just is covert readiness for action. -/- In Section 4, we move to the disposition theory, most influentially articulated by Gareth Evans (1982, 1985), but more recently defended by Rick Grush (2000, 2007). Evans’ theory is, at its core, very similar to the bold efferent readiness theory. There are some notable differences, though. Evans’ account is more finely articulated in some philosophical respects. It also does not posit a reduction of perception to behavioral dispositions, but rather posits that certain complicated relations between perceptual input and behavioral provide spatial content. Grush proposes a very specific theory that is like Evans’ in that it does not posit a reduction, but unlike Evans’ view, does not put behavioral dispositions and sensory input on an undifferentiated footing. (shrink)

Maria Goltsman. On some graphic regularities of perception in painting and dance: Mnemonic form of dance. The present article handles some problems of the mechanisms of visual perception in painting and classical ballet. It proceeds from the assumption that the interaction between those arts is based on the similarity of their formal languages. The main attention focuses on the questions of how and why does the classical ballet use the code of painting? The interaction between pictorial art (...) and ballet occurs through the theatre, which is considered to be a picture coming alive in European tradition. This principle is taken here as a main method of analysis of ballet art and it is used in two ways. The first handles a problem of composition of a ballet as a theatrical performance. The second analyses the movement itself — the language of the choreography as such. The last part of the article contains the answer to the question — why does the ballet need such aspects of pictorial code as frontal composition of a picture coming alive, memory photo, multiplication of the similar images and repeating movements. Dance is dynamic, picture is stable. To represent a movement, the painting uses the rhythm and visual repeating of lines and contours. It helps to construct an illusion of motion and brings the temporal aspect into a static piece of art. Whereas different stops, poses and fixations in ballet help it to visualize the movement, to capture the space. This is one of the ways for ballet to leave its trace in space as much as in the memory of the spectators, to become fixed in space, to prevent the dispersion of dance in the thin air and to surmount in such a way the ephemera characteristic of it. (shrink)

Interactive Cinema explores cinematic practices that work to transform what is often seen as a receptive activity into a participatory, multimedia experience. Combining cutting-edge theory with updated conventional film studies methodologies, Marina Hassapopoulou presses at the conceptual limits of cinema and offers an essential road map to the rapidly evolving landscape of contemporary media.

This paper addresses the visual culture of late-19th-century experimental physiology. Taking the case of Johann Nepomuk Czermak as a key example, it argues that images played a crucial role in acquiring experimental physiological skills. Czermak, Emil Du Bois-Reymond and other late-19th-century physiologists sought to present the achievements and perspective of their discipline by way of "immediate visual perception." However, the images they produced and presented for this purpose were strongly mediated. By means of specifically designed instruments, such (...) as the "cardioscope," the "contraction telegraph," and the "frog pistol," and of specifically constructed rooms, so-called "spectatoriums," physiologists trained and controlled the perception of their students before allowing them to conduct experiments on their own. Studying the material culture of physiological image production reveals that technological resources such as telegraphy, photography, and even railways contributed to making physiological facts anschaulich. At the same time, it shows that the more traditional image techniques of anatomy played an important role in physiological lecture halls, especially when it came to displaying the details of vivisection experiments to the public. Thus, the images of late 19th century physiology stood half-way between machines and organisms, between books and instruments. (shrink)

Motion pictures, from their emergence in the late nineteenth century, have been used in ways that have held in tension a number of competing or seemingly contradictory impulses. Movies can document and reveal physical and social realities, extend perception through time and space, and create audio-visual approximations of subjective perspective and mental states; they can mimic or transform reality, or create new verisimilar or fantastical screen worlds that, in part, resemble, or abstract our own. Over the (...) past 120 years, many thinkers have attempted to define the aesthetic nature of the medium in, at times, prescriptive or overly conditional ways that centre on some technologies (notably the camera), techniques, or types of motion picture making while excluding others (notably animation), and that bracket or narrowly circumscribe the question of viewer experience. However, in the past thirty years or so, we have seen an expanded interest in forms previously more marginalized in film studies, such as documentary, docudrama, and animation. This is due in part to the digital turn in both screen media production and distribution, which has led to the proliferation and pervasiveness of both. We have also seen much deeper consideration of how viewers understand, experience, and think with screen media with the rise of phenomenological and cognitive approaches to the screen-viewer relationship. Carl Plantinga has become a key and productive figure during these years, generating persuasive understandings of the emotional, schematic, and moral dimensions of our experience of screen media, and the ways in which films and TV are designed for such purposes. A cognitivist, he is interested in the possibilities of the screen to allow us to better imagine and empathize with the experiences of others, to persuade us of a state of affairs, and to provoke our capacity for moral reasoning. (shrink)

Self-motion through space generates a visual pattern called optic flow. It can be used to determine one’s direction of self-motion (heading). Previous studies have already shown thatthis perceptual ability, which is of critical importance during everyday life, changes with age. In most of these studies subjects were asked to judge whether they appeared to be heading to the left or right of a target. Thresholds were found to increase continuously with age. In our current study, we were (...) interested in absolute rather than relative heading judgements and in the question about a potential neural correlate of an age-related deterioration of heading perception. Two groups, older test subjects and younger controls, were shown optic flow stimuli in a virtual-reality setup. Visual stimuli simulated self-motion through a 3-D cloud of dots and subjects had to indicate their perceived heading direction after each trial. In different subsets of experiments we varied individuallyrelevant stimulus parameters: presentation time, number of dots in the display, stereoscopic vs. non-stereoscopic stimulation, and motion coherence. We found decrements in heading performance with agefor each stimulus parameter. In a final step we aimed to determine a putative neural basis of this behavioural decline. To this end we modified a neural network model which previously has proven to be capable of reproduce and predict certain aspects of heading perception. We show that the observed data can be modeled by implementing an age related neuronal cell loss in this neural network. We conclude that a continuous decline of certain aspects of motion perception, among them heading, might directly be based on anage-related progressive loss of groups of neurons being activated by visual motion. (shrink)

The relationship between brain activity and conscious visual experience is central to our understanding of the neural mechanisms underlying perception. Binocular rivalry, where monocular stimuli compete for perceptual dominance, has been previously used to dissociate the constant stimulus from the varying percept. We report here fMRI results from humans experiencing binocular rivalry under a dichoptic stimulation paradigm that consisted of two drifting random dot patterns with different motion coherence. Each pattern had also a different color, which both (...) enhanced rivalry and was used for reporting which of the two patterns was visible at each time. As the perception of the subjects alternated between coherent motion and motion noise, we examined the effect that these alternations had on the strength of the MR signal throughout the brain. Our results demonstrate that motion perception is able to modulate the activity of several of the visual areas which are known to be involved in motion processing. More specifically, in addition to area V5 which showed the strongest modulation, a higher activity during the perception of motion than during the perception of noise was also clearly observed in areas V3A and LOC, and less so in area V3. In previous studies, these areas had been selectively activated by motion stimuli but whether their activity reflects motion perception or not remained unclear; here we show that they are involved in motion perception as well. The present findings therefore suggest a lack of a clear distinction between ?processing? versus ?perceptual? areas in the brain, but rather that the areas involved in the processing of a specific visual attribute are also part of the neuronal network that is collectively responsible for its perceptual representation. (shrink)

In my thesis I develop a theory of our mental, physiological and emotional involvement with motion pictures that accounts for the distinct role of perception in our cinematic experiences. In particular, I present a resemblance view of cinematic perception and depiction that begins with an analysis of motion picture screenings as events in the world to which audience members share perceptual access and to which we can attribute complex visual and auditory properties. By understanding (...) the precise nature of these properties and by understanding the mind's rich and dynamic relationship to visual and auditory stimuli, we can meet the demand of explaining the essential contribution of perception to our cinematic experiences. This positive theory is introduced through a philosophical and empirical critique of the work of several contemporary "cognitivist" film theorists who can been faulted for falling into the traps of traditional illusion accounts, failing to account for the perceptual nature of our film experiences, or incorrectly characterizing the nature of our perceptual relationship to cinematic content. (shrink)

Following lesions to the primary visual cortex, some patients maintain visual capacities within areas of the visual field in which they are defined as clinically blind by static field perimetry. Blindsight describes the ability to discriminate visual stimuli in the absence of awareness of the stimuli in such patients. Some patients exhibit blindsight, but others are aware of the stimuli with which they are presented, a response mode that has been referred to as residual vision. The (...) two response modes are of great interest as they are capable of providing us with information concerning the conscious and unconscious processing of visual signals in humans. However, determining consciousness in these patients is a difficult task and relies on the patient assessing and then reporting on his awareness. In this paper, an experiment is described which is capable of demonstrating conscious visual processing of motion under conditions where the observer is not required to assess his level of awareness. In applying this technique to a human hemianope, GY, it is demonstrated that GY has veridical and conscious perception of visual motion presented to his blind hemifield. Although previously reported, this result can be derived without any reference to GY's commentary on his blind field perception. (shrink)

Human infants begin very early in life to take advantage of multisensory information by extracting the invariant amodal information that is conveyed redundantly by multiple senses. Here we addressed the question as to whether infants can bind multisensory moving stimuli, and whether this occurs even if the motion produced by the stimuli is only illusory. Three- to four-month-old infants were presented with two bimodal pairings: visuo-tactile and audio-visual. Visuo-tactile pairings consisted of apparently vertically moving bars (the Barber Pole (...) illusion) moving in either the same or opposite direction with a concurrent tactile stimulus consisting of strokes given on the infant’s back. Audio-visual pairings consisted of the Barber Pole illusion in its visual and auditory version, the latter giving the impression of a continuous rising or ascending pitch. We found that infants were able to discriminate congruently (same direction) vs. incongruently moving (opposite direction) pairs irrespective of modality (Experiment 1). Importantly, we also found that congruently moving visuo-tactile and audio-visual stimuli were preferred over incongruently moving bimodal stimuli (Experiment 2). Our findings suggest that very young infants are able to extract motion as amodal component and use it to match stimuli that only apparently move in the same direction. (shrink)

Margaret Cavendish’s views about the nature of bodies and perception leave her with a potentially problematic implication: that light has no role in visual perception. For her, perception occurs through the self-motion of animate matter, not through a mechanical system that appeals to local motions and collisions of contiguous bodies. This means that motion is not transferred from external objects with light playing a mediating role; the matter of our eyes simply moves itself to (...) copy the sensible qualities of external bodies. However, Cavendish cannot ignore the simple empirical fact that we appear to have visual perceptions in the presence of light but not in the presence of darkness. Light must play some role. I argue that light for Cavendish plays an intermediary role but does not transfer motions as the mechanical model suggests. Rather, light behaves like our eyes by moving itself to form copies of external objects. Our eyes then see these copies. For Cavendish, we are directly acquainted with a “veil of light” rather than the objects themselves. (shrink)

Neurophysiological studies in humans employing magneto- and electro- encephalography increasingly suggest that oscillatory rhythmic activity of the brain may be a core mechanism for binding sensory information across space, time, and object features to generate a unified perceptual representation. To distinguish whether oscillatory activity is causally related to binding processes or whether, on the contrary, it is a mere epiphenomenon, one possibility is to employ neuromodulatory techniques such as transcranial alternating current stimulation. tACS has seen a rising interest due to (...) its ability to modulate brain oscillations in a frequency-dependent manner. In the present review, we critically summarize current tACS evidence for a causal role of oscillatory activity in spatial, temporal, and feature binding in the context of visual perception. For temporal binding, the emerging picture supports a causal link with the power and the frequency of occipital alpha rhythms ; however, there is no consistent evidence on the causal role of the phase of occipital tACS. For feature binding, the only study available showed a modulation by occipital alpha tACS. The majority of studies that successfully modulated oscillatory activity and behavioral performance in spatial binding targeted parietal areas, with the main rhythms causally linked being the theta and beta frequency bands. On the other hand, spatio-temporal binding has been directly modulated by parieto-occipital gamma and alpha tACS, suggesting a potential role of cross-frequency coupling when binding across space and time. Nonetheless, negative or partial results have also been observed, suggesting methodological limitations that should be addressed in future research. Overall, the emerging picture seems to support a causal role of brain oscillations in binding processes and, consequently, a certain degree of plasticity for shaping binding mechanisms in visual perception, which, if proved to have long lasting effects, can find applications in different clinical populations. (shrink)

We examine a number of investigations of perceptual economy or, more specifically, of minimum tendencies and minimum principles in the visual perception of form, depth, and motion. A minimum tendency is a psychophysical finding that perception tends toward simplicity, as measured in accordance with a specified metric. A minimum principle is a theoretical construct imputed to the visual system to explain minimum tendencies. After examining a number of studies of perceptual economy, we embark on a (...) systematic analysis of this notion. We examine the notion that simple perceptual representations must be defined within the "geometric constraints" provided by proximal stimulation. We then take up metrics of simplicity. Any study of perceptual economy must use a metric of simplicity; the choice of metric may be seen as a matter of convention, or it may have deep theoretical and empirical implications. We evaluate several answers to the question of why the visual system might favor economical representations. Finally, we examine several accounts of the process for achieving perceptual economy, concluding that those which favor massively parallel processing are the most plausible. (shrink)

How does a picture teach a viewer to look at it, understand it, and make meaning?. “Cross-mediality and narrative textual form: A semiotic snalysis of the lexical and visual signs and codes of the picture bnook.” Semiotica, 118 : 1–70 and Peter Pericles Trifonas.. “Texts and images.” In International handbook of semiotics, Vols. 1&2, edited by Peter Pericles Trifonas. The Netherlands: Springer. Pp. 1139–1154.) The suggestion for a pictorial grammar has been derived from the fact that pictures have (...) no unique visual metalanguage and therefore require recourse to language as an instrument for pictorial analysis. The lexical-visual relationship in a text is more complex than is suggested in the question. Proponents for the semiotic autonomy of pictures have objected that the commentaries of crossmedial contexts have not asserted the semiotic priority of the lexical over the visual message. ‘Is an autonomous semiotics of visual perception possible, or does the semiotic analysis of pictorial text always require recourse to the model of language?’. (shrink)

Even simple geometric shapes are seen as animate and goal-directed when they move in certain ways. Previous research has revealed a great deal about the cues that elicit such percepts, but much less about the consequences for other aspects of perception and cognition. Here we explored whether simple shapes that are perceived as animate and goal-directed are prioritized in memory. We investigated this by asking whether subjects better remember the locations of displays that are seen as animate vs. inanimate, (...) con- trolling for lower-level factors. We exploited the ‘Wolfpack effect’: moving darts (or discs with ‘eyes’) that stay oriented toward a particular target are seen to be actively pursuing that target, even when they actually move randomly. (In contrast, shapes that stay oriented perpendicular to a target are correctly perceived to be drifting randomly.) Subjects played a ‘matching game’ – clicking on pairs of panels to reveal animations with moving shapes. Across four experiments, the locations of Wolfpack animations (compared to control animations equated on lower-level visual factors) were better remembered, in terms of more efficient matching. Thus perceiving animacy influences subsequent visual memory, perhaps due to the adaptive significance of such stimuli. (shrink)

The success of movies like The Artist and Hugo recreated the wonder and magic of silent film for modern audiences, many of whom might never have experienced a movie without sound. But while the American silent movie was one of the most significant popular art forms of the modern age, it is also one that is largely lost to us, as more than eighty percent of silent films have disappeared, the victims of age, disaster, and neglect. We now know about (...) many of these cinematic masterpieces only from the collections of still portraits and production photographs that were originally created for publicity and reference. Capturing the beauty, horror, and moodiness of silent motion pictures, these images are remarkable pieces of art in their own right. In the first history of still camera work generated by the American silent motion picture industry, David S. Shields chronicles the evolution of silent film aesthetics, glamour, and publicity, and provides unparalleled insight into this influential body of popular imagery. Exploring the work of over sixty camera artists, Still recovers the stories of the photographers who descended on early Hollywood and the stars and starlets who sat for them between 1908 and 1928. Focusing on the most culturally influential types of photographs—the performer portrait and the scene still—Shields follows photographers such as Albert Witzel and W. F. Seely as they devised the poses that newspapers and magazines would bring to Americans, who mimicked the sultry stares and dangerous glances of silent stars. He uncovers scene shots of unprecedented splendor—visions that would ignite the popular imagination. And he details how still photographs changed the film industry, whose growing preoccupation with artistry in imagery caused directors and stars to hire celebrated stage photographers and transformed cameramen into bankable names. Reproducing over one hundred and fifty of these gorgeous black-and-white photographs, Still brings to life an entire long-lost visual culture that a century later still has the power to enchant. (shrink)

There is mounting evidence that language comprehension involves the activation of mental imagery of the content of utterances (; ; ; ; ; ; ). This imagery can have motor or perceptual content. Three main questions about the process remain under‐explored, however. First, are lexical associations with perception or motion sufficient to yield mental simulation, or is the integration of lexical semantics into larger structures, like sentences, necessary? Second, what linguistic elements (e.g., verbs, nouns, etc.) trigger mental simulations? (...) Third, how detailed are the visual simulations that are performed? A series of behavioral experiments address these questions, using a visual object categorization task to investigate whether up‐ or down‐related language selectively interferes with visual processing in the same part of the visual field (following ). The results demonstrate that either subject nouns or main verbs can trigger visual imagery, but only when used in literal sentences about real space—metaphorical language does not yield significant effects—which implies that it is the comprehension of the sentence as a whole and not simply lexical associations that yields imagery effects. These studies also show that the evoked imagery contains detail as to the part of the visual field where the described scene would take place. (shrink)

I aim to give a new account of picture perception: of the way our visual system functions when we see something in a picture. My argument relies on the functional distinction between the ventral and dorsal visual subsystems. I propose that it is constitutive of picture perception that our ventral subsystem attributes properties to the scene, whereas our dorsal subsystem attributes properties to the surface. Keywords: picture perception; dorsal subsystem;.

Measures of visual cortical development in children demonstrate high variability and inconsistency throughout the literature. This is partly due to the specificity of the visual system in processing certain features. It may then be advantageous to activate multiple cortical pathways in order to observe maturation of coinciding networks. Visual stimuli eliciting the percept of apparent motion and shape change is designed to simultaneously activate both dorsal and ventral visual streams. However, research has shown that such (...) stimuli also elicit variable visual evoked potential (VEP) morphology in children. The aim of this study was to describe developmental changes in VEPs, including morphological patterns, and underlying visual cortical generators, elicited by apparent motion and shape change in school-aged children. Forty-one typically developing children underwent high-density EEG recordings in response to a continuously morphing, radially modulated, circle-star grating. VEPs were then compared across the age groups of 5-7, 8-10, and 11-15 years according to latency and amplitude. Current density reconstructions were performed on VEP data in order to observe activated cortical regions. It was found that two distinct VEP morphological patterns occurred in each age group. However, there were no major developmental differences between the age groups according to each pattern. Current density reconstructions further demonstrated consistent visual generators across age and pattern. These results describe two novel VEP morphological patterns in typically developing children, but with similar underlying cortical sources. The importance of these morphological patterns is discussed in terms of future studies and the investigation of a relationship to visual cognitive performance. (shrink)

One of the more compelling beliefs about vision is that it is based on representations that are coherent and complete, with everything in the visual field described in great detail. However, changes made during a visual disturbance are found to be difficult to see, arguing against the idea that our brains contain a detailed, picture-like representation of the scene. Instead, it is argued here that a more dynamic, "just-in-time" representation is involved, one with deep similarities to the way (...) that users interact with external displays. It is further argued that these similarities can provide a basis for the design of intelligent display systems that can interact with humans in highly effective and novel ways. (shrink)

Recent developments in vision science have resulted in several major changes in our understanding of human visual perception. For example, attention no longer appears necessary for "visual intelligence"--a large amount of sophisticated processing can be done without it. Scene perception no longer appears to involve static, general-purpose descriptions, but instead may involve dynamic representations whose content depends on the individual and the task. And vision itself no longer appears to be limited to the production of a (...) conscious "picture"--it may also guide processes outside the conscious awareness of the observer. (shrink)

Previous reports have demonstrated that the comprehension of sentences describing motion in a particular direction (toward, away, up, or down) is affected by concurrently viewing a stimulus that depicts motion in the same or opposite direction. We report 3 experiments that extend our understanding of the relation between perception and language processing in 2 ways. First, whereas most previous studies of the relation between perception and language processing have focused on visual perception, our data (...) show that sentence processing can be affected by the concurrent processing of auditory stimuli. Second, it is shown that the relation between the processing of auditory stimuli and the processing of sentences depends on whether the sentences are presented in the auditory or visual modality. (shrink)

Photography has always been associated with the physical activity of the human body: capturing, editing and viewing photos are all activities that involve the user’s spatial interaction with the technology used. With conventional photography, one aspect of spatial relation with technology is the viewer’s ability to recognize the camera’s location in the photographic scene through visual indications, such as the relative location of objects in the frame to the camera’s point of view, combined with a basic familiarity with the (...) functionality of conventional cameras, relating to the notions of ‘in-front’ and ‘behind’ the camera. Some instances of interactive photography, such as 360-degree imagery and three-dimensional photogrammetry, challenge the spatial connection between the photographer (represented by the camera location) and the viewer due to unique usability and innovative interactions, such as the viewer’s ability to ‘move’ freely in all directions of the three-dimensional, photographic space. The technological affordances of interactive photography create a distinct corporeal experience that challenges the traditional associations between the photographer, the viewer and the photographic imagery, evoking with the viewers the notion of technological uncanniness and, consequently, questioning some of the traditional preconceptions regarding the prime characteristics of the photographic medium. (shrink)

Hunter Vaughan interweaves phenomenology and semiotics to analyze cinema's ability to challenge conventional modes of thought. Merging Maurice Merleau-Ponty's phenomenology of perception with Gilles Deleuze's image-philosophy, Vaughan applies a rich theoretical framework to a comparative analysis of Jean-Luc Godard's films, which critique the audio-visual illusion of empirical observation (objectivity), and the cinema of Alain Resnais, in which the sound-image generates innovative portrayals of individual experience (subjectivity). Both filmmakers radically upend conventional film practices and challenge philosophical traditions to alter (...) our understanding of the self, the world, and the relationship between the two. Films discussed in detail include Godard's _Vivre sa vie_ (1962), _Contempt_ (1963), and _2 or 3 Things I Know About Her_ (1967); and Resnais's _Hiroshima, mon amour_ (1959), _Last Year at Marienbad_ (1961), and _The War Is Over_ (1966). Situating the formative works of these filmmakers within a broader philosophical context, Vaughan pioneers a phenomenological film semiotics linking two disparate methodologies to the mirrored achievements of two seemingly irreconcilable artists. (shrink)

ABSTRACT:Are face-to-face perception and picture perception different perceptual phenomena? The question is controversial. On the one hand, philosophers have offered several solid arguments showing that, despite some resemblances, they are quite different perceptual phenomena and that pictures are special objects of perception. On the other hand, neuroscientists routinely use pictures in experimental settings as substitutes for normal objects, and this practice is successful in explaining how the human visual system works. But this seems to (...) imply that face-to-face perception and picture perception are very similar, if not actually the same. How can we decide between these two opposite intuitions? Here I offer a regimentation of the notion of picture perception that can reconcile these two apparently conflicting ideas about pictures. It follows that philosophers and neuroscientists can maintain their respective stances without any theoretical conflict. (shrink)

This work tells the story of the rise of the modern German environmental imagination, with particular emphasis on its narrative and visual components.

The Emergic Cognitive Model (ECM) is a unified computational model of visual filling-in based on the Emergic Network architecture. The Emergic Network was designed to help realize systems undergoing continuous change. In this thesis, eight different filling-in phenomena are demonstrated under a regime of continuous eye movement (and under static eye conditions as well). -/- ECM indirectly demonstrates the power of unification inherent with Emergic Networks when cognition is decomposed according to finer-grained functions supporting change. These can interact to (...) raise additional emergent behaviours via cognitive re-use, hence the Emergic prefix throughout. Nevertheless, the model is robust and parameter free. Differential re-use occurs in the nature of model interaction with a particular testing paradigm. -/- ECM has a novel decomposition due to the requirements of handling motion and of supporting unified modelling via finer functional grains. The breadth of phenomenal behaviour covered is largely to lend credence to our novel decomposition. -/- The Emergic Network architecture is a hybrid between classical connectionism and classical computationalism that facilitates the construction of unified cognitive models. It helps cutting up of functionalism into finer-grains distributed over space (by harnessing massive recurrence) and over time (by harnessing continuous change), yet simplifies by using standard computer code to focus on the interaction of information flows. Thus while the structure of the network looks neurocentric, the dynamics are best understood in flowcentric terms. Surprisingly, dynamic system analysis (as usually understood) is not involved. An Emergic Network is engineered much like straightforward software or hardware systems that deal with continuously varying inputs. Ultimately, this thesis addresses the problem of reduction and induction over complex systems, and the Emergic Network architecture is merely a tool to assist in this epistemic endeavour. -/- ECM is strictly a sensory model and apart from perception, yet it is informed by phenomenology. It addresses the attribution problem of how much of a phenomenon is best explained at a sensory level of analysis, rather than at a perceptual one. As the causal information flows are stable under eye movement, we hypothesize that they are the locus of consciousness, howsoever it is ultimately realized. (shrink)

Determining the compositional properties of surfaces in the environment is an important visual capacity. One such property is specular reflectance, which encompasses the range from matte to shiny surfaces. Visual estimation of specular reflectance can be informed by characteristic motion profiles; a surface with a specular reflectance that is difficult to determine while static can be confidently disambiguated when set in motion. Here, we used fMRI to trace the sensitivity of human visual cortex to such (...) motion cues, both with and without photometric cues to specular reflectance. Participants viewed rotating blob-like objects that were rendered as images (photometric) or dots (kinematic) with either matte-consistent or shiny-consistent specular reflectance profiles. We were unable to identify any areas in low and mid-level human visual cortex that responded preferentially to surface specular reflectance from motion. However, univariate and multivariate analyses identified several visual areas; V1, V2, V3, V3A/B, and hMT+, capable of differentiating shiny from matte surface flows. These results indicate that the machinery for extracting kinematic cues is present in human visual cortex, but the areas involved in integrating such information with the photometric cues necessary for surface specular reflectance remain unclear. (shrink)

Time Tells is a grand study of time, technology, performance, the attention economy, and comedy. Using the cinematic time-jump, "a numerical shorthand for a fated intermission," to weave a narrative of chronopolitics, memoir, and cultural study, Masha Tupitsyn constructs a unique literary and visual phenomenology on the loss of time, presence, and attention in the digital age. Structured into two interlocked inquiries--Time and Acting--Time Tells focuses on the internet to talk about the ethics of presence and attention, comedy to (...) talk about timing and the language of critique, and lying masculinity, the double, and acting to talk about performance and the reign of falsehood. Both volumes intersect to examine our inability to experience coherence and integration in the post-truth era. In the first volume, Time, Tupitsyn covers wide-ranging cultural touchstones such as the '90s TV show Felicity, Hitchcock's Vertigo, Luca Guadagnino's Call Me by Your Name, Joan Didion's The Year of Magical Thinking, Pretty Woman, Wong Kar-wai's 2046, David Fincher's Zodiac, Jean-Luc Godard, the Beastie Boys, Wim Wenders, the art of style, memory and music in the post-internet age, and the lost ontology of cinema. Using what Tupitsyn terms "screen-shot criticism," Time Tells makes innovative critical thinking accessible to anyone interested in American culture today. (shrink)

The question of whether cognition can influence perception has a long history in neuroscience and philosophy. Here, we outline a novel approach to this issue, arguing that it should be viewed within the framework of top-down information-processing. This approach leads to a reversal of the standard explanatory order of the cognitive penetration debate: we suggest studying top-down processing at various levels without preconceptions of perception or cognition. Once a clear picture has emerged about which processes have influences on (...) those at lower levels, we can re-address the extent to which they should be considered perceptual or cognitive. Using top-down processing within the visual system as a model for higher-level influences, we argue that the current evidence indicates clear constraints on top-down influences at all stages of information processing; it does, however, not support the notion of a boundary between specific types of information-processing as proposed by the cognitive impenetrability hypothesis. (shrink)

We addressed the questions whether stimuli presented below the threshold of verbal awareness are nevertheless perceived and whether there are perceptual differences between the two cerebral hemispheres. Pictures of line drawn objects and animals were subliminally presented to each visual half-field for subsequent identification in a form as fragmented as possible. The performance of 40 healthy subjects was compared to that of 63 controls. Whereas identification performance after blank presentation in the experimental group did not differ from that (...) of controls, identification in a significantly more fragmented form was achieved after the presentation of the complete picture. This effect, however, occurred only after subliminal stimulation in the left visual field, i.e., of the right hemisphere. Our results show that pictures presented below the threshold of verbal awareness can be perceived, and that only the right hemisphere can perceive them and make use of the perception. It remains an open question whether this kind of hemispheric specialization represents a right hemisphere dominance for subliminal perception or reflects an inability of the left hemisphere to access and behaviorally use unaware percepts via fragmented picture identification, for which a right hemisphere advantage is known. (shrink)