In his paper, “The Dorsal Stream and the Visual Horizon,” Michael Madary argues that “dorsal stream processing plays a main role in the spatiotemporal limits of visual perception, in what Husserl identified as the visual horizon” (Madary 2011, p. 424). Madary regards himself as thereby providing a theoretical framework “sensitive to basic Husserlian phenomenology” (Madary 2011). In particular, Madary draws connections between perceptual anticipations and the experience of the indeterminate spatial margins, on the one hand, and (...) the Husserlian spatiotemporal visual horizons, on the other. I argue that Madary’s arguments, for a Husserlian view of the two visual systems, are not convincing. When the notion of visual horizon is adequately understood as a constitutive notion, there will be reason to regard the connections between dorsal processing and the Husserlian spatiotemporal horizons as tenuous at best. (shrink)

Today many philosophers of mind accept that the two cortical streams of visual processing in humans can be distinguished in terms of conscious experience. The ventral stream is thought to produce representations that may become conscious, and the dorsal stream is thought to handle unconscious vision for action. Despite a vast literature on the topic of the two streams, there is currently no account of the way in which the relevant empirical evidence could fit with basic Husserlian (...) phenomenology of vision. Here I offer such an account. In this article, I show how the empirical evidence ought to be understood in a way that is informed by phenomenology. The differences in the two streams are better described as differences in spatial and temporal processing. Rather than simply “unconscious,” the dorsal stream can be better described as making a special contribution to what Husserl identified as the visual horizon. (shrink)

AimVisual functions of the dorsal stream are considered vulnerable in children with early brain damage. Considering the recognition of objects in suboptimal representations a dorsal stream dysfunction, we examined whether children with early brain damage and impaired object recognition had either general or selective dorsal stream dysfunctions.MethodIn a group of children with early brain damage we evaluated the dorsal stream functioning. To determine whether these patients had an increased risk of a (...) class='Hi'>dorsal stream dysfunction we compared the percentage of patients with impaired object recognition, assessed with the L94, with the estimated base rate. Then we evaluated the performance levels on motion perception, visual attention and visuomotor tasks in patients with and without object recognition abnormalities. A general dorsal stream dysfunction was considered present if a patient showed at least one abnormally low score in two out of three additional dorsal stream functions.ResultsSix of the eighteen patients with object recognition problems scored abnormally low on at least two additional dorsal stream functions. This was significantly higher than the base rate. The difference of 24.1% between the patients with and without object recognition problems was not significant. Of the patients with object recognition problems 72.2% had at least 1 dorsal weakness, whereas this was only the case in 27.3% of patients without object recognition problems. Compared to patients with normal object recognition, patients with object recognition problems scored significantly more abnormally low on motion perception and visual attention but did not differ on visuomotor skills.ConclusionChildren with object recognition problems seem at risk for other dorsal stream dysfunctions, but dysfunctions might be rather specific than general. Multiple functions/aspects should be evaluated in neuropsychological assessment of children at risk. (shrink)

Our commentary focuses on the functional link between the ventral and dorsal systems implied by Norman, as they relate to overt movement. While issues relating to space perception and size constancy are the primary justification for this dual-process theory, the philosophical extensions of this approach are less consistent with examination of motor control and, in particular, motor learning.

Some data concerning visual illusions are hardly compatible with the perception–action model, assuming that only the perception system is influenced by visual context. The planning–control dichotomy offers an alternative that better accounts for some controversy in experimental data. We tested the two models by submitting the patient I. G. to the induced Roelofs effect. The similitude of the results of I. G. and control subjects favoured Glover's model, which, however, presents a paradox that needs to be clarified.

Opposed to Norman's proposal, processing of affordance is likely to occur not solely in the dorsal stream but also in the ventral stream. Moreover, the dorsal stream might do more than just serve an important role in motor actions. It supports egocentric location coding as well. As such, it would possess a form of representational memory, contrary to Norman's proposal.

Patients with apraxia perform poorly when demonstrating how an object is used, particularly when pantomiming the action. However, these patients are able to accurately identify, and to pick up and move objects, demonstrating intact ventral and dorsal stream visuomotor processing. Appropriate object manipulation for skilled use is thought to rely on integration of known and visible object properties associated with ‘ventro-dorsal’ stream neural processes. In apraxia, it has been suggested that stored object knowledge from the ventral (...) stream may be less readily available to incorporate into the action plan, leading to an over-reliance on the objects’ visual affordances in object-directed motor behaviour. The current study examined grasping performance in left hemisphere stroke patients with (N = 3) and without (N = 9) apraxia, and in age-matched healthy control participants (N = 14), where participants repeatedly grasped novel cylindrical objects of varying weight distribution. Across two conditions, object weight distribution was indicated by either a memory-associated cue (object colour) or visual-spatial cue (visible dot over the weighted end). Participants were required to incorporate object-weight associations to effectively grasp and balance each object. Control groups appropriately adjusted their grasp according to each object’s weight distribution across each condition, whereas throughout the task two of the three apraxic patients performed poorly on both the memory-associated and visual-spatial cue conditions. A third apraxic patient seemed to compensate for these difficulties but still performed differently to control groups. Patients with apraxia performed normally on the neutral control condition when grasping the evenly weighted version. The pattern of behaviour in apraxic patients suggests impaired integration of visible and known object properties attributed to the ventro-dorsal stream: in learning to grasp the weighted object accurately, apraxic patients applied neither pure knowledge-based information (the memory-associated condition) nor higher-level information given in the visual-spatial cue condition. Disruption to ventro-dorsal stream predicts that apraxic patients will have difficulty learning to manipulate new objects on the basis of information other than low-level visual cues such as shape and size. (shrink)

Although developmental dyslexia (DD) is frequently associate to a phonological deficit, the underlying neurobiological cause remain undetermined. One prominent hypothesis suggests a specific deficit in magnocellular-dorsal (M-D) pathway. Here we investigated the visual M-D and parvocellular-ventral (P-V) pathway in dyslexic and in chronological age and IQ-matched normally reading children by measuring dynamic (frequency doubling illusion) and static stimuli sensibility, respectively. A specific deficit in M-D task was found. Importantly, the M-D deficit was selectively shown in poor phonological decoders. M-D (...) deficit appears to be frequent because 75% of poor pseudo-word readers were at least 1 SD below the mean of the controls. Finally, a replication study by using a new group of poor phonological decoders and reading level controls suggests a possible role of M-D deficit in DD. These results showed that a M-D deficit might impair the sub-lexical mechanisms that are critical for reading development. The possible link between these findings and the oscillatory “temporal sampling” framework is discussed. (shrink)

Philosophers and neuroscientists often suggest that we perceptually represent objects and their properties. However, they start from very different background assumptions when they use the term “perceptual representation”. On the one hand, sometimes philosophers do not need to properly take into consideration the empirical evidence concerning the neural states subserving the representational perceptual processes they are talking about. On the other hand, neuroscientists do not rely on a meticulous definition of “perceptual representation” when they talk about this empirical evidence that (...) is supposed to show that we perceptually represent such and such properties. It seems that, on both sides, something is missed. My aim is to show that, in the light of empirical evidence from neuroscience, the case of action properties is a good candidate in order to properly talk of perceptually represented properties. My claim is that the neurophysiological states encoding action properties are perceptual processes and that these perceptual processes are representational processes. That is, in the case of those neurophysiological states involved in the detection of action properties, it is correct to speak of perceptual representational states, and hence, ipso facto, of perceptually represented properties. First, I describe a reasonable and widely agreed upon conception of perceptual representation in the philosophical literature. Then, I report evidence from vision and motor neuroscience concerning the perception of action properties, which is subserved by the ventro-dorsal stream, a portion of the dorsal visual system. Finally, I show that a strong connection can be found between the philosophical idea of perceptual representation I have reported before and the neuroscientific evidence concerning the activity of the ventro-dorsal stream, whose job is, as said, to detect action properties. (shrink)

Several lines of evidence indicate that rapid target-aiming movements, involving both the eyes and hand, can be biased by the visual context in which the movements are performed. Some of these contextual influences carry-over from trial to trial. This research indicates that dissociation between the dorsal and ventral systems based on speed, conscious awareness, and frame of reference is far from clear.

Milner and Goodale's influential account of the primate cortical visual streams involves a division of consciousness between them, for it is the ventral stream that has the responsibility for visual consciousness. Hence, the dorsal visual stream is a ‘zombie’ stream. In this article, I argue that certain information carried by the dorsal stream likely plays a central role in the egocentric spatial content of experience, especially the experience of visual spatial constancy. Thus, the (...) class='Hi'>dorsal stream contributes to a pervasive feature of consciousness. (shrink)

According to what I’ll call the ‘two visual systems account’ (TWO-SYSTEMS), the visual system is divided into two independent sub- systems, a ventral system implementing ‘vision for perception’ and a dorsal system implementing ‘vision for action’ (Milner and Goodale, 2006). TWO-SYSTEMS is widely discussed in philosophy due to the counter-intuitive role that it posits for conscious experience in the control of actions. However, recent evidence undermines the model’s core tenets: it no longer appears that the ventral and dorsal (...) streams constitute isolated processing systems, and there is now evidence for the involvement of both streams in conscious experience and online motor control. I articulate a new ‘direct dorsal control account’ (DORSAL-CONTROL), show that it is immune to three empirical challenges facing TWO-SYSTEMS, and show that it nonetheless has similarly significant implications for the perceiving mind. -/- Section 1 articulates TWO-SYSTEMS and its philosophical implications. Section 2 describes three empirical challenges to TWO-SYSTEMS. Section 3 articulates DORSAL-CONTROL and shows that it is immune to the three challenges. Section 4 articulates DORSAL-CONTROL’s philosophical implications. (shrink)

The author argues that the theory of a dorsal/ventral stream for visual processing can be used to reconcile the constructivist and direct perception theories. My commentary discusses neurophysiological and psychophysical studies that run counter to the view. In addition, the central issue of debate between the constructionist and direct perception approaches regarding what is visual information is discussed.

For almost half a century dual-stream advocates have vigorously defended the view that there are two functionally specialized cortical streams of visual processing originating in the primary visual cortex: a ventral, perception-related ‘conscious’ stream and a dorsal, action-related ‘unconscious’ stream. They furthermore maintain that the perceptual and memory systems in the ventral stream are relatively shielded from the action system in the dorsal stream. In recent years, this view has come under scrutiny. Evidence (...) points to two overlapping action pathways: a dorso-dorsal pathway that calculates features of the object to be acted on, and a ventro-dorsal pathway that transmits stored information about skilled object use from the ventral stream to the dorso-dorsal pathway. This evidence suggests that stored information may exert significantly more influence on visually guided action than hitherto assumed. I argue that this, in turn, supports the notion of skilled automatic action that is nonetheless agential. My focus here will be on actions influenced by implicit biases (stereotypes/prejudices). Action that is biased in this way, I argue, is in an important sense intentional and agential. (shrink)

David Milner and Melvyn Goodale’s dissociation hypothesis is commonly taken to state that there are two functionally specialized cortical streams of visual processing originating in striate (V1) cortex: a dorsal, action-related “unconscious” stream and a ventral, perception-related “conscious” stream. As Milner and Goodale acknowledge, findings from blindsight studies suggest a more sophisticated picture that replaces the distinction between unconscious vision for action and conscious vision for perception with a tripartite division between unconscious vision for action, conscious vision (...) for perception, and unconscious vision for perception. The combination excluded by the tripartite division is the possibility of conscious vision for action. But are there good grounds for concluding that there is no conscious vision for action? There is now overwhelming evidence that illusions and perceived size can have a significant effect on action (Bruno & Franz, 2009; Dassonville & Bala, 2004; Franz & Gegenfurtner, 2008; McIntosh & Lashley, 2008). There is also suggestive evidence that any sophisticated visual behavior requires collaboration between the two visual streams at every stage of the process (Schenk & McIntosh, 2010). I nonetheless want to make a case for the tripartite division between unconscious vision for action, conscious vision for perception, and unconscious vision for perception. My aim here is not to refute the evidence showing that conscious vision can affect action but rather to argue (a) that we cannot gain cognitive access to action-guiding dorsal stream representations, and (b) that these representations do not correlate with phenomenal consciousness. This vindicates the semi-conservative view that the dissociation hypothesis is best understood as a tripartite division. (shrink)

Blindsight and vision for action seem to be exemplars of unconscious visual processes. However, researchers have recently argued that blindsight is not really a kind of uncon- scious vision but is rather severely degraded conscious vision. Morten Overgaard and col- leagues have recently developed new methods for measuring the visibility of visual stimuli. Studies using these methods show that reported clarity of visual stimuli correlates with accuracy in both normal individuals and blindsight patients. Vision for action has also come under (...) scrutiny. Recent findings seem to show that information processed by the dor- sal stream for online action contributes to visual awareness. Some interpret these results as showing that some dorsal stream processes are conscious visual processes (e.g., Gallese, 2007; Jacob & Jeannerod, 2003). The aim of this paper is to provide new support for the more traditional view that blindsight and vision for action are genuinely unconscious per- ceptual processes. I argue that individuals with blindsight do not have access to the kind of purely qualitative color and size information which normal individuals do. So, even though people with blindsight have a kind of cognitive consciousness, visual information process- ing in blindsight patients is not associated with a distinctly visual phenomenology. I argue further that while dorsal stream processing seems to contribute to visual awareness, only information processed by the early dorsal stream (V1, V2, and V3) is broadcast to working memory. Information processed by later parts of the dorsal stream (the parietal lobe) never reaches working memory and hence does not correlate with phenomenal awareness. I con- clude that both blindsight and vision for action are genuinely unconscious visual processes. (shrink)

This paper examines Milner and Goodale’s hypothesis about the two visual streams and raises the questions of whether properties in egocentric space (commonly associated with the vision-for-action, or "dorsal," stream) can be part of the phenomenal content of perceptual experience, or only properties in allocentric space (commonly associated with the vision-for-perception, or "ventral," stream) can play this role, and how (if at all) properties in egocentric space differ from properties in allocentric space. These questions are reminiscent of (...) issues raised by Christopher Peacocke's "equal-sized trees" case: if you are looking at equal-sized trees on the side of a road, the trees will phenomenally look to you to be equally tall. But it is also true that a tree will take up more of the space in your visual field the closer it is to you. So, the equal-sized trees will also phenomenally look to you to have different heights. Your (visual) perceptual experience is not illusory. That is, the trees veridically look to you to have the same height, and they also veridically look to you to have different heights. Call the sort of issue raised here the "problem of dual looks." I provide a solution to the problem of dual looks that helps shed light on whether properties in egocentric space can be part of the phenomenal content of perceptual experience, and how (if at all) properties in egocentric space differ from properties in allocentric space. (shrink)

The most important question concerning picture perception is: what perceptual state are we in when we see an object in a picture? In order to answer this question, philosophers have used the results of the two visual systems model, according to which our visual system can be divided into two streams, a ventral stream for object recognition, allowing one to perceive from an allocentric frame of reference, and a dorsal stream for visually guided motor interaction, thus allowing (...) one to perceive from an egocentric frame of reference. Following this model, philosophers denied that we can be in a dorsal perceptual state when perceiving a depicted object. This is because a depicted object is not physically graspable or manipulable and, in turn, it cannot be egocentrically localized, as a normal object, by the dorsal stream. Thus, the impossibility of manipulating depicted objects and of localizing them from an egocentric frame of reference has led some people to be sceptical about the possibility of a representation of action properties in the perception of objects in pictures, which pertains to the dorsal visual system. The aim of the present paper is to show that it is possible for the depicted object to be represented by dorsal perception. That means that we can ascribe action properties to depicted objects as well, even if depicted objects cannot be egocentrically localized—at least, not as much as normal objects can. (shrink)

Norman's aim to reconcile two longstanding and seemingly opposed philosophies of perception, the constructivist and the ecological, by casting them as approaches to complementary subsystems within the visual brain is laudable. Unfortunately, Norman overreaches in attempting to equate direct perception with dorsal/unconscious visual processing and indirect perception with ventral/conscious visual processing. Even a cursory review suggests that the functional and neural segregation of direct and indirect perception is not as clear as the target article would suggest.

Visual systems first evolved not to enable animals to perceive the world, but to provide distal sensory control of their movements. Conscious sight is a relatively recent invention, but its emergence has enabled organisms such as humans and other primates to carry out complex cognitive operations on a detailed perceptual representation of the world. The two streams of visual processing that have been identified in the primate cerebral cortex are a reflection of these two functions of vision. The dorsal (...) 'action' stream projecting from early visual areas to the posterior parietal cortex mediates the visual control of skilled motor acts. The ventral 'perceptual' stream projecting from early visual areas to the temporal lobe provides a perceptual experience of the world beyond our bodies. Both streams work together in the production of adaptive behavior. (shrink)

Inner speech emerges in early childhood, in parallel with the maturation of the dorsal language stream. To date, the developmental relations between these two processes have not been examined. We review evidence that the dorsal language stream has a role in supporting the psychological phenomenon of inner speech, before considering paediatric studies of the dorsal stream’s anatomical development and evidence for its emerging functional roles. We examine possible causal accounts of the relations between these (...) two developmental processes, and consider their implications for phylogenetic theories about the evolution of inner speech and the accounts of the ontogenetic relations between language and cognition. (shrink)

Philosophers have suggested that, in order to understand the particular visual state we are in during picture perception, we should focus on experimental results from vision neuroscience—in particular, on the most rigorous account of the functioning of the visual system that we have from vision neuroscience, namely, the ‘Two Visual Systems Model’. According to the initial version of this model, our visual system can be dissociated, from an anatomo-functional point of view, into two streams: a ventral stream subserving visual (...) recognition, and a dorsal stream subserving the visual guidance of action. Following this model, philosophers have suggested that, since the two streams have different functions, they represent different properties of a picture. However, the original view proposed by the ‘Two Visual Systems Model’ about the presence of a strong anatomo-functional dissociation between the two streams has recently been questioned on both philosophical and experimental grounds. Indeed, the analysis of several new pieces of evidence seems to suggest that many visual representations in our visual system, related to different tasks, are the result of a deep functional interaction between the streams. In the light of the renewed status of the ‘Two Visual Systems Model’, also our best philosophical model of picture perception should be renewed, in order to take into account a view of the process of picture perception informed by the new evidence about such interaction. Despite this, no account fulfilling this role has been offered yet. The aim of the present paper is precisely to offer such an account. It does this by suggesting that the peculiar visual state we are in during picture perception is subserved by interstream interaction. This proposal allows us to rely on a rigorous philosophical account of picture perception that is, however, also based on the most recent results from neuroscience. Unless the explanation offered in this paper is endorsed, all the recent evidence from vision neuroscience will remain unexplained under our best empirically informed philosophical theory of picture perception. (shrink)

What representational state mediates between perception and action? Bence Nanay says pragmatic representations, which are outputs of perceptual systems. This commits him to the view that optic ataxics face difficulty in performing visually guided arm movements because the relevant perceptual systems output their pragmatic representations incorrectly. Here, I argue that it is not enough to say that pragmatic representations are output incorrectly; we also need to know why they are output that way. Given recent evidence that optic ataxia impairs peripersonal (...) space representation, I argue that pragmatic representations are output incorrectly because the organizing principle of the vision-for-action system is blocked by optic ataxia. I then show how this means that this principle, not pragmatic representations, is the representational state that mediates between perception and action, i.e. the principle, not pragmatic representations, is the immediate mental antecedent of action. (shrink)

According to Milner and Goodale’s dual visual systems (DVS) theory, a division obtains between visual consciousness and motor action, in that the visual system producing conscious vision (the ventral stream) is distinct from the one guiding action (the dorsal stream). That there would be this division is often taken (by Andy Clark and others) to undermine the folk view on how consciousness and action relate. However, even if this division obtains, this leaves open the possibility that con- (...) scious ventral information is often transmitted to the uncon- scious dorsal stream and then used to guide action, a possibility seeming to preserve a significant role for consciousness in action. This article assesses this possibility. In course of doing so, we will review those arguments recently having been made against the DVS view on how visual consciousness and action relate (ones due to, e.g., Briscoe and Schwenkler, or Schenk and McIntosh). What we will find is that, if we properly analyze the data upon which these arguments are based, we are still left with the impression that the DVS view is largely correct; i.e., it is only rarely that visual experience guides action. (shrink)

The representations formed by the ventral and dorsal streams of a prelinguistic agent will tend to be too qualitatively similar to support the distinct roles required by PREDICATE(x) structure. We suggest that the attachment of qualities to objects is not a product of the combination of these separate processing streams, but is instead a part of the processing required in each. In addition, we suggest that the formation of objective predicates is inextricably bound up with the emergence of language (...) itself, and so cannot be cleanly identified with any prelinguistic cognitive capacities. (shrink)

It is natural to assume that the fine-grained and highly accurate spatial information present in visual experience is often used to guide our bodily actions. Yet this assumption has been challenged by proponents of the Two Visual Systems Hypothesis , according to which visuomotor programming is the responsibility of a “zombie” processing stream whose sources of bottom-up spatial information are entirely non-conscious . In many formulations of TVSH, the role of conscious vision in action is limited to “recognizing objects, (...) selecting targets for action, and determining what kinds of action, broadly speaking, to perform” . Our aim in this study is to show that the available evidence not only fails to support this dichotomous view but actually reveals a significant role for conscious vision in motor programming, especially for actions that require deliberate attention. (shrink)

Empirical work and philosophical analysis have led to widespread acceptance that vision for action, served by the cortical dorsal stream, is unconscious. I argue that the empirical argument for this claim is unsound. That argument relies on subjects’ introspective reports. Yet on biological grounds, in light of the theory of primate cortical vision, introspection has no access to dorsal stream mediated visual states. It is thus wrongly assumed that introspective reports speak to absent phenomenology in the (...) dorsal stream. In light of this, I consider a different conception of consciousness’s relation to agency in terms of access. While theoretical reasons suggest that the inaccessibility of the dorsal stream to conceptual report is evidence that it is unconscious, this position begs important questions. I propose a broader notion of access in respect of the guidance of intentional agency and not, narrowly, conceptual report (Note: this paper contradicts my earlier paper, "The Case for Zombie Agency"). (shrink)

The cortical visual mechanisms involved in processing spatial relationships remain subject to debate. According to one current view, the ''dorsal stream'' of visual areas, emanating from primary visual cortex and culminating in the posterior parietal cortex, mediates this aspect of visual processing. More recently, others have argued that while the dorsal stream provides egocentric coding of visual location for motor control, the separate ''ventral'' stream is needed for allocentric spatial coding. We have assessed the visual (...) form agnosic patient DF, whose lesion mainly affects the ventral stream, on a prehension task requiring allocentric spatial coding. She was presented with transparent circular disks. Each disk had circular holes cut in it. DF was asked to reach out and grasp the disk by placing her fingers through the holes. The disks either had three holes (for forefinger, middle finger, and thumb) or two holes (for forefinger and thumb). The distance between the forefinger and thumb holes, and the orientation of the line formed by them, were independently varied. DF was quite unable to adjust her grip aperture or her hand orientation in the three-hole task. Although she was able to orient her hand appropriately for the two-hole disks, she still remained unable to adjust her grip aperture to the distance between the holes. These findings are consistent with the idea that allocentric processing of spatial information requires a functioning ventral stream, even when the information is being used to guide a motor response. (shrink)

One necessary condition on any adequate account of perception is clarity regarding whether unconscious perception exists. The issue is complicated, and the debate is growing in both philosophy and science. In this paper we consider the case for unconscious perception, offering three primary achievements. First, we offer a discussion of the underspecified notion of central coordinating agency, a notion that is critical for arguments that purportedly perceptual states are not attributable to the individual, and thus not genuinely perceptual. We develop (...) an explication of what it is for a representational state to be available to central coordinating agency for guidance of behavior. Second, drawing on this explication, we place a more careful understanding of the attributability of a state to the individual in the context of a range of empirical work on vision-for-action, saccades, and skilled typing. The results place pressure on the skeptic about unconscious perception. Third, reflecting upon broader philosophical themes running through debates about unconscious perception, we highlight how our discussion places pressure on the view that perception is a manifest kind, rather than a natural kind. In doing so, we resist the tempting complaint that the debate about unconscious perception is merely verbal. (shrink)

The visual control of action is a critical ability for interacting with the visual environment. Visual perception, however, is necessary for recognizing and memorizing different aspects of this environment. According to an influential proposal by Goodale and Milner, these two distinct visual functions are mediated by different cortical areas. The ventral visual stream mediates perception and the dorsal stream mediates the visual control of action. In this review, we focus on behavioral evidence looking at potential differences in (...) the principles governing visual organization for perception and action. We propose that, unlike visual perception, which is largely governed by relational and Gestalt representations of objects, visually-guided action treats objects in a more analytic fashion. We review evidence from visual illusions, studies of object–shape perception, and psychophysical studies of visual resolution of size to support this idea. We conclude that the visual perception of objects and their relations tends to be holistic and contextual in nature, whereas the visual control of skilled actions is more analytical, circumscribed, and tuned to the real metrics of the visual environment. (shrink)

A body schema is an agent's model of its own body that enables it to act on affordances in the environment. This paper presents a body schema system for the Learning Intelligent Decision Agent (LIDA) cognitive architecture. LIDA is a conceptual and computational implementation of Global Workspace Theory, also integrating other theories from neuroscience and psychology. This paper contends that the ‘body schema' should be split into three separate functions based on the functional role of consciousness in Global Workspace Theory. (...) There is (1) an online model of the agent's effectors and effector variables (Current Body Schema), (2) a long-term, recognitional storage of embodied capacities for action and affordances (Habitual Body Schema), and (3) "dorsal" stream information feeding directly from early perception to sensorimotor processes (Online Body Schema). This paper then discusses how the LIDA model of the body schema explains several experiments in psychology and ethology. (shrink)

O'Regan & Noë run into some difficulty in trying to reconcile their “seeing as acting” proposal with the perception and action account of the functions of the two streams of visual projections in the primate cerebral cortex. I suggest that part of the problem is their reluctance to acknowledge that the mechanisms in the ventral stream may play a more critical role in visual awareness and qualia than mechanisms in the dorsal stream.

Whether or not the correspondence of dorsal stream functions to Gibsonian ecological psychology and the ventral stream functions to “constructivism” hold up, the overall goal of capturing a pragmatic realism should not be forgotten.

When we reach to pick up an object, our actions are effortlessly informed by the object’s spatial information, the position of our limbs, stored knowledge of the object’s material properties, and what we want to do with the object. A substantial body of evidence suggests that grasps are under the control of “automatic, unconscious” sensorimotor modules housed in the “dorsal stream” of the posterior parietal cortex. Visual online feedback has a strong effect on the hand’s in-flight grasp aperture. (...) Previous work of ours exploited this effect to show that grasps are refractory to cued expectations for visual feedback. Nonetheless, when we reach out to pretend to grasp an object (pantomime grasp), our actions are performed with greater cognitive effort and they engage structures outside of the dorsal stream, including the ventral stream. Here we ask whether our previous finding would extend to cued expectations for haptic feedback. Our method involved a mirror apparatus that allowed participants to see a “virtual” target cylinder as a reflection in the mirror at the start of all trials. On “haptic feedback” trials, participants reached behind the mirror to grasp a size-matched cylinder, spatially coincident with the virtual one. On “no-haptic feedback” trials, participants reached behind the mirror and grasped into “thin air” because no cylinder was present. To manipulate haptic expectation, we organized the haptic conditions into blocked, alternating, and randomized schedules with and without verbal cues about the availability of haptic feedback. Replicating earlier work, we found the strongest haptic effects with the blocked schedules and the weakest effects in the randomized uncued schedule. Crucially, the haptic effects in the cued randomized schedule was intermediate. An analysis of the influence of the upcoming and immediately preceding haptic feedback condition in the cued and uncued random schedules showed that cuing the upcoming haptic condition shifted the haptic influence on grip aperture from the immediately preceding trial to the upcoming trial. These findings indicate that, unlike cues to the availability of visual feedback, participants take advantage of cues to the availability of haptic feedback, flexibly engaging pantomime, and natural modes of grasping to optimize the movement. (shrink)

Deictic coding offers a useful model for understanding the interactions between the dorsal and ventral streams of visual processing in the cerebral cortex. By extending Ballard et al.'s ideas on teleassistance, I show how dedicated low-level visuomotor processes in the dorsal stream might be engaged for the services of high-level cognitive operations in the ventral stream.

The studies cited by Dijkerman & de Haan (D&dH) stress the distinction between perception and action within the somatosensory system but provide little information about memory functions. Recent findings by our group and by others show that the dorsal stream is also activated during short-term memory maintenance and long-term memory retrieval of haptic information. These data complement and extend the proposed model.

The ability to judge accurately whether or not an action can be accomplished successfully is critical for selecting appropriate response options that enable adaptive behaviors. Such affordance judgments are thought to rely on the perceived fit between environmental properties and knowledge of one's current physical capabilities. Little, however, is currently known about the ability of individuals to judge their own affordances following a stroke, or about the underlying neural mechanisms involved. To address these issues, we employed a signal detection approach (...) to investigate the impact of left or right hemisphere injuries on judgments of whether a visual object was located within reach while remaining still. Regarding perceptual sensitivity and accuracy in judging reachability, there were no significant group differences between healthy controls, right brain damaged and left brain damaged stroke patients. However, while healthy controls and RBD patients demonstrated a negative response criterion and thus overestimated their reach capability, LBD patients' average response criterion converged to zero, indicating no judgment tendency. Critically, the LBD group's judgment tendency pattern is consistent with previous findings in this same sample on an affordance judgment task that required estimating whether the hand can fit through apertures. Lesion analysis suggests that this loss of judgment tendency may be associated with damage to the left insula, the left parietal and middle temporal lobe. Based on these results, we propose that damage to the left ventro-dorsal stream disrupts the retrieval and processing of a stable criterion, leading to stronger reliance on intact on-line body-perceptive processes computed within the preserved bilateral dorsal network. (shrink)

Much of our everyday, embodied action comes in the form of smooth coping. Smooth coping is skillful action that has become habituated and ingrained, generally placing less stress on cognitive load than considered and deliberative thought and action. When performed with skill and expertise, walking, driving, skiing, musical performances, and short-order cooking are all examples of the phenomenon. Smooth coping is characterized by its rapidity and relative lack of reflection, both being hallmarks of automatization. Deliberative and reflective actions provide the (...) contrast case. In Dreyfus’ classic view, smooth coping is “mindless” absorption into action, being in the flow, and any reflective thought will only interrupt this flow. Building on the pragmatist account of Dewey, others, such as Sutton, Montero, and Gallagher, insist on the intelligent flexibility built into smooth coping, suggesting that it is not equivalent to automatization. We seek to answer two complementary challenges in this article. First, how might we model smooth coping in autonomous agents at fine granularity? Second, we use this model of smooth coping to show how we might implement smooth coping in artificial intelligent agents. We develop a conceptual model of smooth coping in LIDA. LIDA is an embodied cognitive architecture implementing the global workspace theory of consciousness, among other psychological theories. LIDA’s implementation of consciousness enables us to account for the phenomenology of smooth coping, something that few cognitive architectures would be able to do. Through the fine granular analysis of LIDA, we argue that smooth coping is a sequence of automatized actions intermittently interspersed with consciously mediated action selection, supplemented by dorsal stream processes. In other words, non-conscious, automatized actions often require occasional bursts of conscious cognition to achieve the skillful and flexible adjustments of smooth coping. In addition, never-conscious dorsal stream information and associated sensorimotor processes provide further online adjustments during smooth coping. To achieve smooth coping in LIDA we introduce a new module to the LIDA cognitive architecture the Automatized Action Selection sub-module. Our complex model of smooth coping borrows notions of “embodied intelligence” from enactivism and augments these by allowing representations and more detailed mechanisms of conscious control. We explore several extended examples of smooth coping, starting from basic activities like walking and scaling up to more complex tasks like driving and short-order cooking. (shrink)