This paper introduces a manual movement performed recurrently by German children in the age range of four to six. Based on the movement gestalt and its meaning, we termed it the Slapping movement. All forms identified in the data were performed with a communicative function, yet they showed different degrees of “gesturality.” To be more precise, we observed versions that clearly count as actions or gestures, but we also observed transitional forms between them. Based on a thorough analyses of form, (...) meaning, and context we determined variations of the Slapping gesture that showed different degrees of abstraction from action to gesture in a semiotic sense. These degrees are distinguished by modifications in the execution of the movement and different levels of form stability, environmental coupling, and representational complexity. (shrink)

The goal of the article is to offer a framework against which relations between gesture and sign can be systematically explored beyond the current literature. It does so by (a) reconstructing the history of the discussion in the field of gesture studies, focusing on three leading positions (Kendon, McNeill, and Goldin-Meadow); and (b) by formulating a position to illustrate how this can be achieved. The paper concludes by emphasizing the need for systematic cross-linguistic research on multimodal use of (...) language in its signed and spoken forms. (shrink)

Few philosophers today know much about Charles Peirce’s metaphysics, although a great many know something about his epistemology, philosophy of science, and logic. Indeed, few Peirce experts have written much on his metaphysics or made it the focus of their research. To an extent, this is understandable. Peirce’s writings were left in a disastrously disorganized state (mostly unpublished), and the crucial papers on metaphysics from his later years have not yet been republished in the first-rate chronological edition, the incomplete Writings (...) of Charles S. Peirce: A Chronological Edition , edited at Indianapolis by my friends. And then there is Peirce’s writing: an awkward, abrasive, arrogant, eclectic style that demands technical knowledge in diverse fields, especially logic, mathematics, and the natural sciences. His worst personality traits manifested themselves in his highly technical metaphysics—with its idiosyncratic, anti-Cantorian conception of continua, a pecularly mathematical phenomenology, and elaborate views on Darwinian and non-Darwinian evolution, for example. Finally, there is what might appear to be the bizarreness of the theory itself, as we shall see. Peirce was a kind of philosophical swashbuckler, a bold, courageous speculator on philosophical questions beyond most of our temperaments even to ponder. Ours is not the philosophical age of Errol Flynn but the minimalist age of Harrison Ford, with no grand gestures or speeches, just a series of small, no-nonsense gestures: we typically like our philosophy short, neat, "science-like," and isolated from other philosophical issues. (shrink)

Few philosophers today know much about Charles Peirce’s metaphysics, although a great many know something about his epistemology, philosophy of science, and logic. Indeed, few Peirce experts have written much on his metaphysics or made it the focus of their research. To an extent, this is understandable. Peirce’s writings were left in a disastrously disorganized state (mostly unpublished), and the crucial papers on metaphysics from his later years have not yet been republished in the first-rate chronological edition, the incomplete Writings (...) of Charles S. Peirce: A Chronological Edition , edited at Indianapolis by my friends. And then there is Peirce’s writing: an awkward, abrasive, arrogant, eclectic style that demands technical knowledge in diverse fields, especially logic, mathematics, and the natural sciences. His worst personality traits manifested themselves in his highly technical metaphysics—with its idiosyncratic, anti-Cantorian conception of continua, a pecularly mathematical phenomenology, and elaborate views on Darwinian and non-Darwinian evolution, for example. Finally, there is what might appear to be the bizarreness of the theory itself, as we shall see. Peirce was a kind of philosophical swashbuckler, a bold, courageous speculator on philosophical questions beyond most of our temperaments even to ponder. Ours is not the philosophical age of Errol Flynn but the minimalist age of Harrison Ford, with no grand gestures or speeches, just a series of small, no-nonsense gestures: we typically like our philosophy short, neat, "science-like," and isolated from other philosophical issues. (shrink)

How does sign language compare with gesture, on the one hand, and spoken language on the other? Sign was once viewed as nothing more than a system of pictorial gestures without linguistic structure. More recently, researchers have argued that sign is no different from spoken language, with all of the same linguistic structures. The pendulum is currently swinging back toward the view that sign is gestural, or at least has gestural components. The goal of this review is to elucidate (...) the relationships among sign language, gesture, and spoken language. We do so by taking a close look not only at how sign has been studied over the past 50 years, but also at how the spontaneous gestures that accompany speech have been studied. We conclude that signers gesture just as speakers do. Both produce imagistic gestures along with more categorical signs or words. Because at present it is difficult to tell where sign stops and gesture begins, we suggest that sign should not be compared with speech alone but should be compared with speech-plus-gesture. Although it might be easier (and, in some cases, preferable) to blur the distinction between sign and gesture, we argue that distinguishing between sign (or speech) and gesture is essential to predict certain types of learning and allows us to understand the conditions under which gesture takes on properties of sign, and speech takes on properties of gesture. We end by calling for new technology that may help us better calibrate the borders between sign and gesture. (shrink)

The book represents a historical overview of the way the topic of gesture and sign language has been treated in the 18th century French philosophy. The texts treated are grouped into several categories based on the view they present of deafness and gesture. While some of those texts obviously view deafness and sign language in negative terms, i.e. as deficiency, others present deafness essentially as difference, i.e. as a set of competences that might provide some insights into how (...) spoken language works. One of the arguments of the book is that these two views of deafness and sign language still represent two dominant paradigms present in the current debates on the issue. The aim of the book, therefore, is not only to provide a historical overview but to trace what might be called a "history of the present". (shrink)

People frequently gesture when a word is on the tip of their tongue (TOT), yet research is mixed as to whether and why gesture aids lexical retrieval. We tested three accounts: the lexical retrieval hypothesis, which predicts that semantically related gestures facilitate successful lexical retrieval; the cognitive load account, which predicts that matching gestures facilitate lexical retrieval only when retrieval is hard, as in the case of a TOT; and the motor movement account, which predicts that any motor (...) movements should support lexical retrieval. In Experiment 1 (a between‐subjects study; N = 90), gesture inhibition, but not neck inhibition, affected TOT resolution but not overall lexical retrieval; participants in the gesture‐inhibited condition resolved fewer TOTs than participants who were allowed to gesture. When participants could gesture, they produced more representational gestures during resolved than unresolved TOTs, a pattern not observed for meaningless motor movements (e.g., beats). However, the effect of gesture inhibition on TOT resolution was not uniform; some participants resolved many TOTs, while others struggled. In Experiment 2 (a within‐subjects study; N = 34), the effect of gesture inhibition was traced to individual differences in verbal, not spatial short‐term memory (STM) span; those with weaker verbal STM resolved fewer TOTs when unable to gesture. This relationship between verbal STM and TOT resolution was not observed when participants were allowed to gesture. Taken together, these results fit the cognitive load account; when lexical retrieval is hard, gesture effectively reduces the cognitive load of TOT resolution for those who find the task especially taxing. (shrink)

This study aims to corroborate Merleau-Ponty’s interpretations of fundamental ideas from Saussure’s linguistics by linking them to works that were independently elaborated by Jan Mukařovský, Czech structuralist aesthetician and literary theorist. I provide a comparative analysis of the two authors’ theories of language and their interpretations of thought as fundamentally determined by language. On this basis, I investigate how they conceive linguistic innovation and its translation into changes in the constituted language and other social codes and institutions. I explain how (...) they elaborate on Saussure’s idea of language as a system of oppositions by interpreting cultural innovation as a systematic variation of pre-established social norms and, similarly, linguistic innovation as gesturing within language. Connectedly, I show how Mukařovský’s works help clarify Merleau-Ponty’s focus on the gestural dimension of language. By discussing the two thinkers’ arguments in favour of linguistic innovation, I explore what could be called phenomenological limits of structuralism. (shrink)

Speakers frequently perform representational gestures to depict concepts in an iconic fashion. For example, a speaker may hold her index finger and thumb apart to indicate the size of a matchstick. However, the process by which a physical handshape is mentally transformed into abstract spatial information is not well understood. We present a series of experiments that investigate how people decode the physical form of an articulator to derive imaginary geometrical constructs, which we call “gesture form.” We provide quantitative (...) evidence for several key properties that play a role in this process. First, “profiling,” the ability to focus on a structural subunit within the complex form of the physical hand. Second, “perspective,” for which we show that one and the same handshape seen from different perspectives can lead to different spatial interpretations. Third, “selectivity,” the fact that gestures focus on specific spatial features at the expense of others. Our results provide a first step toward mapping out the process of how representational gestures make the communication of spatial information possible. (shrink)

In this paper I propose to read and understand gestures as logical tools within a synthetic paradigm of knowledge. This interpretation of gesture is drawn from a new pragmatist reading of reasoning in general, and synthetic reasoning in particular. Complete gestures are actions with a beginning and an end that bear a meaning. It is our regular way to embody vague ideas into singular actions with general meaning. The tool is forged by a dense blending of icons, indices, and (...) symbols and by a complexity of phenomenological characteristics as feelings, actual actions, general concepts and habits. The paper illustrates this new way to look at gestures and different kinds of complete and incomplete gestures. (shrink)

David McNeill, a pioneer in the ongoing study of the relationship between gesture and language, here argues that gestures are active participants in both speaking and thinking. He posits that gestures are key ingredients in an “imagery-language dialectic” that fuels speech and thought. The smallest unit of this dialectic is the growth point, a snapshot of an utterance at its beginning psychological stage. In _Gesture and Thought,_ the central growth point comes from a Tweety Bird cartoon. Over the course (...) of twenty-five years, the McNeill Lab showed this cartoon to numerous subjects who spoke a variety of languages, and a fascinating pattern emerged. The shape and timing of gestures depends not only on what speakers see but on what they take to be distinctive; this, in turn, depends on the context. Those who remembered the same context saw the same distinctions and used similar gestures; those who forgot the context understood something different and changed gestures or used none at all. Thus, the gesture becomes part of the growth point—the building block of language and thought. _Gesture and Thought _is an ambitious project in the ongoing study of how we communicate and how language is connected to thought. (shrink)

Gestures is a collection of essays that proposes a daring and ambitious new conception of human behavior. Defining gesture as “a movement of the body or of a tool attached to the body for which there is no satisfactory causal explanation,” Flusser moves around the topic from different points of view, angles and distances: sometimes he zooms in on a modest, ordinary movement like taking a photograph, shaving, or smoking a pipe. Sometimes he pulls back to look at something (...) as vast and varied as human “making,” embracing everything from the fashioning of simple tools to mass manufacturing. Holding firmly to basic phenomenological principles – that consciousness is always consciousness of something, that we know others by reference to ourselves, he claims that we constantly “read” states of mind, i.e. thoughts, intentions, emotions, from gestures; still we lack a theory about how this happens. Gestures takes a first step. It offers alternatives to theories by now so veiled by habit and myth that we are hardly conscious of them, and so hardly realize that they are failing. These include the assumption that we can “know” something without being affected by it, the belief that science is value-free, and the common conviction that science and art are fundamentally different activities. (shrink)

During face‐to‐face conversation, transitions between speaker turns are incredibly fast. These fast turn exchanges seem to involve next speakers predicting upcoming semantic information, such that next turn planning can begin before a current turn is complete. Given that face‐to‐face conversation also involves the use of communicative bodily signals, an important question is how bodily signals such as co‐speech hand gestures play into these processes of prediction and fast responding. In this corpus study, we found that hand gestures that depict or (...) refer to semantic information started before the corresponding information in speech, which held both for the onset of the gesture as a whole, as well as the onset of the stroke (the most meaningful part of the gesture). This early timing potentially allows listeners to use the gestural information to predict the corresponding semantic information to be conveyed in speech. Moreover, we provided further evidence that questions with gestures got faster responses than questions without gestures. However, we found no evidence for the idea that how much a gesture precedes its lexical affiliate (i.e., its predictive potential) relates to how fast responses were given. The findings presented here highlight the importance of the temporal relation between speech and gesture and help to illuminate the potential mechanisms underpinning multimodal language processing during face‐to‐face conversation. (shrink)

A beneficial effect of gesture on learning has been demonstrated in multiple domains, including mathematics, science, and foreign language vocabulary. However, because gesture is known to co-vary with other non-verbal behaviors, including eye gaze and prosody along with face, lip, and body movements, it is possible the beneficial effect of gesture is instead attributable to these other behaviors. We used a computer-generated animated pedagogical agent to control both verbal and non-verbal behavior. Children viewed lessons on mathematical equivalence (...) in which an avatar either gestured or did not gesture, while eye gaze, head position, and lip movements remained identical across gesture conditions. Children who observed the gesturing avatar learned more, and they solved problems more quickly. Moreover, those children who learned were more likely to transfer and generalize their knowledge. These findings provide converging evidence that gesture facilitates math learning, and they reveal the potential for using technology to study non-verbal behavior in controlled experiments. (shrink)

Analogy researchers do not often examine gesture, and gesture researchers do not often borrow ideas from the study of analogy. One borrowable idea from the world of analogy is the importance of distinguishing between attributes and relations. Gentner observed that some metaphors highlight attributes and others highlight relations, and called the latter analogies. Mirroring this logic, we observe that some metaphoric gestures represent attributes and others represent relations, and propose to call the latter analogical gestures. We provide examples (...) of such analogical gestures and show how they relate to the categories of iconic and metaphoric gestures described previously. Analogical gestures represent different types of relations and different degrees of relational complexity, and sometimes cohere into larger analogical models. Treating analogical gestures as a distinct phenomenon prompts new questions and predictions, and illustrates one way that the study of gesture and the study of analogy can be mutually informative. (shrink)

There has long been interest in why languages are shaped the way they are, and in the relationship between sign language and gesture. In sign languages, entity classifiers are handshapes that encode how objects move, how they are located relative to one another, and how multiple objects of the same type are distributed in space. Previous studies have shown that hearing adults who are asked to use only manual gestures to describe how objects move in space will use gestures (...) that bear some similarities to classifiers. We investigated how accurately hearing adults, who had been learning British Sign Language for 1–3 years, produce and comprehend classifiers in locative and distributive constructions. In a production task, learners of BSL knew that they could use their hands to represent objects, but they had difficulty choosing the same, conventionalized, handshapes as native signers. They were, however, highly accurate at encoding location and orientation information. Learners therefore show the same pattern found in sign-naïve gesturers. In contrast, handshape, orientation, and location were comprehended with equal accuracy, and testing a group of sign-naïve adults showed that they too were able to understand classifiers with higher than chance accuracy. We conclude that adult learners of BSL bring their visuo-spatial knowledge and gestural abilities to the tasks of understanding and producing constructions that contain entity classifiers. We speculate that investigating the time course of adult sign language acquisition might shed light on how gesture became conventionalized during the genesis of sign languages. (shrink)

The ubiquitous human practice of spontaneously gesturing while speaking demonstrates the embodiment, embeddedness, and sociality of cognition. The present essay takes gestural practice to be a paradigmatic example of a more general claim: human cognition is social insofar as our embedded, intelligent, and interacting bodies select and construct meaning in a way that is intersubjectively constrained and defeasible. Spontaneous co-speech gesture is markedly interesting because it at once confirms embodied aspects of linguistic meaning-making that formalist and linguistic turn-type philosophical (...) approaches fail to appreciate, and it also forefronts intersubjectivity as an inherent and inherently normative dimension of communicative action. Co-speech hand gestures, as linguistically meaningful speech acts, demonstrate both sedimentation and spontaneity (in the sense of Maurice Merleau-Ponty’s dialectic of linguistic expression ( 2002 )), or features of convention and nonconvention in a Gricean sense ( 1989 ). Yet neither pragmatic nor classic phenomenological approaches to communication can accommodate the practice of co-speech hand gesturing without some rehabilitation and reorientation. Pragmatic criteria of intersubjectivity, normativity, and rationality need to confront the non-propositional and nonverbal meaning-making of embodied encounters. Phenomenological treatments of expression and intersubjectivity must consider the normative nature of high-order social practices like language use. Reciprocally critical exchanges between these traditions and gesture studies yield an improved philosophy that treats language as a multi-modal medium for collaborative meaning achievement. The proper paradigm for these discussions is found in enactive approaches to social cognition. Co-speech hand gestures are first and foremost emergent elements of social interaction, not the external whirring of an isolated internal consciousness. In contrast to current literature that frequently presents gestures as uncontrollable bodily upsurge or infallible imagistic phenomenon that drives and dances with verbal or “linguistic” convention (McNeill 1992 , 2005 ), I suggest that we study gestures as dynamic, embodied, and shared tools for collaborative sense-making. (shrink)

Speakers of different languages (e.g., English vs. Turkish) show a binary split in how they package and order components of a motion event in speech and co‐speech gesture but not in silent gesture. In this study, we focused on Mandarin Chinese, a language that does not follow the binary split in its expression of motion in speech, and asked whether adult Chinese speakers would follow the language‐specific speech patterns in co‐speech but not silent gesture, thus showing a (...) pattern akin to Turkish and English adult speakers in their description of animated motion events. Our results provided evidence for this pattern, with Chinese—as well as English and Turkish—speakers following language‐specific patterns in speech and co‐speech gesture but not in silent gesture. Our results provide support for the “thinking‐for‐speaking” account, namely that language influences thought only during online, but not offline, production of speech. (shrink)

For Greek antiquity, the question of right or fitting measure constituted the very heart of both ethics and politics. But can the Good of the ethical life and the Justice of the political be reduced to measurement and calculation? If they are matters of measure, are they not also absolutely immeasurable? In critical dialogue with texts by Plato, Hölderlin, Rilke, Heidegger, Benjamin, Adorno, Marx, Merleau-Ponty, Levinas, and Levi, the author argues that the question of measure has become ever more urgent (...) in the context of a modernity pressured by the conditions of a technological economy and a relativism that threatens to destroy a vital sense of moral responsibility and the commitment to justice that underlies the possibility of freedom. Conceived as a task for the “metaphysics” of memory, this book explores the normative problematic of measure, bringing its deeply buried redemptive promise to appearance in our gestures, uses and abuses of the hands, the dialectic of tact, and the manners of social existence. (shrink)

In dynamic theories of presupposition, a trigger pp′ with presupposition p and at-issue component p′ comes with a requirement that p should be entailed by the local context of pp′. We argue that some co-speech gestures should be analyzed within a presuppositional framework, but with a twist: an expression p co-occurring with a co-speech gesture G with content g comes with the requirement that the local context of p should guarantee that p entails g; we call such assertion-dependent presuppositions (...) ‘cosuppositions’. We show that this analysis can be combined with earlier theories of local contexts to account for complex patterns of gesture projection in quantified and in attitudinal contexts, and we compare our account to two potential alternatives: one based on supervaluations, and one, due to Cornelia Ebert, that treats co-speech gestures as supplements. We argue that the latter is correct, but for ‘post-speech’ gestures, rather than for co-speech gestures. (shrink)

Gestures’ Contribution to Collective Metaphorical Thinking in a Community of Philosophical Inquiry (CPI). This paper explores an idea expressed by a student discussing where our thoughts come from: to think we have to move our hands. Such sentence echoes the literature on the role of gesture for thinking. This study also focuses on the collective advancement of reasoning in a CPI. The instructor chooses to conclude by asking each student to suggest an analogy of thinking. This closing sequence reveals (...) how the instructor, through metaphorical gestures, fosters collective awareness of new propositions, and their further elaboration. After characterizing the cognitive models so produced, video analysis is used to follow their collective, verbal and gestural construction along the discussion. (shrink)

Gottlob Frege’s conception of works of art has received scant notice in the literature. This is a pity since, as this paper undertakes to reveal, his innovative philosophy of language motivated a theoretically and historically consequential, yet unaccountably marginalized Wittgenstinian line of inquiry in the domain of aesthetics. The element of Frege’s approach that most clearly inspired this development is the idea that only complete sentences articulate thoughts and that what sentences in works of drama and literary art express are (...) ‘mock thoughts’ (Schiengedanken). The early Wittgenstein closely followed Frege’s lead on this theme. One sees this, for example, in the Tractatus, where Wittgenstein announces that only sentential propositions model (‘picture’) states of affairs whereas works of art are objects we perceive sub specie aeternitatis (1961, 83). By the 1930s, however, Wittgenstein began to revise his view beyond his initial Frege-inspired standpoint. He came to insist that works of art can convey thoughts as well, but that thoughts do not model (picture) the world of facts and hence do not convey information about measurable objects and events. Rather, his contention was that aesthetically configured thoughts that artworks communicate impart information about our perspective on reality and reconfigure our view of life. To be more explicit, successful (gelungene) or ‘good’ works of art (ibid.), in Wittgenstein’s view, can supply aesthetically instructive ‘gestures’ that open to living experience promising new ways of being. It is in this respect, he held, that artists ‘have something to teach’ (1980, 36). (shrink)

While recent studies have claimed that non-referential gestures (i.e., gestures that do not visually represent any semantic content in speech) are used to mark discourse-new and/or -accessible referents and focused information in adult speech, to our knowledge, no prior investigation has studied the relationship between information structure (IS) and gesture referentiality in children’s narrative speech from a developmental perspective. A longitudinal database consisting of 332 narratives performed by 83 children at two different time points in development was coded for (...) IS and gesture referentiality (i.e., referential and non-referential gestures). Results revealed that at both time points, both referential and non-referential gestures were produced more with information that moves discourse forward (i.e., focus) and predication (i.e., comment) rather than topical or background information. Further, at 7–9 years of age, children tended to use more non-referential gestures to mark focus and comment constituents than referential gestures. In terms of the marking of the newness of discourse referents, non-referential gestures already seem to play a key role at 5–6 years old, whereas referential gestures did not show any patterns. This relationship was even stronger at 7–9 years old. All in all, our findings offer supporting evidence that in contrast with referential gestures, non-referential gestures have been found to play a key role in marking IS, and that the development of this relationship solidifies at a period in development that coincides with a spurt in non-referential gesture production. (shrink)

This paper explores the intertwinement of ontology and history that happened after the idealist turn of Kantian transcendentalism, particularly in classic German idealism and later in American pragmatism. The paper focuses on the less remarked-upon consequence of this intertwinement, namely the possibility of a new reading of history based on changes in concepts and habitual mentality. The paper proposes a new take on historiography that vindicates Hegel’s insight but changes his approach to a pragmatist one, more apt to face historical (...) changes in a technical way and less easily twistable into ideological frameworks. The paper argues that the notion of habit, as phenomenologically and semiotically described by Peirce, is the fundamental cellule of the pragmatist take on the entanglement of history and ontology. The paper elaborates on the notion of habit, singling out a special form of it called “gesture” that can be a useful tool for reading the history of the human spirit without incorporating Hegel’s dialectic and Absolute. The paper compares the notion of gesture as it originated in the pragmatist tradition with the parallel use of the term in the early studies of Michel Foucault and argues that the notion of gesture is better equipped to tackle a theoretical reading of history. (shrink)

Using a cross-modal semantic priming paradigm, both experiments of the present study investigated the link between the mental representations of iconic gestures and words. Two groups of the participants performed a primed lexical decision task where they had to discriminate between visually presented words and nonwords (e.g., flirp). Word targets (e.g., bird) were preceded by video clips depicting either semantically related (e.g., pair of hands flapping) or semantically unrelated (e.g., drawing a square with both hands) gestures. The duration of gestures (...) was on average 3,500 ms in Experiment 1 but only 1,000 ms in Experiment 2. Significant priming effects were observed in both experiments, with faster response latencies for related gesture–word pairs than unrelated pairs. These results are consistent with the idea of interactions between the gestural and lexical representational systems, such that mere exposure to iconic gestures facilitates the recognition of semantically related words. (shrink)

Stories evoke emotions in their hearers. Do they evoke emotions in their tellers as well? Tellers can tell stories from the inside as if they were characters in the world of the tale or they can tell stories from the outside as if they were perceiving the taleworld from elsewhere. From the outside, the teller can represent the emotion a character feels; from the inside, the teller can express the emotion the character feels. In either instance, tellers can be moved (...) by the story they tell. When they are, they can experience their emotions as a suffusion of sensation that springs forth in their bodies. The body’s experience of its sensation can appear in the gestures that accompany the telling. On the occasion presented here, the teller represents her emotion in metaphorical gestures that figure her body as the container of a fluid substance that threatens to overflow its boundaries. Her gestures disclose and elaborate this metaphoricity while at the same time disclosing and elaborating the sensations that motivate the metaphor. (shrink)

Gestures are usually regarded as a casual element of communication processes between logicians. By contrast, we aim to show that gestures have played a significant role in logic. We argue that the development of communication techniques and their standardization have led to the rise of formal notation systems commonly used in logic today. In order to substantiate this claim, the historical development of the use of gestures in (early) modern logic is investigated. This investigation uncovers exemplary communication and proof techniques (...) that illustrate the efficacy of gestures as representational media in formal logic. Revisiting the tradition of gestures in logic offers promising paths and insights for today’s logic as a communication practice in the digital age. (shrink)

Most language learners have difficulties acquiring the phonemes of a second language (L2). Unfortunately, they are often judged on their L2 pronunciation, and segmental inaccuracies contribute to miscommunication. Therefore, we aim to determine how to facilitate phoneme acquisition. Given the close relationship between speech and co-speech gesture, previous work unsurprisingly reports that gestures can benefit language acquisition, e.g., in (L2) word learning. However, gesture studies on L2 phoneme acquisition present contradictory results, implying that both specific properties of gestures (...) and phonemes used in training, and their combination, may be relevant. We investigated the effect of phoneme and gesture complexity on L2 phoneme acquisition. In a production study, Dutch natives received instruction on the pronunciation of two Spanish phonemes, /u/ and /θ/. Both are typically difficult to produce for Dutch natives because their orthographic representation differs between both languages. Moreover, /θ/ is considered more complex than /u/, since the Dutch phoneme inventory contains /u/ but not /θ/. The instruction participants received contained Spanish examples presented either via audio-only, audio-visually without gesture, audio-visually with a simple, pointing gesture, or audio-visually with a more complex, iconic gesture representing the relevant speech articulator(s). Preceding and following training, participants read aloud Spanish sentences containing the target phonemes. In a perception study, Spanish natives rated the target words from the production study on accentedness and comprehensibility. Our results show that combining gesture and speech in L2 phoneme training can lead to significant improvement in L2 phoneme production, but both gesture and phoneme complexity affect successful learning: Significant learning only occurred for the less complex phoneme /u/ after seeing the more complex iconic gesture, whereas for the more complex phoneme /θ/, seeing the more complex gesture actually hindered acquisition. The perception results confirm the production findings and show that items containing /θ/ produced after receiving training with a less complex pointing gesture are considered less foreign-accented and more easily comprehensible as compared to the same items after audio-only training. This shows that gesture can facilitate task performance in L2 phonology acquisition, yet complexity affects whether certain gestures work better for certain phonemes than others. (shrink)

In the recent years, gesture recognition based on the surface electromyography (sEMG) signals has been extensively studied. However, the accuracy and stability of gesture recognition through traditional machine learning algorithms are still insufficient to some actual application scenarios. To enhance this situation, this paper proposed a method combining feature selection and ensemble extreme learning machine (EELM) to improve the recognition performance based on sEMG signals. First, the input sEMG signals are preprocessed and 16 features are then extracted from (...) each channel. Next, features that mostly contribute to the gesture recognition are selected from the extracted features using the recursive feature elimination (RFE) algorithm. Then, several independent ELM base classifiers are established using the selected features. Finally, the recognition results are determined by integrating the results obtained by ELM base classifiers using the majority voting method. The Ninapro DB5 dataset containing 52 different hand movements captured from 10 able-bodied subjects was used to evaluate the performance of the proposed method. The results showed that the proposed method could perform the best (overall average accuracy 77.9%) compared with decision tree (DT), ELM, and random forest (RF) methods. (shrink)

As a speculative and abstract discipline, philosophy is traditionally considered to be in dialectical tension with physical experience and daily practice. In contrast to this conventional and idealistic perspective, and in line with aesthetics as embodied knowledge, this article attempts to show that not only do we constantly think via gestures, movements, and physical experiences but also that there is no need to disconnect a concept from practice. Passing from Wittgenstein’s idea of “form of life” to the pragmatist aesthetics initiated (...) by Dewey’s idea of “art as experience,” I propose an analysis of the philosophical framework of postmodern dance (Yvonne Rainer) and of Happenings (Allan Kaprow), in order to underline the theoretical and conceptual research that is already at work in the field of contemporary art practice, the latter being understood as a sensorial dimension intrinsically linked to ordinary life. My general argument is that gestures, which are an inescapable and vital part of everyday life, can be foregrounded by certain artistic practices without corrupting or theatricalizing their ordinariness. (shrink)

The article argues in favour of a pragmatist enactive interpretation of the emergence of the symbolic and contentful mind from a basic form of social communicative interaction in which basic cognitive capacities are involved. Through a critical overview of Radical Enactivists (RECers)’ view about language, the article focuses on Mead’s pragmatist behavioural theory of meaning that refers to the gestural conversation as the origin of the evolution of linguistic conversation. The article develops as follows. After exposing the main elements of (...) REC’s theory of cognition and language that involve the construction of a theory of natural signs (teleosemiotics) and basic directionality (Ur-intentionality), some critical points of Hutto and Myin’s proposal will be highlighted. To foster a continuist perspective of language, the behavioural theory of meaning and language that Mead develops from the notion of gesture will be analysed. His theory is akin to REC and could augment the bare bones of REC’s sketched perspective, helping to include Ur-intentionality in a broader non-dualistic phylogenetic and ontogenetic theory of symbolic language from gestural communication, thus helping to overcome the distinction between a content-less intentionality and a content-involving intentionality, i.e., a semantic propositional intentionality. Furthermore, a recent revival of Mead’s theory testifies to its up-to-date relevance to explain the innate social dimension of human and non-human animals, and the human communicative capacity through the conditioning of bio-social canons and structures. (shrink)

Social cognition researchers have become increasingly interested in the ways that behavioral, physiological, and neural coupling facilitate social interaction and interpersonal understanding. We distinguish two ways of conceptualizing the role of such coupling processes in social cognition: strong and moderate interactionism. According to strong interactionism (SI), low-level coupling processes are alternatives to higher-level individual cognitive processes; the former at least sometimes render the latter superfluous. Moderate interactionism (MI) on the other hand, is an integrative approach. Its guiding assumption is that (...) higher-level cognitive processes are likely to have been shaped by the need to coordinate, modulate, and extract information from low-level coupling processes. In this paper, we present a case study on Möbius Syndrome (MS) in order to contrast SI and MI. We show how MS—a form of congenital bilateral facial paralysis—can be a fruitful source of insight for research exploring the relation between high-level cognition and low-level coupling. Lacking a capacity for facial expression, individuals with MS are deprived of a primary channel for gestural coupling. According to SI, they lack an essential enabling feature for social interaction and interpersonal understanding more generally and thus ought to exhibit severe deficits in these areas. We challenge SI’s prediction and show how MS cases offer compelling reasons for instead adopting MI’s pluralistic model of social interaction and interpersonal understanding. We conclude that investigations of coupling processes within social interaction should inform rather than marginalize or eliminate investigation of higher-level individual cognition. (shrink)

How do teachers’ gestures influence students’ learning? This article reviews research investigating the role of gestures in communication, focusing on teachers’ communication with their students, primarily in mathematics and science instruction. We first briefly consider gesture's role in communication more generally as a backdrop for considering teaching as a special context for communication. We then describe teachers’ spontaneous gesturing in teaching contexts, and we consider how teachers’ spontaneous gestures might influence students’ learning. We then consider experimental studies that provide (...) causal support for the effects of teachers’ gestures on students’ learning. We conclude by discussing future directions and implications for educational practice. (shrink)

The article seeks a rapprochement between pragmatic and semantic theories of language by returning to a breaking point in the history of philosophy, the middle of the twentieth century, when these theoretical models began to evolve into distinct schools of thought. Philosophical accounts of this period explore various and intertwined dependencies between semantics and context; however, they only implicitly examine the potential of sounds and bodily gestures in bringing descriptive clarity to the modes and limits of such dependencies. The article (...) first investigates the way W. V. Quine conceptualized linguistic reference by combining behavioral models of language acquisition with more systematic explorations of syntax. It then turns to P. F. Strawson’s revisionary accounts of Kantian philosophy which reassess the silent strains of empiricism in Kant’s framework in order to identify possible grounds of reconciliation between pragmatic and semantic theories of language. Sound and gesture, two aspects that supplement language and give it an embodied feeling, are suggested as possible devices for formalizing intersections between context and semantic-oriented approaches. Poems by Wallace Stevens are used to think about the endurance of reference and how this endurance can find more compelling demonstration through an investigation of language as an embodied phenomenon. (shrink)

In spoken languages, children acquire locative terms in a cross‐linguistically stable order. Terms similar in meaning to in and on emerge earlier than those similar to front and behind, followed by left and right. This order has been attributed to the complexity of the relations expressed by different locative terms. An additional possibility is that children may be delayed in expressing certain spatial meanings partly due to difficulties in discovering the mappings between locative terms in speech and spatial relation they (...) express. We investigate cognitive and mapping difficulties in the domain of spatial language by comparing how children map spatial meanings onto speech versus visually motivated forms in co‐speech gesture across different spatial relations. Twenty‐four 8‐year‐old and 23 adult native Turkish‐speakers described four‐picture displays where the target picture depicted in‐on, front‐behind, or left‐right relations between objects. As the complexity of spatial relations increased, children were more likely to rely on gestures as opposed to speech to informatively express the spatial relation. Adults overwhelmingly relied on speech to informatively express the spatial relation, and this did not change across the complexity of spatial relations. Nevertheless, even when spatial expressions in both speech and co‐speech gesture were considered, children lagged behind adults when expressing the most complex left‐right relations. These findings suggest that cognitive development and mapping difficulties introduced by the modality of expressions interact in shaping the development of spatial language. (shrink)

Empirical studies of gesture in a subject who has lost proprioception and the sense of touch from the neck down show that specific aspects of gesture remain normal despite abnormal motor processes for instrumental movement. The experiments suggest that gesture, as a linguistic phenomenon, is not reducible to instrumental movement. They also support and extend claims made by Merleau-Ponty concerning the relationship between language and cognition. Gesture, as language, contributes to the accomplishment of thought.

In debates about the proper analysis of demonstrative expressions, ostensive gestures and speaker intentions are often seen as competing for primary importance in securing reference. Underlying some of these debates is the mistaken assumption that ostensive gestures always make the demonstrated object maximally salient to interlocutors. When we abandon this assumption and focus on an object’s mutually-recognized salience itself, rather than on how the object came to be salient, we can work towards a more promising analysis with a uniform treatment (...) of demonstrative reference whether or not there is an ostensive gesture, and whether reference is ordinary or deferred. (shrink)

This article examines the formal and functional features of a recurring ‘away’ gesture in Syuba (Tibeto-Burman, Nepal). The formal properties of this gesture include a pronation of the forearms to bring the palms downward while the fingers spread away, and is most often performed with both hands. Functionally, it is found with utterances that signal negation, particularly the absence of something. A growing body of literature links ‘away’ trajectories with negation, or negative evaluation of speech content cross-linguistically. The (...) temporal alignment between these gesture and lexical content also shows that cross-linguistic differences in word order appear to affect performance of gestures associated with negated content. (shrink)

The framework of depicting put forward byClark (2016)offers a schematic vantage point from which to examine iconic language use. Confronting the framework with empirical data, we consider some of its key theoretical notions. Crucially, by reconceptualizing the typology of depictions, we identify an overlooked domain in the literature: “speech-embedded nonverbal depictions,” namely cases where meaning is communicated iconically, nonverbally, and without simultaneously co-occurring speech. In addition to contextualizing the phenomenon in relation to existing research, we demonstrate, with examples from American (...) TV talk shows, how such depictions function in real-life language use, offering a brief sketch of their complexities and arguing also for their theoretical significance. (shrink)

Temporal perspectives allow us to place ourselves and temporal events on a timeline, making it easier to conceptualize time. This study investigates how we take different temporal perspectives in our temporal gestures. We asked participants (n = 36) to retell temporal scenarios written in the Moving‐Ego, Moving‐Time, and Time‐Reference‐Point perspectives in spontaneous and encouraged gesture conditions. Participants took temporal perspectives mostly in similar ways regardless of the gesture condition. Perspective comparisons showed that temporal gestures of our participants resonated (...) better with the Ego‐ (i.e., Moving‐Ego and Moving‐Time) versus Time‐Reference‐Point distinction instead of the classical Moving‐Ego versus Moving‐Time contrast. Specifically, participants mostly produced more Moving‐Ego and Time‐Reference‐Point gestures for the corresponding scenarios and speech; however, the Moving‐Time perspective was not adopted more than the others in any condition. Similarly, the Moving‐Time gestures did not favor an axis over the others, whereas Moving‐Ego gestures were mostly sagittal and Time‐Reference‐Point gestures were mostly lateral. These findings suggest that we incorporate temporal perspectives into our temporal gestures to a considerable extent; however, the classical Moving‐Ego and Moving‐Time classification may not hold for temporal gestures. (shrink)

Adults and children spontaneously produce gestures while they speak, and such gestures appear to support and expand on the information communicated by the verbal channel. Little research, however, has been carried out to examine the role played by gesture in the listener's representation of accumulating information. Do listeners attend to the gestures that accompany narrative speech? In what kinds of relationships between gesture and speech do listeners attend to the gestural channel? If listeners do attend to information received (...) in gesture, how is this information represented— is it 'tagged' as originating in the gestural channel? In this article research is described that addresses these questions. Results show that listeners do attend to information conveyed in gesture, when that information supplements or even contradicts the information conveyed by speech. And information received via gesture is available for retelling in speech. These results are taken to demonstrate that gesture is not taken by the listener to be epiphenomenal to the act of speaking, or a simple manual translation of speech. But they also suggest that the information conveyed in a discourse may be represented in a manner that is neither gesture nor language, although accessible to both channels. (shrink)

The article presents two gestures corresponding to two profound new understandings of Peirce's Continuum and Peirce's Existential Graphs. Vargas and Oostra have revolutionized Peirce's mathematical studies, thanks to a first complete model for Peirce's continuum provided by Vargas, and thanks to the emergence of intuitionistic existential graphs provided by Oostra. The article aims at showing how these careful mathematical constructions can be encrypted in very simple gestures.

Speakers perform manual gestures in the physical space nearest them, called gesture space. We used a controlled elicitation task to explore whether speakers use gesture space in a consistent way and whether they use space in a contrastive way when talking about abstract referents. Participants answered two questions designed to elicit contrastive, abstract discourse. We investigated manual gesture behavior. Gesture hand, location on the horizontal axis, and referent in corresponding speech were coded. We also coded contrast (...) in speech. Participants’ overall tendency to use the same hand = 13.12, p =.001, 95% CI [.31,.43], d = 2.53) and same location = 7.47, p =.001, 95% CI [.27,.47], d = 1.69) when referring to an entity was higher than expected frequency. When comparing pairs of gestures produced with contrastive speech to pairs of gestures produced with non-contrastive speech, we found a greater tendency to produce gestures with different hands for contrastive speech: = 4.19, p =.001, 95% CI [.27,.82], d = 1.42). We did not find associations between dominant side and positive concepts or between left, center, and right space and past, present, and future, respectively, as predicted by previous studies. Taken together, our findings suggest that speakers do produce spatially consistent and contrastive gestures for abstract as well as concrete referents. They may be using spatial resources to assist with abstract thinking, and/or to help interlocutors with reference tracking. Our findings also highlight the complexity of predicting gesture hand and location, which appears to be the outcome of many competing variables. (shrink)