Music can be interpreted by attributing syntactic relationships to sequential musical events, and, computationally, such musical interpretation represents an analogous combinatorial task to syntactic processing in language. While this perspective has been primarily addressed in the domain of harmony, we focus here on rhythm in the Western tonal idiom, and we propose for the first time a framework for modeling the moment‐by‐moment execution of processing operations involved in the interpretation of music. Our approach is based on (...) (1) a music‐theoretically motivated grammar formalizing the competence of rhythmic interpretation in terms of three basic types of dependency (preparation, syncopation, and split; Rohrmeier, 2020), and (2) psychologically plausible predictions about the complexity of structural integration and memory storage operations, necessary for parsing hierarchical dependencies, derived from the dependency locality theory (Gibson, 2000). With a behavioral experiment, we exemplify an empirical implementation of the proposed theoretical framework. One hundred listeners were asked to reproduce the location of a visual flash presented while listening to three rhythmic excerpts, each exemplifying a different interpretation under the formal grammar. The hypothesized execution of syntactic‐processing operations was found to be a significant predictor of the observed displacement between the reported and the objective location of the flashes. Overall, this study presents a theoretical approach and a first empirical proof‐of‐concept for modeling the cognitive process resulting in such interpretation as a form of syntactic parsing with algorithmic similarities to its linguistic counterpart. Results from the present small‐scale experiment should not be read as a final test of the theory, but they are consistent with the theoretical predictions after controlling for several possible confounding factors and may form the basis for further large‐scale and ecological testing. (shrink)

This exploratory study assessed the use of functional Near Infrared Spectroscopy (fNIRS) to examine hemodynamic response patterns during sentence processing. Four groups of participants: monolingual English children, bilingual Chinese-English children, bilingual Chinese-English adults and monolingual English adults were given an agent selection syntactic processing task. Bilingual child participants were classified as simultaneous or sequential bilinguals to examine the impact of first language, age of second-language acquisition (AoL2A), and the length of second language experience on behavioral performance and (...) cortical activation. Participants were asked to select the agent of four types of sentences: subject-verb-object (SVO), passive (PAS), subject-extracted relative clause (SR), and object-extracted relative clause (OR) adopted from the “Whatdunit” task by Montgomery et al. (2016). Semantic cues were removed by using inanimate nouns for agents and patients, which constrained participants to make decisions based on syntactic knowledge. Behavioral results showed greater accuracy for canonical SVO and SR sentence types than for noncanonical OR and PAS sentence types, which aligns with prior studies. Neuroimaging results revealed greater hemodynamic responses to relative clauses (i.e., SR and OR sentences) than to simple sentences (SVO and PAS), especially for Chinese-English bilinguals suggesting first-language transfer influencing sentence processing in English. The effects AoL2A and the length of second language experience showed no significant differences between simultaneous and sequential bilinguals or between bilingual adults and children for identifying the correct agent in each sentence. However, neuroimaging results demonstrated greater hemodynamic responses in right dorsolateral prefrontal cortex (DLPFC) and left inferior parietal lobule (IPL) in simultaneous bilinguals compared to sequential bilinguals and greater hemodynamic responses in left and right DLPFC and left IPL among bilingual adults. Different behavioral and neural hemodynamic response patterns afford new insights into the effects of syntactic knowledge on sentence processing. (shrink)

Both autonomy and local specificity are compatible with observed interconnectivity at the cell level when considering two different levels: cell assemblies and brain systems. Early syntactic structuring processes in particular are likely to representan autonomous module in the language/brain system.

Although several theories of online syntactic processing assume the parallel activation of multiple syntactic representations, evidence supporting simultaneous activation has been inconclusive. Here, the continuous and non‐ballistic properties of computer mouse movements are exploited, by recording their streaming x, y coordinates to procure evidence regarding parallel versus serial processing. Participants heard structurally ambiguous sentences while viewing scenes with properties either supporting or not supporting the difficult modifier interpretation. The curvatures of the elicited trajectories revealed both an (...) effect of visual context and graded competition between simultaneously active syntactic representations. The results are discussed in the context of 3 major groups of theories within the domain of sentence processing. (shrink)

Scalp-recorded event-related potential (ERP) measures of reading and listening have been proved more sensitive to the time course of syntactic processing than the chronometric and behavioral data described by Caplan & Waters. ERP studies using sentences containing relative clauses indicate that there are individual differences in syntactic processing that appear at the earliest theoretically relevant time points and are attributable to working memory operations.

This commentary discusses the relation between Grodzinsky's target article and Friederici's (1995) model of syntactic processing. The two models can be made more compatible if it is assumed that people with Broca's aphasia have a problem in trace construction rather than trace deletion, and that the process of trace construction takes place during the second early syntactic substage of Friederici's model.

People use language to communicate their perceptions and conceptions of the world, and underlying this communication is the linguistic system that interacts with the human perceptual and conceptual machinery. This is supported by research on sentence comprehension among adults. This chapter examines theories of sentence processing in children and adults. It comments on a study John Trueswell et al. in which they demonstrated that five-year-old children appeared to be unable to use contextual cues to resolve ambiguity in sentences such (...) as “Put the frog on the napkin into the box.” Trueswell et al. explained this finding by arguing that children have limited working memory capacity that prevents them from using information from the context to disambiguate linguistic input. The chapter first discusses real-time sentence processing in adults before presenting a developmental account of sentence comprehension. It then considers the so-called Kindergarten-path Effect along with referential scenes, definite reference, and restrictive modifiers. It also looks at the effects of discourse and pragmatics on parsing by children and concludes with a discussion of the development of attention in children. (shrink)

We investigated cross-language influences from the first and second languages in third language processing, to examine how order of acquisition and proficiency modulate the degree of cross-language influences, and whether these cross-language influences manifest differently in online and offline measures of L3 processing. The study focused on morpho-syntactic processing of English as an L3 among Arabic-Hebrew-English university student trilinguals. Importantly, both L1 and L2 of participants are typologically distant from L3, which allows overcoming confounds of previous (...) research. Performance of trilinguals was compared to that of native English monolingual controls. To investigate the source of cross-language influences, critical stimuli were ungrammatical sentences in English, which when translated could be grammatical in L1, in L2 or in both. Thus, the L3 morpho-syntactic structures included in the study were a mismatch with L1, a mismatch with L2, a Double mismatch, with both L1 and L2, or a no mismatch condition. Participants read the English sentences while their eye-movements were recorded, and they also performed grammaticality judgments following each sentence. Across both measures, cross-language influences were assessed by comparing the performance of the trilinguals in each of the critical interference conditions to the no-interference condition, and by comparing their performance to that of the monolingual controls. L1 interference was evident in first pass sentence reading, and marginally in offline grammaticality judgment, and L2 interference was robust across second pass reading and grammaticality judgments. These results suggest that either L1 or the L2 can be the source of cross-language influences in L3 processing, but with different time-courses. The findings highlight the difference between online and offline measures of performance: processing language in real-time reflects mainly automatic activation of morpho-syntactic structures, whereas offline judgments might also involve strategic and meta-linguistic decision making. Together, the findings show that during L3 processing, trilinguals have access to all previously acquired linguistic knowledge, and that the multilingual language system is fully interactive. (shrink)

Previous research has demonstrated the influence of emotions during linguistic processing, indicating the interactivity of both processes in the brain. However, little is known regarding such interplay in a second language (L2). This study addressed this question by examining the reading effects of syntactic violations while processing L2 emotional and neutral statements. Forty-six Spanish-English bilinguals with various levels of L2 proficiency and emotional resonance (i.e. capability for emotional experience in L2) were presented with a self-paced sentence reading (...) task. Sentences contained positive (16), neutral (16) and negative (16) verbs, half of them presented in agreement and half in disagreement with the preceding pronoun. Analysis of verb reading times using linear mixed effects modelling revealed a significant interaction between syntactic violation, verb valence and emotional resonance, suggesting that stronger emotional L2 experience results in a higher saliency of negative verbs, reducing the impact of syntactic violations. (shrink)

This study addressed the question of whether L2 learners are able to utilize verb’s argument structure information in online structural analysis. Previous L2 research has shown that L2 learners have difficulty in using verb’s intransitive information to guide online syntactic processing. This is true even though L2 learners have grammatical knowledge that is correct and similar to that of native speakers. In the present study, we contrasted three hypotheses, the initial inaccessibility account, the intransitivity overriding account, and the (...) fuzzy subcategorization frame account, to investigate whether L2 learner’s knowledge of intransitive verbs is in fact ignored in L2 online structural analysis. The initial inaccessibility account and the fuzzy subcategorization frame account predicted that L2 learners cannot access intransitivity information in building syntactic structures in any situation. The intransitivity overriding account predicted that intransitivity information is accessed in L2 parsing, but this process is overridden by the strong transitivity preference when a verb is followed by a noun phrase. Importantly, the intransitivity overriding account specifically predicted that L2 learners would be able to use intransitive information in online syntactic processing when a noun phrase does not appear immediately following a verb. We tested the three accounts in an eye-tracking reading experiment using filler-gap dependency structures. We manipulated verb’s transitivity information and lexically based plausibility information and tested English native speakers as a control L1 group and Japanese-English L2 participants. The results showed that L2 learners as well as native speakers processed sentences differently depending on the subcategorization information of the verb, and adopted transitive analysis only when the verb was optionally transitive, providing support for the intransitivity overriding. The results further demonstrated that L2 learners had strong expectations for the transitive structure, which is consistent with the view proposed by the hyper-active gap-filling hypothesis. In addition, the results showed that the semantic mismatch in the incorrect transitive analysis facilitated native speaker’s processing but caused difficulty for L2 learners. Together, the current study provides evidence that L2 learners use intransitive information of the verbs to guide their structural analysis when there are no overriding constraints. (shrink)

We explore the interaction between oculomotor control and language comprehension on the sentence level using two well-tested computational accounts of parsing difficulty. Previous work (Boston, Hale, Vasishth, & Kliegl, 2011) has shown that surprisal (Hale, 2001; Levy, 2008) and cue-based memory retrieval (Lewis & Vasishth, 2005) are significant and complementary predictors of reading time in an eyetracking corpus. It remains an open question how the sentence processor interacts with oculomotor control. Using a simple linking hypothesis proposed in Reichle, Warren, and (...) McConnell (2009), we integrated both measures with the eye movement model EMMA (Salvucci, 2001) inside the cognitive architecture ACT-R (Anderson et al., 2004). We built a reading model that could initiate short “Time Out regressions” (Mitchell, Shen, Green, & Hodgson, 2008) that compensate for slow postlexical processing. This simple interaction enabled the model to predict the re-reading of words based on parsing difficulty. The model was evaluated in different configurations on the prediction of frequency effects on the Potsdam Sentence Corpus. The extension of EMMA with postlexical processing improved its predictions and reproduced re-reading rates and durations with a reasonable fit to the data. This demonstration, based on simple and independently motivated assumptions, serves as a foundational step toward a precise investigation of the interaction between high-level language processing and eye movement control. (shrink)

Despite differences in their function and domain-specific elements, syntactic processing in music and language is believed to share cognitive resources. This study aims to investigate whether the simultaneous processing of language and music share the use of a common syntactic processor or more general attentional resources. To investigate this matter we tested musicians and non-musicians using visually presented sentences and aurally presented melodies containing syntactic local and long-distance dependencies. Accuracy rates and reaction times of participants’ (...) responses were collected. In both sentences and melodies, unexpected syntactic anomalies were introduced. This is the first study to address the processing of local and long-distance dependencies in language and music combined while reducing the effect of sensory memory. Participants were instructed to focus on language (language session), music (music session), or both (dual session). In the language session, musicians and non-musicians performed comparably in terms of accuracy rates and reaction times. As expected, groups’ differences appeared in the music session, with musicians being more accurate in their responses than non-musicians and only the latter showing an interaction between the accuracy rates for music and language syntax. In the dual session musicians were overall more accurate than non-musicians. However, both groups showed comparable behavior, by displaying an interaction between the accuracy rates for language and music syntax responses. In our study, accuracy rates seem to better capture the interaction between language and music syntax; and this interaction seems to indicate the use of distinct, however, interacting mechanisms as part of decision making strategy. This interaction seems to be subject of an increase of attentional load and domain proficiency. Our study contributes to the long-lasting debate about the commonalities between language and music by providing evidence for their interaction at a more domain-general level. (shrink)

In the 1950s, Noam Chomsky offered a new vision for linguistic research and syntacticians. This chapter explores some ways in which Chomsky's linguistic work has influenced research on one domain of linguistic performance, sentence processing, over the last half century. It shows that Chomsky's claim in Aspects of the Theory of Syntax is largely borne out: "the study of performance will proceed only as far as the study of the underlying competence permits". The chapter briefly addresses a question about (...) the scope of modern sentence processing research and its relationship to specific grammatical formalisms. It reviews the literature on incremental ambiguity resolution, moves to the processing of long‐distance filler‐gap dependency processing, and provides information on the processing of anaphoric relations. In order to illustrate how the phenomenon has contributed to psycholinguistic theorizing, the chapter outlines a well‐known model and then considers how other models diverge. (shrink)

Learning a second language (L2) proceeds with individual approaches to proficiency in the language. Individual differences including sex, as well as working memory (WM) function appear to have strong effects on behavioral performance and cortical responses in L2 processing. Thus, by considering sex and WM capacity, we examined neural responses during L2 sentence processing as a function of L2 proficiency in young adolescents. In behavioral tests, girls significantly outperformed boys in L2 tests assessing proficiency and grammatical knowledge, and (...) in a reading span test (RST) assessing WM capacity. Girls, but not boys, showed significant correlations between L2 tests and RST scores. Using functional near-infrared spectroscopy (fNIRS) and event-related potential (ERP) simultaneously, we measured cortical responses while participants listened to syntactically correct and incorrect sentences. ERP data revealed a grammaticality effect only in boys in the early time window (100–300 ms), implicated in phrase structure processing. In fNIRS data, while boys had significantly increased activation in the left prefrontal region implicated in syntactic processing, girls had increased activation in the posterior language-related region involved in phonology, semantics, and sentence processing with proficiency. Presumably, boys implicitly focused on rule-based syntactic processing, whereas girls made full use of linguistic knowledge and WM function. The present results provide important fundamental data for learning and teaching in L2 education. (shrink)

Syntactic complexity effects have been investigated extensively with respect to comprehension . According to one prominent class of accounts , certain structures cause comprehension difficulty due to their scarcity in the language. But why are some structures less frequent than others? In two elicited-production experiments we investigated syntactic complexity effects in relative clauses and wh-questions varying in whether or not they contained non-local dependencies. In both experiments, we found reliable durational differences between subject-extracted structures and object-extracted structures : (...) Participants took longer to begin and produce object-extractions. Furthermore, participants were more likely to be disfluent in the object-extracted constructions. These results suggest that there is a cost associated with planning and uttering the more syntactically complex, object-extracted structures, and that this cost manifests in the form of longer durations and disfluencies. Although the precise nature of this cost remains to be determined, these effects provide one plausible explanation for the relative rarity of object-extractions: They are more costly to produce. (shrink)

There has been much interest in the possibility of connectionist models whose representations can be endowed with compositional structure, and a variety of such models have been proposed. These models typically use distributed representations that arise from the functional composition of constituent parts. Functional composition and decomposition alone, however, yield only an implementation of classical symbolic theories. This paper explores the possibility of moving beyond implementation by exploiting holistic structure-sensitive operations on distributed representations. An experiment is performed using Pollack’s Recursive (...) Auto-Associative Memory. RAAM is used to construct distributed representations of syntactically structured sentences. A feed-forward network is then trained to operate directly on these representations, modeling syn- tactic transformations of the represented sentences. Successful training and generalization is obtained, demonstrating that the implicit structure present in these representations can be used for a kind of structure-sensitive processing unique to the connectionist domain. (shrink)

In the present study, using event-related functional magnetic resonance imaging, we investigated a group of participants on a grammaticality classification task after they had been exposed to well-formed consonant strings generated from an artificial regular grammar. We used an implicit acquisition paradigm in which the participants were exposed to positive examples. The objective of this studywas to investigate whether brain regions related to language processing overlap with the brain regions activated by the grammaticality classification task used in the present (...) study. Recent meta-analyses of functional neuroimaging studies indicate that syntactic processing is related to the left inferior frontal gyrus (Brodmann's areas 44 and 45) or Broca's region. In the present study, we observed that artificial grammaticality violations activated Broca's region in all participants. This observation lends some support to the suggestions that artificial grammar learning represents a model for investigating aspects of language learning in infants [TICS 4 (2000) 178] and adults [Proceedings of the National Academy of Sciences of United States of America 99 (2002) 529]. (shrink)

Suppose that one adopts a broadly Chomskyan perspective, in which there is a distinction between the language faculty and other cognitive faculties, including what Chomsky has recently called the “Conceptual-Intensional system”. Then there must in principle be at least three stages in this association that need to be understood. First, there is the nonlinguistic stage of conceptualizing a particular event.1 For example, while all of the participants in an event may be affected by the event in some way or another, (...) human cognizers typically focus on one or the other of those changes as being particularly salient or relevant to their interests. This participant is taken to be the “theme” or “patient” of the event, perhaps in some kind of nonlinguistic conceptual representation, such as the one developed by Jackendoff (1983, 1990b). Second, this conceptual/thematic representation is associated with a linguistic representation in which the entity seen as the patient of the event is represented as (say) an NP that is the direct object of the verb that expresses what kind of an event it was. This is the interface between language and the conceptual system. Finally, there is the possibility of adjusting this representation internally to the language system, by way of movements, chain formations, Case assignment processes, or whatever other purely syntactic processes there may be. For example, the NP that represents the theme and starts out as the direct object of the verb may become the subject if there is no other subject in the linguistic representation, either because there was no agent in the conceptual representation (as with an unaccusative verb), or because it was suppressed (as with a passive verb). (shrink)

This book investigates the architecture of the language faculty by considering what the properties of language reveal about the mental abilities and processes involved in language acquisition. The language faculty, the author argues, must be able not only to accommodate what is general, exceptionless, and universal in language, but must also be capable of dealing with what is irregular, exceptional, and idiosyncratic. In Syntactic Nuts Peter Culicover shows that this is true not only of the lexicon, but for syntax. (...) Marginal and exceptional cases, where there is no straightforward form-meaning correspondence, are dealt with by the language faculty easily and precisely as the general cases. In considering how and why this should be the author argues against the prevailing trend in generative grammar, which takes the learner as either incorporating maximally global generalisations as part of its innate capacity for language, or projecting global generalisations from a very limited input on the basis of innate mechanisms. He suggests that the learning mechanism does not generalize significantly beyond the evidence presented to it, and further that it seeks to form generalizations based on all and only the evidence presented to it. Syntactic Nuts makes a fundamental contribution to generative grammar and syntactic theory. It situates syntactic theory within cognitive science in a novel way. It contributes to an alternative, and yet in many ways traditional, perspective on the manner in which knowledge is represented and processed in the mind. (shrink)