Five experiments are reported that concern selective perception and representation following dichotic presentations of competing word pairs differing only in their initial consonants . Only one word from each pair tended to be subjectively perceived, even when participants were encouraged to guess two words. Robust selective perception effects were evidenced as a function of stimulus affective valence. Control tasks showed that these effects could not be attributed to report biases or to the acoustic properties of the stimuli. (...) The unreported words were not recognized on a two-alternative forced-choice task but were recognized with a more sensitive ranking task. Additional cognitive activity during the intertrial interval weakened memory only for the words reported as perceived. Moreover, negative affective valence decreased the recognition of words reported as consciously perceived but increased recognition of unreported words. The implications of these findings for theories of unconscious processing are discussed. (shrink)

Spoken word recognition involves a perceptual tradeoff between the reliance on the incoming acoustic signal and knowledge about likely sound categories and their co-occurrences as words. This study examined how adult second language (L2) learners navigate between acoustic-based and knowledge-based spoken word recognition when listening to highly variable, multi-talker truncated speech, and whether this perceptual tradeoff changes as L2 listeners gradually become more proficient in their L2 after multiple months of structured classroom learning. First language (L1) Mandarin Chinese (...) listeners and L1 English-L2 Mandarin adult listeners took part in a gating experiment. The L2 listeners were tested twice—once at the start of their intermediate/advanced L2 language class and again two months later. L1 listeners were only tested once. Participants were asked to identify syllable-tone words that varied in syllable token frequency (high/low according to a spoken word corpus) and syllable-conditioned tonal probability (most probable/least probable in speech given the syllable). The stimuli were recorded by 16 different talkers and presented at eight gates ranging from onset-only (gate 1) through onset+40 ms increments (gates 2 through 7) to the full word (gate 8). Mixed-effects regression modeling was used to compare performance to our previous study which used single-talker stimuli (Wiener, Lee, & Tao, 2019). The results indicated that multi-talker speech caused both L1 and L2 listeners to rely greater on knowledge-based processing of tone. L1 listeners were able to draw on distributional knowledge of syllable-tone probabilities in early gates and switch to predominantly acoustic-based processing when more of the signal was available. In contrast, L2 listeners, with their limited experience with talker range normalization, were less able to effectively transition from probability-based to acoustic-based processing. Moreover, for the L2 listeners, the reliance on such distributional information for spoken word recognition appeared to be conditioned by the nature of the acoustic signal. Single-talker speech did not result in the same pattern of probability-based tone processing, suggesting that knowledge-based processing of L2 speech may only occur under certain acoustic conditions, such as multi-talker speech. (shrink)

Human communication is multi-modal. It is an empirical fact that many of our acts of communication exploit a variety of means to make our communicative intentions recognisable. Scholars readily distinguish between verbal and non-verbal means of communication, and very often they deal with them separately. So it is that a great number of semanticists and pragmaticists give verbal communication preferential treatment. The non-verbal aspects of an act of communication are treated as if they were not underlain by communicative intentions. They (...) are “relegated” to mere aspects of the context. However, several schools of thoughts have a different take on the issue. Thus psychologists or semioticians of gesture have shown how intricately gestures and speech are related in utterances. And, in a different area of the theoretical landscape, so-called “Relevance Theorists” have made the same point. Thus, Robyn Carston writes that “the domain of pragmatics is a natural class of environmental phenomena, that of ostensive stimuli; verbal utterances are the central case, but not the only one, and they themselves are frequently accompanied by other ostensive gestures of the face, hands, voice etc, all of which have to be interpreted together if one is to correctly infer what is being communicated”. This position rests on the assumption that there is a single “pragmatic system” or module at work in the interpretation of “ostensive stimuli”. When it comes to interpreting verbal stimuli, the same mechanisms and resources are used as when it comes to processing non-verbal ones. If there is no distinct “linguistic pragmatic system”, then the scholar who studies communication should not favour the verbal at the expense of the non-verbal. In this paper, I want to make a contribution to the study of multi-modal messages by considering a type of utterances that mix the verbal with the non-verbal in such a way that a piece of non-linguistic communication seems to stand in for a linguistic constituent which remains unrealised. Here is a real-life example : I didn't see the [IMITATION OF FRIGHTENING GRUMPINESS] woman today; will she be back this week? The square-bracketed string in small capitals is meant to capture the facial expressions and gestures performed in the conversational setting. What is intriguing here is that this instance of ostensive mimicry does not come as a mere complement to some linguistic stimulus; it appears to take the place of that stimulus. I shall try to show that a linguistic analysis can indeed be offered for cases like – though, I believe, without succumbing to the pro-linguistic bias that Carston warns against. I will, however, argue against an ellipsis-based account : the structure of sentence does not contain an unrealised adjective phrase. Instead, I shall defend a ‘syntactic-recruitment' account. (shrink)

We performed three experiments to investigate whether adjectives can modulate the sensorimotor activation elicited by nouns. In Experiment 1, nouns of graspable objects were used as stimuli. Participants had to decide if each noun referred to a natural or artifact, by performing either a precision or a power reach‐to‐grasp movement. Response grasp could be compatible or incompatible with the grasp typically used to manipulate the objects to which the nouns referred. The results revealed faster reaction times (RTs) in compatible (...) than in incompatible trials. In Experiment 2, the nouns were combined with adjectives expressing either disadvantageous information about object graspability (e.g., sharp) or information about object color (e.g., reddish). No difference in RTs between compatible and incompatible conditions was found when disadvantageous adjectives were used. Conversely, a compatibility effect occurred when color adjectives were combined with nouns referring to natural objects. Finally, in Experiment 3 the nouns were combined with adjectives expressing tactile or shape proprieties of the objects (e.g., long or smooth). Results revealed faster RTs in compatible than in incompatible condition for both noun categories. Taken together, our findings suggest that adjectives can shape the sensorimotor activation elicited by nouns of graspable objects, highlighting that language simulation goes beyond the single‐word level. (shrink)

Do children’s single words related to motion and change also encode aspects of environmental events highlighted by Talmy’s motion event analysis? If so, these meanings may predict children’s early verb meanings. Analyzing the kinds of meanings expressed in single “dynamic event words” through motion event semantics yields links between early true verbs in sentences and the semantics encoded in these single words. Dynamic event words reflect the sense of temporal and spatial reversibility established in the late sensorimotor (...) period. We propose that these dynamic meanings provide the semantic foundation for the most common verbs included in early sentences, and thus a bootstrap to full development of the verb repertoire. In this study, we followed the spoken language development of five children. We identified dynamic event words as encoding dynamic change in the following dimensions: spatial direction in relation to self; vertical spatial direction; figure/ground relationships; and temporal event sequences. Verbs continuing the semantics previously identified in dynamic event words occurred early and dominated the verb repertoire through 24 months of age. (shrink)

Wilkins & Wakefield assign importance to motor systems but skip from anatomy to cognitive structure with little attention to behavior. Organisms, no matter how sophisticated, that do not behave in accord with what they know will fall by the evolutionary wayside. Facts about behavior can supplement the authors' theory, whose hierarchical structures can accommodate an evolutionary scenario in which a million years or more of functionally varied utterances mainly limited to single words is followed by an explosion of linguistic (...) diversity with the development in the last 50,000 years or so of syntactically organized multiple word utterances. (shrink)

Words sound slightly different each time they are said, both by the same talker and across talkers. Rather than hurting learning, lab studies suggest that talker variability helps infants learn similar sounding words. However, very little is known about how much variability infants hear within a single talker or across talkers in naturalistic input. Here, we quantified these types of talker variability for highly frequent words spoken to 44 infants, from naturalistic recordings sampled longitudinally over a year of life (...) (from 6 to 17 months). We used non‐contrastive acoustic measurements (e.g., mean pitch, duration, harmonics‐to‐noise ratio) and holistic measures of sound similarity (normalized acoustic distance) to quantify acoustic variability. We find three key results. First, pitch‐based variability was generally lower for infants' top talkers than across their other talkers, but overall acoustic distance is higher for tokens from the top talker versus the others. Second, the amount of acoustic variability infants heard could not be predicted from, and thus was not redundant with, other properties of the input such as the number of talkers or tokens, or proportion of speech from particular sources (e.g., women, children, electronics). Finally, we find that patterns of pitch‐based acoustic variability heard in naturalistic input were similar to those found with in‐lab stimuli that facilitated word learning. This large‐scale quantification of talker variability in infants' everyday input sets the stage for linking naturally occurring variability “in the wild” to early word learning. (shrink)

People prefer linguistic stimuli with an inward (e.g. BODIKA) over those with an outward articulation dynamic (e.g. KODIBA), a phenomenon known as the articulatory in-out effect. Despite its robustness across languages and contexts, the phenomenon is still poorly understood. To learn more about the effect’s boundary conditions, mental representation, and origin, we crossed the in-out effect with evaluative conditioning research. In five experiments (N = 713, three experiments pre-registered), we systematically paired words containing inward versus outward dynamics with pictures (...) of negative versus positive valence. Although this evaluative conditioning procedure reversed the preference for inward over outward words, this was the case only for words with the same consonant sequences as the conditioned words. For words with inward/outward dynamics but different consonant sequences than the conditioned ones, a regular in-out effect emerged. Also, no preference reversal at all emerged for the conditioned consonant sequences when the contingency between single consonants at specific positions and positive/negative valence was zero. Implications of these findings for the in-out effect and evaluative conditioning are discussed. (shrink)

Models of category learning have been extensively studied in cognitive science and primarily tested on perceptual abstractions or artificial stimuli. In this paper, we focus on categories acquired from natural language stimuli, that is, words. We present a Bayesian model that, unlike previous work, learns both categories and their features in a single process. We model category induction as two interrelated subproblems: the acquisition of features that discriminate among categories, and the grouping of concepts into categories based (...) on those features. Our model learns categories incrementally using particle filters, a sequential Monte Carlo method commonly used for approximate probabilistic inference that sequentially integrates newly observed data and can be viewed as a plausible mechanism for human learning. Experimental results show that our incremental learner obtains meaningful categories which yield a closer fit to behavioral data compared to related models while at the same time acquiring features which characterize the learned categories. (shrink)

It has been suggested that there is a close relationship between visual attention span (VAS) and fluent reading. This relation may be modulated by participants’ age, and exhibits various patterns in different reading modes (i.e. oral v.s. silent reading) and different reading levels (e.g. sentence v.s. character/word levels). Moreover, the modulation effects from the above factors might be more remarkable in the framework of languages with a deep orthography. Therefore, the present study investigated the developmental pattern of the relationship (...) between VAS skills and reading fluency in Chinese, a language with particularly deep orthography, by recruiting 292 participants from primary schools, middle schools and universities. Two tests were utilized to assess fluent reading skills at the single-character and sentence levels with oral and silent reading modes. A visual 1-back task was adopted to reflect VAS capacity with non-verbal stimuli and no verbal response. Results showed that the VAS capacity of low-grade primary school students could significantly account for the variance in single-character reading fluency in the oral mode and that it was a significant predictor of sentence reading fluency in the oral mode among high-grade primary school students. VAS abilities of middle school students allowed a unique and stable prediction of their silent sentence reading. With increasing reading ability, VAS skills of adults showed significant and similar predictive power for estimating the variations in fluent sentence reading in both silent and oral modes. These results revealed developmental changes in the contribution of VAS to fluent reading in Chinese, and provided evidence unveiling whether the underlying mechanisms of oral and silent reading were shared or different. (shrink)

Shepard has argued that a universal law should govern generalization across different domains of perception and cognition, as well as across organisms from different species or even different planets. Starting with some basic assumptions about natural kinds, he derived an exponential decay function as the form of the universal generalization gradient, which accords strikingly well with a wide range of empirical data. However, his original formulation applied only to the ideal case of generalization from a single encountered stimulus to (...) a single novel stimulus, and for stimuli that can be represented as points in a continuous metric psychological space. Here we recast Shepard's theory in a more general Bayesian framework and show how this naturally extends his approach to the more realistic situation of generalizing from multiple consequential stimuli with arbitrary representational structure. Our framework also subsumes a version of Tversky's set-theoretic model of similarity, which is conventionally thought of as the primary alternative to Shepard's continuous metric space model of similarity and generalization. This unification allows us not only to draw deep parallels between the set-theoretic and spatial approaches, but also to significantly advance the explanatory power of set-theoretic models. Key Words: additive clustering; Bayesian inference; categorization; concept learning; contrast model; features; generalization; psychological space; similarity. (shrink)

Primary and secondary processes are the foundational axes of the Freudian mental apparatus: one horizontally as a tendency to associate, the primary process, and one vertically as the ability for perspective taking, the secondary process. Primary process mentation is not only supposed to be dominant in the unconscious but also, for example, in dreams. The present study tests the hypothesis that the mental activity during REM-sleep has more characteristics of the primary process, while during non-REM-sleep more secondary process operations take (...) place. Because the solving of a rebus requires the ability to non-contexually condensate the literal reading of single stimuli into a new one, rebus solving is a primary process operation by excellence. In a replication of the dream-rebus study of Shevrin and Fisher (1967), a rebus, which consisted of an image of a comb (German: “Kamm”) and an image of a raft (German: “Floß”), resulting in the German rebus word “kampflos” (Engl.: without a struggle), was flashed subliminally (at 1 ms) to 20 participants before going to sleep. Upon consecutive awakenings participants were asked for a dream report, free associations and an image description. Based on objective association norms, there were significantly more conceptual associations referring to Kamm and Floß indexing secondary process mentation when subjects were awakened from non-REM sleep as compared to REM-awakenings. There were not significantly more rebus associations referring to kampflos indexing primary process mentation when awakened from REM-sleep as compared to non-REM awakenings. However, when the associations were scored on the basis of each subject’s individual norms, there was a rebus effect with more idiosyncratic rebus associations in awakenings after REM than after non-REM-sleep. Our results support the general idea that REM-sleep is characterized by primary process thinking, while non-REM-sleep mentation follows the rules of the secondary process. (shrink)

It has been suggested that damage to anterior regions of the left hemisphere results in a dissociation in the perception and lexical activation of past-tense forms. Specifically, in a lexical-decision task in which past-tense primes immediately precede present-tense targets, such patients demonstrate significant priming for irregular verbs (spoke–speak), but, unlike control participants, fail to do so for regular verbs (looked–look). Here, this behavioral dissociation was first confirmed in a group of eleven patients with damage to the pars opercularis (BA 44) (...) and pars triangularis (BA 45) of the left inferior frontal gyrus (i.e., Broca's area). Two conditions containing word-onset orthographic–phonological overlap (bead–bee, barge–bar) demonstrated that the disrupted regular-verb priming was accompanied by, and covaried with, disrupted ortho-phonological priming, regardless of whether prime stimuli contained the regular inflectional rhyme pattern. Further, the dissociation between impaired regular-verb and preserved irregular-verb priming was shown to be continuous rather than categorical; priming for weak-irregular verbs (spent–spend) was intermediate in size between that of regular verbs and strong verbs. Such continuous dissociations grounded in ortho-phonological relationships between present- and past-tense forms are predicted by single-system, connectionist approaches to inflectional morphology and not predicted by current dual-system, rule-based models. Event-related potential data demonstrated that N400 priming effects were intact for both regular and irregular verbs, suggesting that the absence of significant regular-verb priming in the response time data did not result from a disruption of lexical access, and may have stemmed instead from post-lexical events such as covert articulation, segmentation strategies, and/or cognitive control. (shrink)

Researchers typically use the “big five” traits as a standard way to describe personality. Evaluation of personality is generally conducted using self-report questionnaires that require participants to respond to a large number of test items. To minimize the burden on participants, this paper proposes an alternative method of estimating multidimensional personality traits from only a single word. We constructed a system that can convert a sound-symbolic word that intuitively expresses personality traits into information expressed by 50 personality-related (...) adjective pairs. This system can obtain information equivalent to the adjective scales using only a single word instead of asking many direct questions. To achieve this, we focused on SSWs in Japanese that have the association between linguistic sounds and meanings and express diverse and complex aspects of personality traits. We evaluated the prediction accuracy of the system and found that the multiple correlation coefficients for 48 personality-related adjective pairs exceeded 0.75, indicating that the model could explain more than half of the variations in the data. In addition, we conducted an evaluation experiment in which participants rated the appropriateness of the system output using a seven-point scale. The average score for 50 personality-related adjective pairs was 1.25. Thus, we believe that this system can contribute to the field of personality computing, particularly in terms of personality evaluation and communication. (shrink)

In two experiments, we examined the impact of color on cognitive performance by asking participants to categorize stimuli presented in three different colors: red, green, and gray (baseline). Participants were either asked to categorize the meaning of words as related to the concepts of “go” or “stop” (Experiment 1) or to indicate if a neutral verbal stimulus was a word or not (lexical decision task, Experiment 2). Overall, we observed performance facilitation in response to go stimuli presented (...) in green (vs. red or gray) and performance inhibition in response to go stimuli presented in red. The opposite pattern was observed for stop‐related stimuli. Importantly, results also indicated that color might also be used to categorize neutral stimuli. Overall, these findings provide support to the green‐go and red‐stop color associations and test the potential functional autonomy acquired by these colors and the boundary conditions to their effects on stimuli categorization. (shrink)

Computational models of infant word‐finding typically operate over transcriptions of infant‐directed speech corpora. It is now possible to test models of word segmentation on speech materials, rather than transcriptions of speech. We propose that such modeling efforts be conducted over the speech of the experimental stimuli used in studies measuring infants' capacity for learning from spoken sentences. Correspondence with infant outcomes in such experiments is an appropriate benchmark for models of infants. We demonstrate such an analysis by (...) applying the DP‐Parser model of Algayres and colleagues to auditory stimuli used in infant psycholinguistic experiments by Pelucchi and colleagues. The DP‐Parser model takes speech as input, and creates multiple overlapping embeddings from each utterance. Prospective words are identified as clusters of similar embedded segments. This allows segmentation of each utterance into possible words, using a dynamic programming method that maximizes the frequency of constituent segments. We show that DP‐Parse mimics American English learners' performance in extracting words from Italian sentences, favoring the segmentation of words with high syllabic transitional probability. This kind of computational analysis over actual stimuli from infant experiments may be helpful in tuning future models to match human performance. (shrink)

Conceptual generalisation occurs when conditional responses generalise to novel stimuli from the same category. Past research demonstrates that physiological fear responses generalise across categories, however, conceptual generalisation of stimulus valence evaluations during fear conditioning has not been examined. We investigated whether conceptual generalisation, as indexed by electrodermal responses and stimulus evaluations, would occur, and differ after training with single or multiple conditional stimuli (CSs). Stimuli from two of four categories (vegetables, farm animals, clothing, and office supplies) (...) were used as the CS+ (followed by an electric stimulus) or CS- (presented alone). Generalisation was assessed by presenting novel stimuli from the CS categories after acquisition, extinction, and reinstatement. One category exemplar was used as the CS+ and CS- in the single group, whereas three exemplars were used as the CS+ and CS- in the multiple group. Electrodermal responses generalised in acquisition and extinction but did not differ between groups. In the multiple group, CS evaluations generalised in acquisition and extinction, whereas generalisation was not evident in the single group. Training with multiple CSs also resulted in the extinction of stimulus valence. The current findings have implications for future research examining the generalisation of valence and for exposure-based treatments of anxiety. (shrink)