A fundamental question in reading research concerns whether attention is allocated strictly serially, supporting lexical processing of one word at a time, or in parallel, supporting concurrent lexical processing of two or more words (Reichle, Liversedge, Pollatsek, & Rayner, 2009). The origins of this debate are reviewed. We then report three simulations to address this question using artificial reading agents (Liu & Reichle, 2010; Reichle & Laurent, 2006) that learn to dynamically allocate attention to 1–4 words to “read” as efficiently (...) as possible. These simulation results indicate that the agents strongly preferred serial word processing, although they occasionally attended to more than one word concurrently. The reason for this preference is discussed, along with implications for the debate about how humans allocate attention during reading. (shrink)

Sequential action makes up the bulk of human daily activity, and yet much remains unknown about how people learn such actions. In one motor learning paradigm, the serial reaction time (SRT) task, people are taught a consistent sequence of button presses by cueing them with the next target response. However, the SRT task only records keypress response times to a cued target, and thus it cannot reveal the full time‐course of motion, including predictive movements. This paper describes a mouse (...) movement trajectory SRT task in which the cursor must be moved to a cued location. We replicated keypress SRT results, but also found that predictive movement—before the next cue appears—increased during the experiment. Moreover, trajectory analyses revealed that people developed a centering strategy under uncertainty. In a second experiment, we made prediction explicit, no longer cueing targets. Thus, participants had to explore the response alternatives and learn via reinforcement, receiving rewards and penalties for correct and incorrect actions, respectively. Participants were not told whether the sequence of stimuli was deterministic, nor if it would repeat, nor how long it was. Given the difficulty of the task, it is unsurprising that some learners performed poorly. However, many learners performed remarkably well, and some acquired the full 10‐item sequence within 10 repetitions. Comparing the high‐ and low‐performers’ detailed results in this reinforcement learning (RL) task with the first experiment's cued trajectory SRT task, we found similarities between the two tasks, suggesting that the effects in Experiment 1 are due to predictive, rather than reactive processes. Finally, we found that two standard model‐free reinforcement learning models fit the high‐performing participants, while the four low‐performing participants provide better fit with a simple negative recency bias model. (shrink)

Sequential action makes up the bulk of human daily activity, and yet much remains unknown about how people learn such actions. In one motor learning paradigm, the serial reaction time (SRT) task, people are taught a consistent sequence of button presses by cueing them with the next target response. However, the SRT task only records keypress response times to a cued target, and thus it cannot reveal the full time‐course of motion, including predictive movements. This paper describes a mouse (...) movement trajectory SRT task in which the cursor must be moved to a cued location. We replicated keypress SRT results, but also found that predictive movement—before the next cue appears—increased during the experiment. Moreover, trajectory analyses revealed that people developed a centering strategy under uncertainty. In a second experiment, we made prediction explicit, no longer cueing targets. Thus, participants had to explore the response alternatives and learn via reinforcement, receiving rewards and penalties for correct and incorrect actions, respectively. Participants were not told whether the sequence of stimuli was deterministic, nor if it would repeat, nor how long it was. Given the difficulty of the task, it is unsurprising that some learners performed poorly. However, many learners performed remarkably well, and some acquired the full 10‐item sequence within 10 repetitions. Comparing the high‐ and low‐performers’ detailed results in this reinforcement learning (RL) task with the first experiment's cued trajectory SRT task, we found similarities between the two tasks, suggesting that the effects in Experiment 1 are due to predictive, rather than reactive processes. Finally, we found that two standard model‐free reinforcement learning models fit the high‐performing participants, while the four low‐performing participants provide better fit with a simple negative recency bias model. (shrink)

While the effects of pattern learning on language processing are well known, the way in which pattern learning shapes exploratory behavior has long gone unnoticed. We report on the way in which individual differences in statistical pattern learning affect performance in the domain of language along multiple dimensions. Analyzing data from healthy monolingual adults' performance on a serial reaction time task and a self‐paced reading task, we show how individual differences in statistical pattern learning are reflected in readers' knowledge (...) of linguistic co‐occurrence patterns and in their exploration and exploitation of content‐specific and task‐general information. First, we investigated the extent to which an individual's pattern learning correlates with his or her sensitivity to systematic morphological and syntactic co‐occurrences, as evidenced while reading authentic sentences. We found that the stream of morphological and syntactic information has a more pronounced effect on the reading speed of, as we will label them, content‐sensitive learners in that the more probable the co‐occurrence pattern, the faster their reading of that pattern will be. Next, we investigated how differences in pattern learning are reflected in the ways in which individuals approach the reading task itself and adapt to it. Casting this relation in terms of exploration/exploitation strategies, known from Reinforcement Learning, we conclude that content‐sensitive learners are also more likely to initially probe (explore) a wider range of directly relevant patterns, which they can later use (exploit) to optimize their reading performance further. By affecting exploratory behavior, pattern learning influences the information that is gathered and becomes available for exploitation, thereby increasing the effect pattern learning has on language cognition. (shrink)

Counterproductive work behavior is one of the most common behavioral decisions of employees in the workplace that negatively impacts the sustainable development of enterprises. Previous studies have shown that individuals make CWB decisions for different reasons. Some individuals engage in CWB due to cognitive factors, whereas others engage in CWB in response to leadership behaviors. The conservation of resources theory holds that individuals have the tendency to preserve, protect and acquire resources. When experiencing the loss of resources, individuals will show (...) irrational and aggressive behaviors in order to regain resources. When obtaining resources, individuals’ tension and pressure will be relieved. To maintain or continue obtaining resources, individuals will show more positive work attitudes and behaviors. Therefore, using the COR theory as the main theoretical framework, this study explores a serial mediation model between family supportive leadership and CWB through work-family conflict and moral disengagement, moderated by personal life attribution. A three-wave survey of 251 medical workers from three hospitals found that family supportive leadership can reduce employees’ perceived work-family conflict, which leads to less moral disengagement, resulting in lower CWB. Personal life attribution strengthens the negative indirect effect of family supportive leadership on CWB by reinforcing the negative association between family supportive leadership and work-family conflict. This study uses the COR theory to explore the mechanism and boundary conditions of family supportive leadership and CWB from the perspective of negative work-family relationship, which enrichis the research content of existing theories. Moreover, this study has important guiding significance for managers to take effective measures to reduce CWB. (shrink)

We have previously shown that several brain areas are activated both during sequence learning at wake and during subsequent rapid-eye-movements (REM) sleep (Nat. Neurosci. 3 (2000) 831– 836), suggesting that REM sleep participates in the reprocessing of recent memory traces in humans. However, the nature of the reprocessed information remains open. Here, we show that regional cerebral reactivation during posttraining REM sleep is not merely related to the acquisition of basic visuomotor skills during prior practice of the serial reaction (...) time task, but rather to the implicit acquisition of the probabilistic rules that defined stimulus sequences. Moreover, functional connections between the reactivated cuneus and the striatum—the latter being critical for implicit sequence learning—are reinforced during REM sleep after practice on a probabilistic rather than on a random sequence of stimuli. Our results therefore support the hypothesis that REM sleep is deeply involved in the reprocessing and optimization of the high-order information contained in the material to be learned. In addition, we show that the level of acquisition of probabilistic rules attained prior to sleep is correlated to the increase in regional cerebral blood flow during subsequent REM sleep. This suggests that posttraining cerebral reactivation is modulated by the strength of the memory traces developed during the learning episode. Our data provide the first experimental evidence for a link between behavioral performance and cerebral reactivation during REM sleep. © 2003 Elsevier Inc. All rights reserved. (shrink)

Universities increasingly play an important role in entrepreneurship, which has contributed to gender equality in the business world. The aim of this study is to establish a causal model of entrepreneurial intentions and explore it by gender, based on the dimensions of the Theory of Planned Behavior, and how these are mediated by the individuals’ resilience and psychological well-being. The previous work experience was considered as one of the control variables, in order to analyze whether this influence the entrepreneurial intention. (...) With a convenience sample of 644 Portuguese students, Structural Equation Modeling was used. For a better understanding, multivariate analyses were performed and each one was individually reported, and for appropriate comparisons by gender, the t-student test was used. The comparison of means, between genders, showed that there are differences only between perceived behavioral control, subjective norm, and entrepreneurial intention, with women scoring the highest values, and psychological well-being, with men scoring the higher. A serial mediation path was performed, and psychological resilience was found to mediate a significant effect between perceived behavioral control and intention in females, but not in males. It also mediates a significant effect between attitude and intention in females, but not in males. These results show that attitude is a determining factor for females to become entrepreneurs. Finally, after discussing the results, theoretical and practical contributions are analyzed, with regard to the field of entrepreneurship in Portugal, and alternatives are pointed out for a more entrepreneurial future, reinforcing the role of higher education institutions. (shrink)

The aim of the inquiry is to interpret the Yijing consistently in terms of time and creativity. In the course of analysis of cosmology, changes and constancy, the self and community in the Yijing, this inquiry suggests that time and creativity play a significant role to understand the whole text. ;In the Yijing, change and time are the ultimate facts of the world. As there is no external agency, every being is in the middle of self-realizing process. It is an (...) one-world view in the sense that myriad things generate and produce in the same field. They are unique and self-determining in that they have freedom to make a decision to construct themselves in their own way. ;There are various kinds of term for change and constancy in the Yijing. While bian tends to be employed as discontinuous breakthrough from one to another, tong refers to continuity. The compound biantong, a dynamic concept of concord of the opposites, seems to signify effective change under the changing environment and "to hit the mark timely." ;Constancy in the Yijing is full blossom of realization and unbounded movement of dao. ;In the Yijing, instead of defining general quality of human being, human being is characterized as temporally self-creative. Image and word play a reinforcing role in the creative process of person-making. Images and words point out the experience of perceiver to orient oneself to the goal of maximizing one's potency. This process suggests a magnifying process of the person. ;Time and creativity play a primary role in making many kinds of interpersonal relationships. Interweaving interpersonal relationship is serial and continuous. At the same time, relationships are discontinuous in that they do not repeat and duplicate what the initiators achieved. The process formulates seamless network of persons. (shrink)

Emergentism is an important and yet underexplored component of John Dewey’s metaphysical program, and concerns the ways in which existences relate, operate, and grow in coordination with a more inclusive environment. Through an emergent account, Dewey addresses continuities among the generic traits of nature, inanimate substance, biological life, and experiential “fields” such as mind and consciousness. The notion of a field is especially important for depicting the ways in which existences serially interact in accordance with some particular purpose or set (...) of functions. Apart from an emergent scheme that contextualizes the interactive contexts of experience, phenomena such as “mind” and “consciousness” remain enigmatic occurrences. Moreover, cognition, and with it instances of “knowing,” remain susceptible to merely “subjective” characterizations that reinforce a misleading dualism between mind and nature. In addition to its role in addressing naturalistic continuities, Dewey’s emergentism suggests a non-reductive philosophical methodology that directly challenges contemporary varieties of realism and materialism. (shrink)

The main goals of this study were, to test the motivational determinants of athletes perceived effort in football considering the four-stage motivational sequence at the contextual level proposed by Hierarchical Model of Intrinsic and Extrinsic Motivation: task-involving, basic psychological needs, self-determined motivation and perceived effort. The multi-group analysis across different age-groups (U15, U17, U19, U21 years) and mediation role of basic psychological needs and self-determined motivation on the task-involving climate and the perceived effort were also analysed. Two independent samples of (...) male football athletes (N= 403, N= 403), aged 13-20 were enrolled in this study. The results demonstrated that structural model provided a good fit to data for all samples under analysis, and was invariant across U17, U19, and U21. However, it was not invariant across U15 and U17, U19 and U21. Additionally, in the results from the mediation analysis, there were significant indirect effects in all samples, supporting theoretical by self-determination theory assumptions, reinforcing the importance of basic psychological needs satisfaction and behavioral regulation in the relation in analysis. The results allow concluding that when coaches promote a task-involving climate, the basic psychological needs satisfaction of athletes improves. This climate will facilitate the regulation of their behaviors towards more autonomous forms of motivation, with positive results in the perceived effort of the athletes. (shrink)

To better understand the work of pre-Darwinian British life researchers in their own right, this paper discusses two different styles of reasoning. On the one hand there was analysis:synthesis, where an organism was disintegrated into its constituent parts and then reintegrated into a whole; on the other hand there was palaetiology, the historicist depiction of the progressive specialization of an organism. This paper shows how each style allowed for development, but showed it as moving in opposite directions. In analysis:synthesis, development (...) proceeded centripetally, through the fusion of parts. In palaetiology, development moved centrifugally, through the ramifying specialization of an initially simple substance. I first examine a community of analytically oriented British life researchers, exemplified by Richard Owen, and certain technical questions they considered important. These involved the neurosciences, embryology, and reproduction and regeneration. The paper then looks at a new generation of British palaetiologists, exemplified by W.B. Carpenter and T.H. Huxley, who succeeded at portraying analysts' questions as irrelevant. The link between styles of reasoning and physical sites is also explored. Analysts favored museums, which facilitated the examination and display of unchanging marine organisms while providing a power base for analysts. I suggest that palaetiologists were helped by vivaria, which included marine aquaria and Wardian cases. As they became popular in the early 1850s, vivaria provided palaetiologists with a different kind of living and changing evidence. Forms of evidence, how they were preserved and examined, and career options all reinforced each other: social and epistemic factors thus merged. (shrink)

Only very few studies exist so far concerning the development of fibre-reinforced plastics. These materials have come into the focus of attention in recent years because of their applications in aircraft design. In Germany their foundations were laid in the interwar period with the emergence of new plastics in macromolecular chemistry and the development of pressed materials. Guided by economic interests, the producers of pressed materials, such as Dynamit AG, promoted the production of FRP in aircraft construction, at first officially, (...) and during the Second World War behind closed doors under the supervision of the German Air Ministry. However, due to a lack of resources the progress achieved in this field could not be implemented before the end of the war due to a lack of resources. The prominence of metallic materials in military aviation research was another impediment. Because of restrictions imposed by the Allies, the first FRP were used in gliders by students after World War II. Carbon fibre-reinforced plastic, currently the best known fibre-reinforced plastic, was first applied serially in Germany in 1974 in the fighter “Alpha Jet” of the aircraft manufacturer Dornier, financed by the Federal Ministry of Defence. The article analyses these developments, thereby highlighting the continuities before and after 1945. (shrink)

Can humans get arbitrarily capable reinforcement learning agents to do their bidding? Or will sufficiently capable RL agents always find ways to bypass their intended objectives by shortcutting their reward signal? This question impacts how far RL can be scaled, and whether alternative paradigms must be developed in order to build safe artificial general intelligence. In this paper, we study when an RL agent has an instrumental goal to tamper with its reward process, and describe design principles that prevent (...) instrumental goals for two different types of reward tampering. Combined, the design principles can prevent reward tampering from being an instrumental goal. The analysis benefits from causal influence diagrams to provide intuitive yet precise formalizations. (shrink)

Praise is a common feature of interpersonal interaction. It is used to encourage, socialize, ingratiate, seduce, reward, and influence other people. These assorted usages reflect a widespread belief in the efficacy of praise for altering the behaviour and affective state of the recipient. Despite this assumed power of praise, and despite its salience and frequency in human social interaction, research interest in praise has been sporadic and intermittent, and not united within an all-embracing theoretical model.In this article we will present (...) an analysis of the effects of praise. We will begin by considering how to define praise. Next, we will examine the view of praise as social reinforcement, a conception which roots praise firmly within an empiricist framework; this appears to have been the predominant theoretical view guiding previous research on praise. We will conclude, however, that this view is conceptually inadequate to account for the empirical evidence. Because of that conclusion, our next step will be to provide a novel examination of the likely processes and consequences involved in praise. The remainder of the article will then be devoted to examining, where it is available, empirical evidence relevant to our analysis. (shrink)

This multi-methodological study applied functional magnetic resonance imaging to investigate neural activation in a group of adolescent students ( N = 88) during a probabilistic reinforcement learning task. We related patterns of emerging brain activity and individual learning rates to socio-motivational (in-)dependence manifested in four different motivation types (MTs): (1) peer-dependent MT, (2) teacher-dependent MT, (3) peer-and-teacher-dependent MT, (4) peer-and-teacher-independent MT. A multinomial regression analysis revealed that the individual learning rate predicts students’ membership to the independent MT, or the (...) peer-and-teacher-dependent MT. Additionally, the striatum, a brain region associated with behavioral adaptation and flexibility, showed increased learning-related activation in students with motivational independence. Moreover, the prefrontal cortex, which is involved in behavioral control, was more active in students of the peer-and-teacher-dependent MT. Overall, this study offers new insights into the interplay of motivation and learning with (1) a focus on inter-individual differences in the role of peers and teachers as source of students’ individual motivation and (2) its potential neurobiological basis. (shrink)

Improving the resilience of urban road networks suffering from various disruptions has been a central focus for urban emergence management. However, to date the effective methods which may mitigate the negative impacts caused by the disruptions, such as road accidents and natural disasters, on urban road networks is highly insufficient. This study proposes a novel adaptive signal control strategy based on a doubly dynamic learning framework, which consists of deep reinforcement learning and day-to-day traffic dynamic learning, to improve the (...) network performance by adjusting red/green time split. In this study, red time split is regarded as extra traffic flow to discourage drivers to use affected roads, so as to reduce congestion and improve the resilience when urban road networks are subject to different levels of disruptions. In addition, we utilize the convolution neural network as Q-network to approximate Q values, link flow distribution and link capacity are regarded as the state space, and actions are denoted as red/green time split. A small network is utilized as a numerical example, and a fixed time signal control and other two adaptive signal controls are employed for the comparisons with the proposed one. The results show that the proposed adaptive signal control based on deep reinforcement learning can achieve better resilience in most of the cases, particularly in the scenarios of moderate and severe disruptions. This study may shed light on the advantages of the proposed adaptive signal control dealing with major emergencies compared to others. (shrink)

The generation of the pitch control signal in a wind turbine (WT) is not straightforward due to the nonlinear dynamics of the system and the coupling of its internal variables; in addition, they are subjected to the uncertainty that comes from the random nature of the wind. Fuzzy logic has proved useful in applications with changing system parameters or where uncertainty is relevant as in this one, but the tuning of the fuzzy logic controller (FLC) parameters is neither straightforward nor (...) an easy task. On the other hand, reinforcement learning (RL) allows systems to automatically learn, and this capability can be exploited to tune the FLC. In this work, a WT pitch control architecture that uses RL to tune the membership functions and scale the output of a fuzzy controller is proposed. The RL strategy calculates the fuzzy controller gains in order to reduce the output power error of the WT according to the wind speed. Different reward mechanisms based on the output power error have been considered. Simulation results with different wind profiles show that this architecture performs better (123.7 W) in terms of power errors than an FLC without RL (133.2 W) or a simpler PID (208.8 W). Even more, it provides a smooth response and outperforms other hybrid controllers such as RL-PID and radial basis function neural network control. (shrink)