Recent proposals for a return to introspective methods make it necessary to review the central problems that led psychologists to abandon those methods as sources of scientific data in the early twentieth century. These problems and other related challenges to verbal reports collected during the cognitive revolution during the 1960s and 1970s were discussed in Ericsson and Simon's proposal for a theoretically motivated procedure to elicit valid and non- reactive concurrent verbalization of thoughts while subjects were performing tasks. The (...) same proposal explains why other verbal reports, such as introspections, detailed descriptions or explanations, require additional cognitive activity that often leads to reactivity and invalid reports. Finally, a new proposal is sketched for how the generation of introspective reports might be incorporated within a framework for non-reactive and valid verbalization of thoughts. (shrink)

The central problem which cognitive scientists face in studying thinking is that thinking cannot be observed directly by other people. The traditional solution has been to rely on introspective methods, where individuals observe their own thinking and reflect on its characteristics. In everyday life, the most common technique involves asking people questions about their thinking, knowledge, and strategies. Psychologists have refined the methods for questioning individuals by designing questionnaires and structured interviews. However, these two ways of obtaining information about thinking (...) share two fundamental methodological problems. First, the accuracy of the reports cannot be assessed, because in naturally occurring situations in everyday life the investigator doesn't have any other empirical evidence against which to evaluate the validity of the subjects' reported information. Hence, psychologists are forced to trust the subjects to provide valid information. The second issue concerns whether even those individuals who strive to give accurate reports are able to access and supply valid information on the cognitive processes that mediate their behavior. (shrink)

Cowan's experimental techniques cannot constrain subject's recall of presented information to distinct independent chunks in short-term memory (STM). The encoding of associations in long-term memory contaminates recall of pure STM capacity. Even in task environments where the functional independence of chunks is convincingly demonstrated, individuals can increase the storage of independent chunks with deliberate practice – well above the magical number four.

To make genuine progress toward explicating the relation between innate talent and high levels of ability, we need to consider the differences in structure between most everyday abilities and expert performance. Only in expert performance is it possible to show consistently that individuals can acquire skills to circumvent and modify basic characteristics (talent).

Every quantum state can be represented as a probability distribution over the outcomes of an informationally complete measurement. But not all probability distributions correspond to quantum states. Quantum state space may thus be thought of as a restricted subset of all potentially available probabilities. A recent publication (Fuchs and Schack, arXiv:0906.2187v1, 2009) advocates such a representation using symmetric informationally complete (SIC) measurements. Building upon this work we study how this subset—quantum-state space—might be characterized. Our leading characteristic is that the inner (...) products of the probabilities are bounded, a simple condition with nontrivial consequences. To get quantum-state space something more detailed about the extreme points is needed. No definitive characterization is reached, but we see several new interesting features over those in Fuchs and Schack (arXiv:0906.2187v1, 2009), and all in conformity with quantum theory. (shrink)

In the mid-1980s, Dario Donatelli participated in a laboratory study of the effects of around 800 h of practice on digit-span and increased his digit-span from 8 to 104 digits. This study assessed changes in the structure of his memory skill after around 30 years of essentially no practice on the digit-span task. On the first day of testing, his estimated span was only 10 digits, but over the following 3 days of testing it increased to 19 digits. Further analyses (...) of his recall performance and verbal reports identified which mechanisms of the original memory skill he could retrieve or reacquire over the 3 days of practice. We discuss theoretical implications for the retention of skilled memory performance, the effects of age-related changes in memory on it, and for the future study of the effects of disuse on exceptional performance and complex skill. (shrink)

in Undetermined On an influential interpretation, the agent's degrees of belief asr identified with her betting rates. However, being placed in a betting situation can itself change one’s degree of belief in the proposition in question. The problem as such isn’t new. Ramsey, for example, was right on to this idea when he wrote: "… the proposal of a bet may inevitably alter [one’s] state of opinion; just as we could not always measure electric intensity by actually introducing a charge (...) and seeing what force it was subject to, because the introduction of the charge would change the distribution to be measured." This ‘interference problem’ for the betting interpretation can best be put in the following way: The bets we are disposed to accept do not manifest our current unconditional degrees of belief in various propositions. Whether a bet on A would be accepted or not does not depend on the agent’s degree of belief in A but rather on the degree of belief she would have if she were confronted with this bet proposal, or – more generally – the degree of belief she would have if she were in a position to bet on A. Assuming the conditionalization model for belief change, this means that whether the agent would be willing to bet depends on her current conditional beliefs concerning A on the hypothetical supposition that she has an opportunity to make this bet. Furthermore, her disposition to bet also depends on the expected effects the act of betting would have on the truth of the proposition to be betted on. Both these phenomena imply that finding oneself in a betting situation might alter one’s expectations in important ways. Consequently, the identification of degrees of belief with betting rates is a mistake. We show that this problem comes up in several different versions, or – equivalently – that different kinds of arguments against the betting interpretation stem from the same source. (shrink)

Video games are ideal platforms for the study of skill acquisition for a variety of reasons. However, our understanding of the development of skill and the cognitive representations that support skilled performance can be limited by a focus on game scores. We present an alternative approach to the study of skill acquisition in video games based on the tools of the Expert Performance Approach. Our investigation was motivated by a detailed analysis of the behaviors responsible for the superior performance of (...) one of the highest scoring players of the video game Space Fortress. This analysis revealed how certain behaviors contributed to his exceptional performance. In this study, we recruited a participant for a similar training regimen, but we collected concurrent and retrospective verbal protocol data throughout training. Protocol analysis revealed insights into strategies, errors, mental representations, and shifting game priorities. We argue that these insights into the developing representations that guided skilled performance could only easily have been derived from the tools of the Expert Performance Approach. We propose that the described approach could be applied to understand performance and skill acquisition in many different video games and help reveal mechanisms of transfer from gameplay to other measures of laboratory and real-world performance. (shrink)

Performance on abstract unfamiliar tasks used to measure intelligence has not been found to correlate with individual differences in highly skilled and expert performance. Given that cognitive and neural structures and regions mediating performance change as skill increases, the structures highlighted by parieto-frontal integration theory are unlikely to account for individual differences in skilled cognitive achievement in everyday life.

Part I: The Life of Cognitive Science:. William Bechtel, Adele Abrahamsen, and George Graham. Part II: Areas of Study in Cognitive Science:. 1. Analogy: Dedre Gentner. 2. Animal Cognition: Herbert L. Roitblat. 3. Attention: A.H.C. Van Der Heijden. 4. Brain Mapping: Jennifer Mundale. 5. Cognitive Anthropology: Charles W. Nuckolls. 6. Cognitive and Linguistic Development: Adele Abrahamsen. 7. Conceptual Change: Nancy J. Nersessian. 8. Conceptual Organization: Douglas Medin and Sandra R. Waxman. 9. Consciousness: Owen Flanagan. 10. Decision Making: J. Frank Yates (...) and Paul A. Estin. 11. Emotions: Paul E. Griffiths. 12. Imagery and Spatial Representation: Rita E. Anderson. 13. Language Evolution and Neuromechanisms: Terrence W. Deacon. 14. Language Processing: Kathryn Bock and Susan M. Garnsey. 15. Linguistics Theory: D. Terence Langendoen. 16. Machine Learning: Paul Thagard. 17. Memory: Henry L. Roediger III and Lyn M. Goff. 18. Perception: Cees Van Leeuwen. 19. Perception: Color: Austen Clark. 20. Problem Solving: Kevin Dunbar. 21. Reasoning: Lance J. Rips. 22. Social Cognition: Alan J. Lambert and Alison L. Chasteen. 23. Unconscious Intelligence: Rhianon Allen and Arthur S. Reber. 24. Understanding Texts: Art Graesser and Pam Tipping. 25. Word Meaning: Barbara C. Malt. Part III: Methodologies of Cognitive Science:. 26. Artificial Intelligence: Ron Sun. 27. Behavioral Experimentation: Alexander Pollatsek and Keith Rayner. 28. Cognitive Ethology: Marc Bekoff. 29. Deficits and Pathologies: Christopher D. Frith. 30. Ethnomethodology: Barry Saferstein. 31. Functional Analysis: Brian Macwhinney. 32. Neuroimaging: Randy L. Buckner and Steven E. Petersen. 33. Protocal Analysis: K. Anders Ericsson. 34. Single Neuron Electrophysiology: B. E. Stein, M.T. Wallace, and T.R. Stanford. 35. Structural Analysis: Robert Frank. Part IV: Stances in Cognitive Science:. 36. Case-based Reasoning: David B. Leake. 37. Cognitive Linguistics: Michael Tomasello. 38. Connectionism, Artificial Life, and Dynamical Systems: Jeffrey L. Elman. 39. Embodied, Situated, and Distributed Cognition: Andy Clark. 40. Mediated Action: James V. Wertsch. 41. Neurobiological Modeling: P. Read Montague and Peter Dayan. 42. Production Systems: Christian D. Schunn and David Klahr. Part V: Controversies in Cognitive Science:. 43. The Binding Problem: Valerie Gray Hardcastle. 44. Heuristics and Satisficing: Robert C. Richardson. 45. Innate Knowledge: Barbara Landau. 46. Innateness and Emergentism: Elizabeth Bates, Jeffrey L. Elman, Mark H. Johnson, Annette Karmiloff-Smith, Domenico Parisi, and Kim Plunkett. 47. Intentionality: Gilbert Harman. 48. Levels of Explanation and Cognition Architectures: Robert N. McCauley. 49. Modularity: Irene Appelbaum. 50. Representation and Computation: Robert S. Stufflebeam. 51. Representations: Dorrit Billman. 52. Rules: Terence Horgan and John Tienson. 53. Stage Theories Refuted: Donald G. Mackay. Part VI: Cognitive Science in the Real World:. 54. Education: John T. Bruer. 55. Ethics: Mark L. Johnson. 56. Everyday Life Environments: Alex Kirlik. 57. Institutions and Economics: Douglass C. North. 58. Legal Reasoning: Edwina L. Rissland. 59. Mental Retardation: Norman W. Bray, Kevin D. Reilly, Lisa F. Huffman, Lisa A. Grupe, Mark F. Villa, Kathryn L. Fletcher, and Vivek Anumolu. 60. Science: William F. Brewer and Punyashloke Mishra. Selective Biographies of Major Contributors to Cognitive Science: William Bechtel and Tadeusz Zawidzki. (shrink)

People generally develop some degree of competence in general informal reasoning and argument skills, but how do they go beyond this to attain higher expertise? Ericsson has proposed that high-level expertise in a variety of domains is cultivated through a specific type of practice, referred to as ‘deliberate practice’. Applying this framework yields the empirical hypothesis that high-level expertise in informal reasoning is the outcome of extensive deliberate practice. This paper reports results from two studies evaluating the hypothesis. University (...) student participants completed 12 weeks of deliberate practice in informal reasoning. Quantity of practice was recorded by computer, and additionally assessed via self report. The hypothesis was supported: students in both studies showed a large improvement, and practice as measured by computer, was related to amount of improvement in informal reasoning. These findings support adopting a deliberate practice approach when attempting to teach or learn expertise in informal reasoning. (shrink)

People often remember what they attend to in the world. Such memory can be cast as a kind of mental catalog or index of attended objects. To investigate how such an index is acquired and used, protocol data were collected from a programmer who scrolled to off‐screen objects from time to time as she worked. These protocol data were modeled using Soar, which constrains how the index is constructed. In the model, an index entry is an episodic trace encoded during (...) attention. The trace associates the attention event with a time symbol denoting the event's occurrence. Later, the model can ask itself whether it saw that object by calling to mind an image of the attention event. If this image retrieves a time symbol, then the model infers that the object exists and can reason about bringing the object back into view. Episodic indexing is a theory of these encoding and retrieval processes. It posits that information about attention events is encoded automatically, but that retrieval requires effort and knowledge. Episodic indexing is congruent with a range of results on episodic and temporal codes and recognition and recall processes. It incorporates source monitoring (Johnson, Hashtroudi, & Lindsay, 1993) and is a simple and pervasive form of long‐term working memory (Ericsson & Kintsch, 1995). (shrink)

Acquiring expertise in a task is often thought of as an automatic process that follows inevitably with practice according to the log‐log law (aka: power law) of learning. However, as Ericsson, Chase, and Faloon (1980) showed, this is not true for digit‐span experts and, as we show, it is certainly not true for Tetris players at any level of expertise. Although some people may simply “twitch” faster than others, the limit to Tetris expertise is not raw keypress time but (...) the techniques acquired by players that allow them to use the tools provided by the hardware and software to compensate for the game's relentlessly increasing drop speed. Unfortunately, these increases in drop speed between Tetris levels make performance plateaus very short and quickly followed by game death. Hence, a player's success at discovering, exploring, and practicing new techniques for the tasks of board preparation, board maintenance, optimal placement discovery, zoid rotation, lateral movement of zoids, and other tasks important to expertise in Tetris is limited. In this paper, we analyze data collected from 492 Tetris players to reveal the challenges they confronted while constructing expertise via the discovery of new techniques for gameplay at increasingly difficult levels of Tetris. (shrink)

1. EXPLICATING THE CONCEPT OF REFLECTION (under review) -/- To understand how ‘reflection’ is used, I consider ordinary, philosophical, and scientific discourse. I find that ‘reflection’ seems to refer to reasoning that is deliberate and conscious, but not necessarily self-conscious. Then I offer an empirical explication of reflection’s conscious and deliberate features. These explications not only help explain how reflection can be detected; they also distinguish reflection from nearby concepts such as ruminative and reformative reasoning. After this, I find that (...) reflection is not obviously limited to only practical or only theoretical reasoning. The chapter ends with reasons to prefer ‘unreflective’ and ‘reflective’ to dual process theorists’ labels about systems or types. -/- 2. BOUNDED REFLECTIVISM & EPISTEMIC IDENTITY (in Metaphilosophy) -/- Reflection features centrally in philosophy (e.g., Korsgaard, 1996; Rawls, 1971; Sosa, 1991) and psychology (e.g., Pennycook, 2018). Bounded reflectivism is an empirically adequate model of reflection that explains reflection’s capacity to either help or hinder reasoning—e.g., reflective equilibrium vs. reflective polarization (e.g., Kahan et al., 2017). One innovation of the model is epistemic identity: an identity that involves particular beliefs—e.g., religious and political identities. When we feel that our epistemic identity is threatened, we can reflectively defend its beliefs rather than update our beliefs according to the best arguments and evidence. The solution, I argue, is not to suppress epistemic identity but embrace it by appealing to shared, superordinate epistemic identities. -/- 3. ALL MEASURES ARE NOT CREATED EQUAL (under review) -/- A bat and a ball cost $1.10 in total. The bat costs $1.00 more than the ball. How much does the ball cost? “10 cents” comes to most people’s minds immediately. However, upon reflection, we can realize that “5 cents” is the correct answer. There are many reflection tests. Each has its limitations. Some reflection tests are mathematical—like the bat-and-ball problem (e.g., Frederick, 2005) and others are logical (e.g., Janis & Frick, 1943). So there are concerns that reflection tests track logical and mathematical competence rather than reflection per se. Also, some psychologists assume a priori that correct answers are reflective and lured answers are unreflective. New evidence raises additional concerns about the plausibility of these assumptions. I argue that think aloud protocols (Ericsson & Simon, 1998) and process dissociation (Jacoby, 1991) can assuage some of these concerns. -/- 4. GREAT MINDS DO NOT THINK ALIKE (in Review of Philosophy and Psychology) -/- Two large studies (N = 1299), one pre-registered, found that many correlations between reflection and philosophical beliefs among non-philosophers replicated among philosophers. For example, less reflective philosophers preferred theism to atheism and utilitarian rather than deontological responses to the trolley problem (Hannikainen & Cova, in prep.; Pennycook et al., 2016; Reynolds, Byrd, & Conway, forthcoming). However, philosophical judgments were sometimes better predicted by factors like education, gender, and personality than by reflection test performance. So although some relationships between reflection and philosophy were robust, there is more to the link between reflection and philosophy. Normative implications are also discussed—e.g., how we can infer the quality of philosophical views from their correlations with reflective or unreflective reasoning. -/- 5. WHAT WE CAN (AND CAN’T) INFER ABOUT IMPLICIT BIAS (in Synthese) -/- Contrary to some philosophers and psychologists, I argue that implicit bias is probably associative. However, I also argue that debiasing is not thereby entirely unconscious and involuntary. Indeed, strong evidence suggests that reflection can change implicitly biased behavior—e.g., conscious and deliberate counterconditioning. This has implications for the science and morality of implicit bias—e.g., evidence suggests that we can reform biases; so. intuitively, we can be responsible for biases. (shrink)

RESUMO Em detrimento do acúmulo de 10.000 horas de prática antes do domínio sobre algo - o famoso tipping point de Ericsson - intérpretes médicos podem ganhar considerável experiência ao analisar vídeos de interações médico-paciente, mesmo quando esse par fala a mesma língua. Os hospitais-escola comumente filmam tais interações usando pacientes simulados. Tais filmes têm sido usados em instruções de aula com intérpretes. Aqui, é descrito o uso recente de filmes com PS em um ambiente de aprendizado online, no (...) qual fóruns de discussão e fichas de atividade suplantaram os métodos de trabalho convencionais. Nessa abordagem de aprendizagem baseada em problemas, típica da educação médica, estudantes de pós-graduação em interpretação em serviços de saúde se familiarizam com o discurso típico de diagnóstico e tratamento. Os alunos relataram que essa familiarização os ajudou a liberar seus recursos cognitivos para planejar e monitorar traduções e outras decisões imediatas. Os materiais e métodos de aprendizado usados nessa abordagem online são descritos detalhadamente. O valor do contexto da ABP é descrito em relação às abordagens educacionais de interpretação para o sistema de saúde de modo geral.ABSTRACT Rather than amassing 10,000 hours of practice before mastery is achieved - Ericsson’s famed tipping point - medical interpreters can gain considerable, concomitant experience by analyzing videos of provider-patient interactions, even when the pair speak the same language. Teaching hospitals commonly film such interactions using standardized patients. Such films have been effectively used in classroom-based instruction with interpreters. The novel use of SP films in an on-line learning environment is described herein, where discussion boards and worksheets supplanted traditional instruction methods. In this problem-based learning approach, typical of medical education, graduate-level medical interpreting students became familiar with common diagnostic and treatment discourse. Students reported that this familiarity helped free their cognitive resources for planning and monitoring translations and other decisions on-the-job. The learning materials and methods used in this on-line approach are detailed. The value of the PBL context is described in relation to healthcare interpreting education approaches generally. (shrink)

Back and forth swings the pendulum. It is remarkable that Baars can claim that “many scientists now feel that radical behaviorists tossed out the baby with the bathwater” while not being able to see that his own efforts threaten to be an instance of the complementary overshooting–what we might call covering a nice clean baby with dualistic dirt . Yes indeed, radical behaviorism of Skinner’s variety fell from grace some years ago, with the so-called cognitive revolution, to be replaced by (...) a sort of cognitivistic behaviorism that has plenty of room for inner processes, for talking to yourself, for mental imagery, for hunches, feelings, pains, dreams, beliefs and hopes and expectations, but only so long as these are understood to be physical (“informational” or “computational”) processes that could be accomplished by the machinery of the brain. It is an interesting speculative question whether William James would have been a wholehearted cognitivist, or whether he would have insisted that what he meant by the stream of consciousness had to be sharply distinguished from the streams of mere information-manipulation discernible in the activities of cortical subsystems, etc., etc. Making a home for consciousness in the brain, for a distinction between unconscious information-transformations and conscious ones, for instance, is now the work of many hands in many fields (See, e.g., Dennett, 2001, and the other essays in the special issue of Cognition devoted to the cognitive neuroscience of consciousness). The main methodological principle of this research is one shared with the radical behaviorists: only intersubjectively accessible data are to be admitted in this natural science of consciousness. If that allegiance, by itself , counts as ‘behaviorism,” then we should all be behaviorists, and indeed the very researchers Baars cites (Singer, Ericsson and Simon, Hilgard, Crick, and Edelman) scrupulously and unapologetically are behaviorists in this minimal sense. They interview their subjects, under controlled conditions, and take their reports seriously–but not as infallible guides to their subjects’ subjectivity.. (shrink)

How do expert performers practice as they develop creatively? This study investigated the processes involved in the practice of new skills by expert breakdancers. A great deal of evidence supports the theory of “deliberate practice” (Ericsson, Krampe, & Tesch‐Römer, 1993,Psychological Review, 100,363) in skill acquisition; however, expert creative performers may emphasize other forms of practice for skill development. Four case studies collected through fieldwork and laboratory observation were analyzed to evaluate expert dancers’ practice processes as they developed proficiency in (...) new, specific skills. We focused on three aspects of learning: the degree of skill acquisition, the content of skills included in practice, and dancers’ stated purposes for practicing. The results showed that dancers’ practice improved skills (as suggested by deliberate practice) and engaged the exploration of new, original skills, along with coordinating skills within performance. In their practice, these dance experts went beyond deliberative practice to highly exploratory processes for skill development. (shrink)

It is so generally accepted that prostitution is immoral, that this is one of the least discussed of all ethical issues. Few serious philosophical treatments of the subject have been published. Of these, at least one, Lars Ericsson's, ‘Charges against Prostitution’, throws into stark relief the apparent inconsistency of our community attitudes. For it demonstrates that, from the point of view of the simple free market liberalism, to which many subscribe, there is nothing immoral about prostitution. The prostitute is (...) a free agent who sells his or her services on the market at the going price. Why should the exchange of sexual services for money be more unsavoury than other exchanges of fee for service? The desire for sexual gratification is natural, as is the desire for food. So prostitution must be morally on a par with catering. Yet it is hemmed about by restrictions. Prostitutes are social outcasts, they may be pitied but are more often vilified and despised. From the liberal point of view, the moral disgust aroused by prostitution can only be the expression of an archaic and irrational taboo. (shrink)

"The only way not to to make mistakes is to wait until history has passed you by," states Bernard-Henri Lévy. But he doesn't like to wait. And that's why 'BHL', armed with a cell phone and raybans, takes off for political hot spots.""Je t'embrasse." The philosopher ends the phone call and places the tiny Ericsson cell phone on the table next to his Ray Bans. He turns to his interviewers: "Where were we?"For a moment they are lost, distracted by (...) the question of who BHL may have been 'embracing'. His wife? His mistress? Perhaps a student of French picked up casually during his lightning visit to The Netherlands? (shrink)

The question of what explains individual differences in expertise within complex domains such as music, games, sports, science, and medicine is currently a major topic of interest in a diverse range of fields, including psychology, education, and sports science, to name just a few. Ericsson and colleagues’ deliberate practice view is highly influential perspective in the literature on expertise and expert performance—but is it viable as a testable scientific theory? Here, reviewing more than 25 years of Ericsson and (...) colleagues’ writings, we document critical inconsistencies in the definition of deliberate practice, along with apparent shifts in the standard for evidence concerning deliberate practice. We also consider the impact of these issues on progress in the field of expertise, focusing on the empirical testability and falsifiability of the deliberate practice view. We then discuss a multifactorial perspective on expertise, and how open science practices can accelerate progress in research guided by this perspective. (shrink)