Cultural phylogenetics has made remarkable progress by relying on methods originally developed in biology. But biological and cultural evolution do not always proceed according to the same principles. So what, if anything, could justify the use of phylogenetic methods to reconstruct the evolutionary history of culture? In this paper, we describe models used to assess the reliability of inference methods and show how these models play an underappreciated role in addressing that question. The notion of reliability is of course central (...) to these models. As we explain, a common way of understanding reliability is in terms of low error rates. A careful look at case studies in cultural phylogenetics suggests that reliability models partly corroborate this understanding of reliability but also raises points of tension. We conclude by hinting at a few ways forward. (shrink)

The paper introduces, compares and contrasts formal models of source reliability proposed in the epistemology literature, in particular the prominent models of Bovens and Hartmann and Olsson :127–143, 2011). All are Bayesian models seeking to provide normative guidance, yet they differ subtly in assumptions and resulting behavior. Models are evaluated both on conceptual grounds and through simulations, and the relationship between models is clarified. The simulations both show surprising similarities and highlight relevant differences between these models. Most importantly, however, our (...) evaluations reveal that important normative concerns arguably remain unresolved. The philosophical implications of this for testimony are discussed. (shrink)

In computer simulations of physical systems, the construction of models is guided, but not determined, by theory. At the same time simulations models are often constructed precisely because data are sparse. They are meant to replace experiments and observations as sources of data about the world; hence they cannot be evaluated simply by being compared to the world. So what can be the source of credibility for simulation models? I argue that the credibility of a simulation model comes not (...) only from the credentials supplied to it by the governing theory, but also from the antecedently established credentials of the model building techniques employed by the simulationists. In other words, there are certain sorts of model building techniques which are taken, in and of themselves, to be reliable. Some of these model building techniques, moreover, incorporate what are sometimes called “falsifications.” These are contrary-to-fact principles that are included in a simulation model and whose inclusion is taken to increase the reliability of the results. The example of a falsification that I consider, called artificial viscosity, is in widespread use in computational fluid dynamics. Artificial viscosity, I argue, is a principle that is successfully and reliably used across a wide domain of fluid dynamical applications, but it does not offer even an approximately “realistic” or true account of fluids. Artificial viscosity, therefore, is a counter-example to the principle that success implies truth – a principle at the foundation of scientific realism. It is an example of reliability without truth. (shrink)

Information generally comes from less than fully reliable sources. Rationality, it seems, requires that one take source reliability into account when reasoning on the basis of such information. Recently, Bovens and Hartmann (2003) proposed an account of the conjunction fallacy based on this idea. They show that, when statements in conjunction fallacy scenarios are perceived as coming from such sources, probability theory prescribes that the “fallacy” be committed in certain situations. Here, the empirical validity of their model was (...) assessed. The model predicts that statements added to standard conjunction problems will change the incidence of the fallacy. It also predicts that statements from reliable sources should yield an increase in fallacy rates (relative to unreliable sources). Neither the former (Experiment 1) nor the latter prediction (Experiment 3) was confirmed, although Experiment 2 showed that people can derive source reliability estimates from the likelihood of statements in a manner consistent with the tested model. In line with the experimental results, model fits and sensitivity analyses also provided very little evidence in favor of the model. This suggests that Bovens and Hartmann’s present model fails to explain fully people’s judgements in standard conjunction fallacy tasks. (shrink)

The relation between models and the world is mediated by experimental procedures generating data that are used as evidence to evaluate the model. Data can serve as empirical evidence, for or against, only if they result from reliable experimental procedures. The aim of this article is to discuss the role of relevance judgments in the evaluation of reliability and to clarify the conditions under which reliability can be a strictly empirical matter. It is argued that reliability is a (...) strictly empirical issue only in the restricted case in which the claim under test/investigation is about a data-generating procedure. (shrink)

One persistent challenge in scientific practice is that the structure of the world can be unstable: changes in the broader context can alter which model of a phenomenon is preferred, all without any overt signal. Scientific discovery becomes much harder when we have a moving target, and the resulting incorrect understandings of relationships in the world can have significant real-world and practical consequences. In this paper, we argue that it is common (in certain sciences) to have changes of context (...) that lead to changes in the relationships under study, but that standard normative accounts of scientific inquiry have assumed away this problem. At the same time, we show that inference and discovery methods can “protect” themselves in various ways against this possibility by using methods with the novel methodological virtue of “diligence.” Unfortunately, this desirable virtue provably is incompatible with other desirable methodological virtues that are central to reliable inquiry. No scientific method can provide every virtue that we might want. (shrink)

In _Reliable Reasoning_, Gilbert Harman and Sanjeev Kulkarni -- a philosopher and an engineer -- argue that philosophy and cognitive science can benefit from statistical learning theory, the theory that lies behind recent advances in machine learning. The philosophical problem of induction, for example, is in part about the reliability of inductive reasoning, where the reliability of a method is measured by its statistically expected percentage of errors -- a central topic in SLT. After discussing philosophical attempts to evade the (...) problem of induction, Harman and Kulkarni provide an admirably clear account of the basic framework of SLT and its implications for inductive reasoning. They explain the Vapnik-Chervonenkis dimension of a set of hypotheses and distinguish two kinds of inductive reasoning. The authors discuss various topics in machine learning, including nearest-neighbor methods, neural networks, and support vector machines. Finally, they describe transductive reasoning and suggest possible new models of human reasoning suggested by developments in SLT. (shrink)

BackgroundThe BelRAI Screener is a short-form assessment consolidating internationally validated interRAI items focusing on physical and psychological aspects of functioning and problems with activities of daily living. It was fully implemented in the Flemish home care setting as of June 2021. In a biopsychosocial model for developing a personalized and effective care plan social and contextual aspects are considered equally important to biomedical ones. Thus, a social supplement to the BelRAI Screener was collaboratively developed with stakeholders and tested to (...) gather additional information on the social context of community-dwelling adults with care needs.Objective and methodsTo examine the interrater reliability of the BelRAI Social Supplement in Flanders, Belgium, an observational study was conducted using a convenience sample. The method of simultaneous rating was used due to strict COVID-19 guidelines at the time and to minimize assessment burden. Fifty two community-dwelling adults requesting home care support were simultaneously assessed by two independent assessors during home visits. Interrater reliability was tested on all 80 items of the BelRAI Social Supplement using observed agreement, kappa coefficients, and intraclass correlation coefficients.ResultsThe kappa mean and median values for nominal items, show substantial agreement, while the kappa mean and median values for ordinal items were 0.81 and 0.90, which correspond to almost perfect agreement. Following the traditional cut-off points for the interpretation of the kappa statistic, reliability was almost perfect for 49% of all items, substantial for 33%, moderate for 8%, and poor for 10%. The majority of items with poor kappa value, showed a high observed agreement, reflecting homogeneity of the sample rather than poor agreement.ConclusionThe strength of kappa agreement for the items in this version of the BelRAI Social Supplement is generally substantial to almost perfect, with high proportions of observed agreement. COVID-19 restrictions had a large impact on the planning and execution of the home visits. A final optimization of the instrument and accompanying manual according to the findings will result in an improved version ready for nation-wide implementation. (shrink)

Science is remarkably reliable. It puts people on the moon, performs laser eye surgery, tells us about ancient civilisations and species, and predicts the future of our climate. What underwrites this reliability? This book argues that the standard answers—the scientific method, rigour, and objectivity—are insufficient for the job. Here we propose a new model of science that places its products front and centre. This is the ‘Tangle of Science’. In this book we show how any reliable piece (...) of science is underpinned by a vast, diverse, and thick network of other scientific products. In doing so we bring back into focus areas of science that have been long neglected, emphasising how every product, from the screws that hold the space shuttle together to ways of measuring the consumer price index to Einstein’s theory of general relativity, work together to support results we can trust. (shrink)

The paper discusses modelling uncertainties in climate models and how they can be addressed based on physical principles as well as based on how the models perform in light of empirical data. We ar...

Presently, most studies focus on the minimization of the costs and negative social effects of the location of construction waste recycling centers; however, the influence of the location on future operation is usually ignored. Aiming at solving these problems, a location model for the maximization of service reliability was devised. Service reliability includes the recycling reliability of the construction waste and the delivery reliability of the recycled product. Through maximizing service reliability, the location deviation as a result of arrival (...) delay is expected to be reduced and the service reliability improved. Then, two important parameters in our model were solved on the basis of correlative mathematical theories. Finally, an example was implemented to verify our location optimization model. A genetic algorithm was used to obtain optimal solutions, and the solutions were analyzed. Through establishing a location optimization model, a possible better solution to location problems may be obtained to help in implementing location selection for recycling centers. (shrink)

The coherentist theory of justification provides a response to the sceptical challenge: even though the independent processes by which we gather information about the world may be of dubious quality, the internal coherence of the information provides the justification for our empirical beliefs. This central canon of the coherence theory of justification is tested within the framework of Bayesian networks, which is a theory of probabilistic reasoning in artificial intelligence. We interpret the independence of the information gathering processes (IGPs) in (...) terms of conditional independences, construct a minimal sufficient condition for a coherence ranking of information sets and assess whether the confidence boost that results from receiving information through independent IGPs is indeed a positive function of the coherence of the information set. There are multiple interpretations of what constitute IGPs of dubious quality. Do we know our IGPs to be no better than randomization processes? Or, do we know them to be better than randomization processes but not quite fully reliable, and if so, what is the nature of this lack of full reliability? Or, do we not know whether they are fully reliable or not? Within the latter interpretation, does learning something about the quality of some IGPs teach us anything about the quality of the other IGPs? The Bayesian-network models demonstrate that the success of the coherentist canon is contingent on what interpretation one endorses of the claim that our IGPs are of dubious quality. (shrink)

This book considers how observations about the past influence future behaviour, as expressed in language. Focusing on information gathered from speech and other evidence sources, the author offers a model of how judgements about reliability can be made, and how such judgements factor into how people treat information they acquire via those sources.

Several current debates in the epistemology of testimony are implicitly motivated by concerns about the reliability of rules for changing one’s beliefs in light of others’ claims. Call such rules testimonial norms (tns). To date, epistemologists have neither (i) characterized those features of communities that influence the reliability of tns, nor (ii) evaluated the reliability of tns as those features vary. These are the aims of this paper. I focus on scientific communities, where the transmission of highly specialized information is (...) both ubiquitous and critically important. Employing a formal model of scientific inquiry, I argue that miscommunication and the “communicative structure” of science strongly influence the reliability of tns, where reliability is made precise in three ways. (shrink)

As a result of the complexity inherent in some natural systems, mathematical models employed in ecology are often governed by a large number of variables. For instance, in the study of population dynamics we often find multiregional models for structured populations in which individuals are classified regarding their age and their spatial location. Dealing with such structured populations leads to high dimensional models. Moreover, in many instances the dynamics of the system is controlled by processes whose time scales are very (...) different from each other. For example, in multiregional models migration is often a fast process in comparison to the growth of the population.Approximate reduction techniques take advantage of the presence of different time scales in a system to introduce approximations that allow one to transform the original system into a simpler low dimensional system. In this way, the dynamics of the original system can be approximated in terms of that of the reduced system. This work deals with the study of that approximation. In particular, we work with a non-autonomous discrete time model previously presented in the literature and obtain different bounds for the error we incur when we describe the dynamics of the original system in terms of the reduced one. (shrink)

Psychological studies show that the beliefs of two agents in a hypothesis can diverge even if both agents receive the same evidence. This phenomenon of belief polarisation is often explained by invoking biased assimilation of evidence, where the agents’ prior views about the hypothesis affect the way they process the evidence. We suggest, using a Bayesian model, that even if such influence is excluded, belief polarisation can still arise by another mechanism. This alternative mechanism involves differential weighting of the (...) evidence arising when agents have different initial views about the reliability of their sources of evidence. We provide a systematic exploration of the conditions for belief polarisation in Bayesian models which incorporate opinions about source reliability, and we discuss some implications of our findings for the psychological literature. (shrink)

Four studies examined 15- to 16-month-olds’ imitation of a model’s novel action with a familiar or an unfamiliar object. The infants observed a reliable or an unreliable model demonstrating a novel action with the object in a solitary observational or in an interactive context. The model’s reliability was manipulated by having the model acting competently or incompetently with different familiar objects. In two out of four studies infants imitated the model’s behavior when the (...) class='Hi'>model had previously shown to be reliable than when the model had been unreliable. The infants’ motivation to imitate was related to whether the reliable model interacted with the infants during object demonstration. More infants imitated the reliable model, who demonstrated the objects while interacting with the infants, than the reliable model who behaved in a disinterested manner during object demonstration. (shrink)

In recent years, the question of the reliability of Machine Learning (ML) methods has acquired significant importance, and the analysis of the associated uncertainties has motivated a growing amount of research. However, most of these studies have applied standard error analysis to ML models—and in particular Deep Neural Network (DNN) models—which represent a rather significant departure from standard scientific modelling. It is therefore necessary to integrate the standard error analysis with a deeper epistemological analysis of the possible differences between DNN (...) models and standard scientific modelling and the possible implications of these differences in the assessment of reliability. This article offers several contributions. First, it emphasises the ubiquitous role of model assumptions (both in ML and traditional science) against the illusion of theory-free science. Secondly, model assumptions are analysed from the point of view of their (epistemic) complexity, which is shown to be language-independent. It is argued that the high epistemic complexity of DNN models hinders the estimate of their reliability and also their prospect of long term progress. Some potential ways forward are suggested. Thirdly, this article identifies the close relation between a model’s epistemic complexity and its interpretability, as introduced in the context of responsible AI. This clarifies in which sense—and to what extent—the lack of understanding of a model (black-box problem) impacts its interpretability in a way that is independent of individual skills. It also clarifies how interpretability is a precondition for a plausible assessment of the reliability of any model, which cannot be based on statistical analysis alone. This article focuses on the comparison between traditional scientific models and DNN models. However, Random Forest (RF) and Logistic Regression (LR) models are also briefly considered. (shrink)

There are many theories surrounding infant imitation; however, there is no research to our knowledge evaluating the reliability of listener perception of vocal imitation in prelinguistic infants. This paper evaluates intra- and inter-rater judgments on the degree of “imitativeness” in utterances of infants below 12 months of age. 18 listeners were presented audio segments selected from naturalistic recordings to represent in each case a parent vocal model followed by an infant utterance ranging from low to high degrees of imitativeness. (...) The naturalistic data suggested vocal imitation occurred rarely across the first year, but strong intra- and inter-rater correlations were found for judgments of imitativeness. Our results suggest salience of the infant’s vocal imitation despite its rare occurrence as well as active perception by listeners of the imitative signal. We discuss infant vocal imitation as a potential signal of well-being and as an indicator of language learning and vocal communication skills as perceived by caregivers. (shrink)

Background: Few robust autism-specific outcome assessments have been developed specifically for use by teachers in special schools. The Assessment of Barriers to Learning in Education – Autism is a newly developed teacher assessment to identify and show progress in barriers to learning for pupils on the autism spectrum with coexisting intellectual disabilities. Aims: This study aimed to conduct a preliminary validity and reliability evaluation of the ABLE-Autism. Methods and procedures: Forty-eight autistic pupils attending special schools were assessed using the ABLE-Autism. (...) Multi-level modelling was used to evaluate test-retest reliability, internal consistency and convergent validity with the Teacher Autism Progress Scale. Outcomes and results: Results showed excellent test-retest reliability and internal consistency. A large effect size suggested that the ABLE-Autism is strongly correlated with the Teacher Autism Progress Scale. Teacher feedback was positive and suggested that the ABLE-Autism is easily understood by teachers, relevant to autistic pupils in special schools, and adequately covers the skills and behaviours that teachers believe are important to assess for these pupils. Conclusions and implications: Although further validation is recommended, the preliminary evaluation of the ABLE-Autism suggests that it is a useful and has the potential to be an effective outcome assessment for autistic pupils in special schools. (shrink)

Peter Spirtes, Richard Scheines and Clark Glymour. Simulated Studies of the Reliability of Computer-Aided Model Specification Using the TETRAD, EQS and LISREL Programs.

This volume represents a contribution to the philosophy of economics with a distinctive point of view -- the contributors have selected particular areas of economics and have probed these areas for the philosophical and methodological issues that they raise. The primary essays are written by philosophers concentrating on philosophical issues that arise at the level of the everyday theoretical practice of working economists. Commentary essays are provided by working economists responding to the philosophical arguments from the standpoint of their own (...) disciplines. The volume thus represents something of an `experiment' in the philosophy of science, striving as it does to explore methodological issues across two research communities. The purpose of the volume is very specific: to stimulate a discussion of the epistemology and methodology of economics that works at the level of detail of existing `best practice' in economics today. The contributors have designed their contributions to stimulate productive conversation between philosophers and economists on topics in the methodology of economics. (shrink)

Introduces different interpretations of witness reliability into the models and constructs Bayesian-Network representations. Applies the models to Condorcet-style jury voting and Tversky and Kahneman’s Linda puzzle.

We consider the procedure for small-sample estimation of reliability parameters. The main shortcomings of the classical methods and the Bayesian approach are analyzed. Models that find robust Bayesian estimates are proposed. The sensitivity of the Bayesian estimates to the choice of the prior distribution functions is investigated using models that find upper and lower bounds. The proposed models reduce to optimization problems in the space of distribution functions.

Combining testimonial reports from independent and partially reliable information sources is an important epistemological problem of uncertain reasoning. Within the framework of Dempster–Shafer theory, we propose a general model of partially reliable sources, which includes several previously known results as special cases. The paper reproduces these results on the basis of a comprehensive model taxonomy. This gives a number of new insights and thereby contributes to a better understanding of this important application of reasoning with uncertain (...) and incomplete information. (shrink)

Ockham’s razor is the characteristic scientific penchant for simpler, more testable, and more unified theories. Glymour’s early work on confirmation theory eloquently stressed the rhetorical plausibility of Ockham’s razor in scientific arguments. His subsequent, seminal research on causal discovery still concerns methods with a strong bias toward simpler causal models, and it also comes with a story about reliability—the methods are guaranteed to converge to true causal structure in the limit. However, there is a familiar gap between convergent reliability and (...) scientific rhetoric: convergence in the long run is compatible with any conclusion in the short run. For that reason, Carnap suggested that the proper sense of reliability for scientific inference should lie somewhere between short-run reliability and mere convergence in the limit. One natural such concept is straightest possible convergence to the truth, where straightness is explicated in terms of minimizing reversals of opinion and cycles of opinion prior to convergence. We close the gap between scientific rhetoric and scientific reliability by showing that Ockham’s razor is necessary for cycle-optimal convergence to the truth, and that patiently waiting for information to resolve conflicts among simplest hypotheses is necessary for reversal-optimal convergence to the truth. (shrink)

The aggregation of consistent individual judgments on logically interconnected propositions into a collective judgment on the same propositions has recently drawn much attention. Seemingly reasonable aggregation procedures, such as propositionwise majority voting, cannot ensure an equally consistent collective conclusion. The literature on judgment aggregation refers to such a problem as the \textit{discursive dilemma}. In this paper we assume that the decision which the group is trying to reach is factually right or wrong. Hence, we address the question of how good (...) the various approaches are at selecting the right conclusion. We focus on two approaches: distance-based procedures and a Bayesian analysis. They correspond to group-internal and group-external decision-making, respectively. We compare those methods in a probabilistic model, demonstrate the robustness of our results over various generalizations and discuss their applicability in different situations. The findings vindicate (i) that in judgment aggregation problems, reasons should carry higher weight than conclusions and (ii) that considering members of an advisory board to be highly competent is a better strategy than to underestimate their advice.". (shrink)

‘Responsibilist' approaches to epistemology link knowledge and justification with epistemically responsible belief management, where responsible management is understood to involve an essential element of guidance by recognized epistemic norms. By contrast, reliabilist approaches stress the de facto reliability of cognitive processes, rendering epistemic self-consciousness as inessential. I argue that, although an adequate understanding of human knowledge must make room for both responsibility and reliability, philosophers have had a hard time putting them together, largely owing to a tendency, on the part (...) of responsibilists, to adopt an overly demanding, hyperintellectualized conception of what epistemic responsibility demands. I trace this tendency towards hyper-intellectualism to a wish to meet scepticism head on, a wish that enforces adherence to a particular model of the structure of epistemic justification. I argue that a more humanly reasonable conception of epistemic justification suggests an alternative model. With this model in hand, we can both deflect sceptical problems and combine responsibility with reliability in a satisfying way. Philosophical Papers Vol. 37 (1) 2008: pp. 1-26. (shrink)

This paper aims to defend the Expertise Defense by addressing the problem of disanalogy, which represents one of the two main critiques against this argument. The Expertise Defense is an argument which defends the notion that philosophers’ judgments are more reliable than those of novices by making analogies between philosophy and other fields in which experts’ judgments are given a privileged position. Conventionally, this line of argumentation has aimed to demonstrate that philosophers' intuitions about thought experiments or metaphysical questions (...) are not as susceptible to being distorted by unrelated factors as those of novices. However, this paper reinterprets the Expertise Defense, proposing that it claims that philosophers' intuitions are considerably more reliable than novices, even if they are still susceptible to distorting factors. By adopting this interpretation, the current paper effectively counters the empirical objection that philosophers' intuitions are subject to distortion. Furthermore, I respond to the disanalogy problem, which contends that there is no meaningful analogy between philosophy and other domains because philosophical experience does not contribute significantly to philosophical intuitions. In response to this, I present a new model of philosophical expertise. According to this model, philosophical training plays a vital role in shaping philosophical intuitions by enabling expert philosophers to comprehend philosophical problems accurately and form well-grounded intuitions about them. Additionally, I provide empirical evidence supporting this model, particularly in the context of the debates about free-will. While the extent to which this model can be generalized remains an empirical question, it seems reasonable to think that it could plausibly be extended to other debates. (shrink)

In middle childhood, boys show more avoidant attachments and girls more ambivalent attachments as a prelude to gender differentiation in reproductive strategies. However, we have failed to find systematic and method-independent gender differences in middle or late childhood attachments, nor in adult attachment representations. We conclude that Del Giudice's model rests on a brittle empirical basis.

Given a traditional intuitionist moral epistemology, it is notoriously difficult for moral realists to explain the reliability of our moral beliefs. This has led some to go looking for an alternative to intuitionism. Perception is an obvious contender. I previously argued that this is a dead end, that all moral perception is dependent on a priori moral knowledge. This suggests that perceptualism merely moves the bump in the rug where the reliability challenge is concerned. Preston Werner responds that my account (...) rests on an overly intellectualized model of perception. In this paper, I argue that though Werner may well be correct, my arguments, properly extended, still suggest that perceptualism leaves realists in no better position than intuitionism when it comes to the reliability challenge. (shrink)

Information about the environment is captured in human biological systems on a variety of interacting levels – in distributions of genes, linguistic particulars, concepts, methods, theories, preferences, and overt behaviors. I investigate some of the basic principles which govern such a hierarchy by constructing a comparatively simple three-level selection model of bee foraging preferences and behaviors. The information-theoretic notion of ''''mutual information'''' is employed as a measure of efficiency in tracking a changing environment, and its appropriateness in epistemological applications (...) is discussed at some length. In particular, information accumulated in mid-level preference distributions exhibits suggestive properties for the purposes of naturalistic epistemology. It also appears that the novelty of scientific objects and representations and the rapidity of scientific change relative to genetic change need present no obstacle to the use of such models in explanations of scientific progress and the reliability of scientific judgement. (shrink)

The main aim of this paper is to revisit the curve fitting problem using the reliability of inductive inference as a primary criterion for the ‘fittest' curve. Viewed from this perspective, it is argued that a crucial concern with the current framework for addressing the curve fitting problem is, on the one hand, the undue influence of the mathematical approximation perspective, and on the other, the insufficient attention paid to the statistical modeling aspects of the problem. Using goodness-of-fit as the (...) primary criterion for ‘best', the mathematical approximation perspective undermines the reliability of inference objective by giving rise to selection rules which pay insufficient attention to ‘accounting for the regularities in the data'. A more appropriate framework is offered by the error-statistical approach, where (i) statistical adequacy provides the criterion for assessing when a curve captures the regularities in the data adequately, and (ii) the relevant error probabilities can be used to assess the reliability of inductive inference. Broadly speaking, the fittest curve (statistically adequate) is not determined by the smallness if its residuals, tempered by simplicity or other pragmatic criteria, but by the nonsystematic (e.g. white noise) nature of its residuals. The advocated error-statistical arguments are illustrated by comparing the Kepler and Ptolemaic models on empirical grounds. ‡I am grateful to Deborah Mayo and Clark Glymour for many valuable suggestions and comments on an earlier draft of the paper; estimating the Ptolemaic model was the result of Glymour's prompting and encouragement. †To contact the author, please write to: Department of Economics, Virginia Tech 3019 Pamplin Hall (0316), Blacksburg, VA 24061; e-mail: [email protected]. (shrink)

The author analyses the reliability and accuracy of the results of sociological research conducted using quota sampling. The author discusses the advantages and disadvantages of using quota samples compared to random samples. The main focus is on the representativeness of the obtained data and the possibility of extrapolating them to the general population.In the problem statement, the author noted that a mechanical method of forming a random sample is most often used to study public opinion in Ukraine. The main feature (...) of this method is to ensure an equal probability of selection of each element of the general population. The author emphasizes that although this method allows for easy calculation of possible errors and analysis of collected information, it has a disadvantage in representing specific groups of the population.To address this problem, the author proposes using an equal probability method of forming quota samples, which allows selecting respondents according to their quotas in the general population, thus providing a more representative model of the studied population. However, in the scientific community, there is no consensus on the use of indicators in forming quota samples, and all existing works remain at the level of theoretical assumptions.The author attempts to empirically substantiate the effectiveness of quota samples through experimentation. The hypothesis of the experiment assumes that the results of studies conducted according to quotas can be extrapolated to the general population with high accuracy and reliability using mathematical and statistical methods. During the experiment, both quota and random samples were used to compare the results.The general population consisted of 489 musical compositions represented in different proportions to eliminate the subjective component from the experiment and provide the opportunity to clearly assess and record the parameters of the initial general population for further comparison with the results of different types of samples. The musical compositions had two parameters: the name of the performer for identification and the duration of the track for digital and statistical evaluation. The analysis was carried out using a specially developed program for statistical data analysis. The collected data allowed for the assessment of the average track duration, median, skewness, standard deviation, and other statistical indicators.The results of the experiment showed that the quota sample provides more accurate results when the quotas are followed during the selection of elements of the general population. The sample obtained by random selection without adhering to quotas showed greater variability in indicators such as mean, median, skewness, and standard deviation relative to the general population. Thus, it was concluded that quota samples have advantages in sociological research, especially when specific groups of the population need to be considered.The author emphasizes the need for further research and improvement of quota sampling methods to enhance the accuracy and reliability of sociological studies, which are important for examining particular social issues. (shrink)

Currently, there are no computerized tools enabling objective interpretation of observational gait assessment based on Wisconsin Gait Scale, which is a reliable and well-tested tool. The solution envisaged by us may provide a practical tool for assessing gait deviations in patients with hemiparesis after stroke. The present study assessed agreement between a new application software for computerized WGS and 3-dimensional gait analysis, and reliability of the application. The study involved 33 individuals with hemiparesis after stroke. The software was developed (...) based on a model designed taking into account components of the WGS and incorporating auxiliary lines passing through the relevant anthropometric points on the patient’s body, as well as measurements of angular values, distances and duration of the specific gait phases, which make it possible to substantiate assessment based on this scale. Series of videos were made to record gait of the qualified patients. After the gait evaluation was carried out using the app, the data were retrieved from the software. The gait assessment was performed separately by three independent examiners who reviewed the video recording using the new app twice. Additionally, 3DGA was carried out for all the subjects, and the results of the app-aided assessment were compared to those acquired using 3DGA. The findings show statistically significant correlations between majority of the WGS items measured using the new app, and the relevant spatiotemporal and kinematic parameters identified by 3DGA. Agreement between the scores reported by the three examiners was high in both measurements, as reflected by Cronbach’s alpha exceeding 0.8. The findings reflect very good intra-observer reliability and inter-observer reliability of the new application software for computerized WGS. The opportunities offered by the observational gait scale objectified through our new software for computerized WGS result from the fact that the tool provides a useful low-cost and time-effective feedback to monitor ongoing treatments or formulate hypotheses. (shrink)

Researchers have recently begun to question the specificity and reliability of conflict adaptation effects, also known as sequential congruency effects, a highly cited effect in cognitive psychology. Some have even used the lack of reliability across tasks to argue against models of cognitive control that have dominated the field for decades. The present study tested the possibility that domain-general processes across tasks might appear on more sensitive mouse-tracking metrics rather than overall reaction times. The relationship between SCE effects on the (...) Stroop and Flanker tasks were examined for the first time using a mouse-tracking paradigm. Three main findings emerged: Robust SCEs were observed for both the Stroop and Flanker tasks at the group level, Within-task split-half reliabilities for the SCE across dependent variables were weak at best and non-existent in many cases, and SCEs for the Flanker and Stroop tasks did not correlate with each other for overall reaction times, but did show significant correlations between tasks on more dynamic measures that captured processes before response execution. These findings contribute to the literature by highlighting how mouse-tracking may be a fruitful avenue by which future studies can examine the specificity and reliability of conflict adaptation and tease apart different theoretical models producing the effects. (shrink)

The environmental elbow room model of free will posits the unshared proportion of environmental variance in twins is a measure of the degree to which free will may be exercised with respect to one’s life outcomes for a trait. This model attempts to unify the behavioral genetic study of socially important psychological characteristics such as intelligence and academic achievement with Dennett’s broadly compatibilist elbow room notion of free will. We demonstrate that the philosophy and genetics underlying the environmental (...) elbow room model are both fundamentally flawed. Philosophically the degree to which an outcome might be predicted in a given situation does not give any sense of whether the course of action to achieve an outcome was free or unfree. With respect to genetics, quantities such as heritability and its environmental complement, even when they do reflect the actions of independently identifiable causes are not indicative of the chain of decisions one would have to evaluate to judge if an action was freely chosen. We show the contemporary human behavioral genetics focus on heritability is wholly misplaced for purposes of making decisions about policy and free will alike. Variance components sample a single instance of the distribution of variation arising from different sources and do not constrain outcomes in other contexts. The claim that the high heritability of a trait, life outcomes included, makes us less free to change it is similar in key ways to Jensenism’s contention that high heritability makes social change impossible. (shrink)

A number of important decision domains, including decisions about hiring, global warming, and weather hazards, are characterized by a global–local incompatibility. These domains involve variables that cannot be observed by a single decision maker (DM) and require the integration of observations from locally available information cues. This paper presents a new bifocal lens model that describes how the structure of the environment can lead to a unique form of overconfidence when generalizing the reliability of the local environment to a (...) global scale. When the local environment does not reliably reflect the global environment, they are incompatible. While local perspectives vary across DMs, global–local incompatibility can be understood using the structure of classical test theory as the difference between (a) perceived estimates of the reliability derived from the local environment and (b) the true reliability of the local environment. I model global–local incompatibility as the difference between the true and estimated reliability when the assumptions of classical test theory are violated. Using a series of case studies and an empirical study, I demonstrate the widespread utility of this framework, and I conclude by discussing implications for cognitive–ecological theory, risk communication, and overconfidence. (shrink)

The paper offers a partial vindication of Sterelny’s view on the role of error rates and reliability in his theory of decoupled representation based on modelling techniques borrowed from the biological literature on evolution in stochastic environments. In the case of a tight link between tracking states and behaviour, I argue that in its full generality Sterelny’s account instantiates the base-rate fallacy. With regard to non-tightly linked behaviour, I show that Sterelny’s account can be vindicated subject to an adequate evolutionary (...) model and a suitable notion of reliability. (shrink)

Background: An ethical climate has been described as a working climate embracing shared perceptions about morally correct behaviour concerning ethical issues. Various ethical climate questionnaires have been developed and validated for different contexts, but no questionnaire has been found concerning the ethical climate from an inter-professional perspective in a healthcare context. The Swedish Ethical Climate Questionnaire, based on Habermas’ four requirements for a democratic dialogue, attempts to assess and measure the ethical climate at various inter-professional workplaces. This study aimed to (...) present the construction of and to test the psychometric properties of the Swedish Ethical Climate Questionnaire. Method: An expert group of six researchers, skilled in ethics, evaluated the content validity. The questionnaire was tested among 355 healthcare workers at three hospitals in Sweden. A parallel analysis (PA), an exploratory factor analysis and confirmatory factor analysis were performed. Ethical considerations: The participants included in the psychometric analysis were informed about the study, asked to participate in person and informed that they could withdraw at any time without giving any reason. They were also assured of confidentiality in the reporting of the results. Findings: The parallel analysis (PA) recommended one factor as a solution. The initial exploratory factor analysis with a four-factor solution showed low concordance with a four-factor model. Cronbach’s alpha varied from 0.75 to 0.82; however, since two factors only consisted of one item, alpha could not be reported. Cronbach’s alpha for the entire scale showed good homogeneity (α = 0.86). A confirmatory factory analysis was carried out based on the four requirements and showed a goodness-of-fit after deleting two items. After deletion of these items, Cronbach’s alpha was 0.82. Discussion: Based on the exploratory factor analysis, we suggest that the scale should be treated as a one-factor model. The result indicates that the instrument is unidimensional and assesses ethical climate as a whole. Conclusion: After testing the Swedish Ethical Climate Questionnaire, we found support for the validity and reliability of the instrument. We found the 10-item version of Swedish Ethical Climate Questionnaire satisfactory. However, we found no support for measuring different dimensions and, therefore, this instrument should be seen as assessing ethical climate as of whole. (shrink)

Standard Assessment Tasks are used in the assessment of pupil performance relative to the National Curriculum in England and Wales, assigning pupils to one of 10 levels on various Attainment Targets . This is a criterion‐referenced system, and the conventional reliability measures used in norm‐referenced systems do not apply. This paper discusses the problems involved in aggregating SA T items to give levels, and in measuring the reliability of the outcomes produced. Fitting a simple model to SAT data has (...) allowed reliability measures to be produced which are more relevant to this situation than the single numerical values applied to norm‐referenced tests. (shrink)

The paper addresses the evaluation of climate models and gives an overview of epistemic uncertainties in climate modeling; the uncertainties concern the data situation as well as the causal behavior of the climate system. In order to achieve reasonable results nonetheless, multimodel ensemble studies are employed in which diverse models simulate the future climate under different emission scenarios. The models jointly deliver a robust range of climate prognoses due to a broad plurality of theories, techniques, and methods in climate research; (...) the range reliably indicates the future development of the global climate. Nevertheless, the uncertainties are widely used by skeptics to challenge the IPCC’s prognoses. Such skeptical allegations can well be distinguished from points of fruitful epistemological criticism: in spite of the enduring range of prognoses, the epistemic uncertainties should not play a role in finding agreements on climate change mitigation. (shrink)

Philosophers of memory have approached the relationship between memory and imagination from two very different perspectives. Advocates of the causal theory of memory, on the one hand, have motivated their preferred theory by appealing to the intuitive contrast between successfully remembering an event and merely imagining it. Advocates of the simulation theory, on the other hand, have motivated their preferred theory by appealing to empirical evidence for important similarities between remembering the past and imagining the future. Recently, causalists have argued (...) that simulationism is unable to accommodate the difference between successful remembering and forms of unsuccessful remembering or mere imagining such as confabulating. This paper argues that, while these arguments fail, simulationism, in its current form, is indeed unable to provide a fully adequate account of unsuccessful remembering. Rather than suggesting a return to causalism, the paper proposes a new form of simulationism, a virtue theory of memory modelled not on the process reliabilist epistemology that has so far served as the inspiration for the simulation theory but instead on virtue reliabilist epistemology, and shows that this new theory grounds a more adequate account of unsuccessful remembering. (shrink)

The heightened focus on patient safety and the quality of nursing care in intensive care units underscores the necessity for reliable tools to evaluate nurses’ ethical awareness. This study was aimed to evaluate the psychometric properties of the Turkish version of the Ethical Awareness Scale in a sample of intensive care nurses. Data were collected from 249 intensive care nurses in Türkiye using the Turkish version of the 18-item Ethical Awareness Scale. The data were then analyzed using Rasch analysis. (...) The Turkish version of the Ethical Awareness Scale demonstrated unidimensionality and an acceptable fit for the Rasch model. The person reliability and item reliability were 0.63 and 0.92, respectively. The Turkish version of the Ethical Awareness Scale was found to be a psychometrically valid and reliable instrument for measuring the ethical awareness levels of intensive care nurses. (shrink)