Until social psychology devotes as much attention to construct and external validity as it does to internal validity, the field will continue to produce theories that fail to replicate in the field and cannot be used to meliorate social problems.

Family carers of individual’s living with Huntington’s Disease (HD) manage a distinct and unique series of difficulties arising from the complex nature of HD. This paper presents the validation of the definitive measure of quality of life for this group. The Huntington’s Disease Quality of Life Battery for carers (HDQoL-C) was expanded and then administered to an international sample of 1716 partners and family carers from 13 countries. In terms of the psychometric properties of the tool, exploratory analysis of half (...) of the sample, demonstrated good internal consistency and reliability. Some items on the full version did not meet psychometric thresholds and a short version (HDQoL-Cs) was developed based on more stringent criteria. Confirmatory Factor Analysis of the model structure showed a good fit for all Factors and, indicated that the HDQoL-C and HDQoL-Cs are psychometrically robust measures of quality of life. We found that carers who lived with and looked after their spouse/partner had reduced sense of coping, hope for the future and overall quality of life. Carers with children who were at risk, carried the gene or were symptomatic also had poorer quality of life outcomes. Findings indicated the HDQoL-C and HDQoL-Cs are valid in multiple languages and across varied cultures as measures of self-reported quality of life in family carers of individual’s living with HD. These psychometrically validated tools can aid and guide the implementation of therapeutic interventions to improve life quality in this population. (shrink)

In Persson & Wallin we show that the common claim that internal validity should be understood as prior to external validity has, at least, three epistemologically problematic aspects: experimental artefacts, the implications of causal relations, and how the mechanism is measured. Each aspect demonstrates how important external validity is for the internal validity of the experimental result. This note is an invited summary of these results.

International government and corporate corruption is increasingly under siege. Although various groups of researchers have quantified and documented world-wide corruption, apparently no one has validated the measures. This study finds a very strong significant correlation of three measures of corruption with each other, thereby indicating validity. One measure was of Black Market activity, another was of overabundance of regulation or unnecessary restriction of business activity. The third measure was an index based on interview perceptions of corruption (Corruption Perceptions Index (...) or CPI) in that nation. Validity of the three measures was further established by finding a highly significant correlation with real gross domestic product per capita (RGDP/Cap). The CPI had by far the strongest correlation with RGDP/Cap, explaining over three fourths of the variance.Corruption is increasingly argued to be a barrier to development and economic growth. Business students often do not see ethics courses as being as relevant as other value-free disciplines or core courses. The data in this study suggests otherwise. Sustainable economic development appears very dependent on a constant, virtuous cycle that includes corruption fighting, and the maintenance of trust and innovation, all reinforcing each other. (shrink)

The article identifies a latent debate in the recent literature on the role and worth of experiments in economics and other social sciences concerning the relationship between the external and the internal validity of experimental designs. Our work identifies two incompatible views regarding the relationship between internal and external validity of experiments. While in the methodological literature references to the idea that there is a trade-off between the internal and external validity of experiments abound, (...) this view coexists with the position stating that internal validity is rather a prerequisite of external validity. By identifying the contours of this implicit debate in the recent methodological literature around the use of experiments in the social sciences we call attention upon a series of insufficiently conceptualized issues regarding the central notions of internal and external validity and we question the standard view positing a trade-off between the two. This article stands against common associations of internal validity and external validity with the distinction between field and laboratory experiments and assesses critically the arguments that link the artificiality of experimental settings done in the laboratory with the purported trade-off between internal and external validity. (shrink)

Much of the methodological discussion around experiments in economics and other social sciences is framed in terms of the notions of internal and external validity. The standard view is that internal validity and external validity stand in a relationship best described as a _trade-off_. However, it is also commonly held that internal validity is a _prerequisite_ to external validity. This article addresses the problem of the compatibility of these two ideas and analyzes (...) critically the standard arguments about the conditions under which a trade-off between internal and external validity arises. Our argument stands against common associations of internal validity and external validity with the distinction between field and laboratory experiments and assesses critically the arguments that link the artificiality of experimental settings done in the laboratory with the purported trade-off between internal and external validity. We conclude that the idea of a trade-off or tension between internal and external validity seems, upon analysis, far less cogent than its intuitive attractiveness may lead us to think at first sight. (shrink)

This paper develops an account of rigour in the use of thought experiments in ethics. I argue that there are two separate challenges to be faced. The first is internal validity: is the thought experiment designed in a way that allows its readers to make judgements that are confident and free of bias about the hypothesis or point of principle that it aims to test? The second is external validity: to what extent do ethical judgements that are (...) correct of the world of the thought experiment generalize to a wide variety of other contexts, including ethical decision-making in the actual world? Ensuring external validity is the harder and more important problem of rigour, yet it is one that few philosophers have even noticed, let alone begun to solve. (shrink)

This article replicates a U.S. study of marketing norms in an international setting. The dimensionality and reliability of the scales are tested in the U.S., Singapore and South Africa. Support is found for the use of the scales, as modified. The norms of the current respondents are compared with those of the original U.S. respondents and each other. Differences between the three countries are found with respect to general honesty and integrity norms, but not for specific marketing-related norms. Differences between (...) the original study results and the current findings are assessed in terms of methodological and substantive factors. (shrink)

This study assessed the International Critical Thinking Essay Test (ICTET-A) for inter-rater reliability, internal reliability, and criterion validity. A self-selecting sample of participants (N = 100) completed the ICTET-A and a comparison test online. We found the ICTET-A items to have moderate to good levels of inter-rater reliability, and overall excellent inter-rater consistency for total test scores. The test had good internal reliability. There was a strong correlation between scores on the ICTET-A and the comparison test. Factor (...) analysis showed that scores were best explained with one factor, suggesting the test measures a single construct. The ICTET-A can therefore be considered a valid measure of critical thinking. Additionally, we propose a short form of the test. (shrink)

Weight stigma internalization among adolescents across weight categories leads to adverse psychological consequences. This study aims to adapt and validate a Chinese version of the Weight Bias Internalization Scale for Mainland Chinese children and adolescents. A total of 464 individuals aged 9 to 15 years participated in the present study. Based on item response theory and classical test theory, we selected the items for the C-WBIS and evaluated its reliability and validity. The item response theory yields support for the (...) one-dimensional factor mode. All item parameters fit the IRT model, eight items were adopted. No evidence of significant differential item functioning was found for gender and age groups. The C-WBIS was correlated with the Core Self-Evaluation Scale and two subscales of the Social Anxiety Scale for Children, which indicated an acceptable criterion-related validity. The C-WBIS is a reliable and valid measure that can be used as a psychometrically sound and informative tool to assess weight bias internalization among children and adolescents. (shrink)

According to a classical work on experimental design internal validity “refers to the approximate validity with which we infer that a relationship between two variables is causal or that the absence of a relationship implies the absence of cause”. External validity “refers to the approximate validity with which we can infer that the presumed causal relationship can be generalized to and across alternate measures of the cause and effect and across different types of persons, settings, (...) and times”. Since then, these have been the accepted definitions, with slight variations, of both concepts. However, there have been deep differences in interpreting the scope and limits of validity concepts in economics. From theory-driven experimental designs that defend the priority of the internal over the external validity to those researches that are demanding the importance of external validity in economics, we can find the most diverse points of view. What can experimental ethics learn, then, from recent debates on external and internal validity in experimental economics? If we want to elicit moral intuitions into the lab, are we testing moral theories that way? Could intuitions be generalized “across different types of persons, settings, and times”? Is that really possible? (shrink)

Researchers often aim to make correct inferences both about that which is actually studied and about what the results generalize to. The language of internal and external validity is not used by everyone, but many of us would agree that intuitively the distinction makes a lot of sense. Two claims are commonly made with respect to internal and external validity. The first is that internal validity is prior to external validity since there is (...) nothing to generalize if the findings obtained in, for instance, the experimental setting do not hold. The first claim is explicit in many writings. See for instance Francisco Guala’s influential book The methodology of experimental economics. And it is often implicitly relied on. The second claim is that researchers have to make a trade-off between internal and external validity. When one is increased, the other will decrease. The second claim was made already from the start by D.T Campbell in his classic Factors relevant to the validity of experiments in social settings. There is a certain tension between the first and the second claim. It has been argued before that it might be difficult to combine them. We intend to make the stronger point that both claims are misconstrued. Our hypothesis is that the relationship between internal and external validity has to be re-conceptualized, and we will briefly indicate how. (shrink)

Cross-cultural comparisons often investigate values that are assumed to have long-lasting influence on human conduct and thought. To capture and compare cultural values across cultures, Geert Hofstede's Cultural Dimensions Theory has offered an influential framework. Hofstede also provided a survey instrument, the Values Survey Module (VSM), for measuring cultural values as outlined in his Cultural Dimensions Theory. The VSM has since been subject to a series of revisions. Yet, data on countries have been derived from the original VSM — and (...) not on one of the revised versions of VSM. We tested three scales (indulgence, power distance, and individualism) from the latest version, the VSM 2013, as part of a larger survey across 57 countries. Two main findings emerged. For one thing, country scores based on the VSM 2013 scales correlated only weakly with country scores of the same cultural dimensions obtained in a large previous study. Thus, the validity of the VSM 2013 is in doubt. For another thing, the internal consistency of the VSM 2013 scales was overall poor, indicating that the scales did not reliably measure well-defined constructs. We discuss implications for cross-cultural research. (shrink)

This study explored the evidence of validity of internal structure of the 12-item Functional Assessment of Chronic Illness Therapy—Spiritual Wellbeing Scale in Brazilian adolescents with chronic health conditions. The study involved 301 Brazilian adolescents with cancer, type 1 diabetes mellitus, or cystic fibrosis. Exploratory Factor Analysis, Confirmatory Factor Analysis, and Item Response Theory were used to test the internal structure. Reliability was determined with Cronbach’s Alpha and McDonald’s Omega. The EFA suggested a one-dimensional scale structure in contrast (...) to the original 2-factor model or the 3-factor model which were not reproduced in the current CFA. All quality indicators for the EFA one-factor exceeded the required criteria. The FACIT-Sp-12 for adolescents yielded strong evidence for a 1-factor model and with good reliability. (shrink)

Background: Moral courage as a part of nurses’ moral competence has gained increasing interest as a means to strengthen nurses acting on their moral decisions and offering alleviation to their moral distress. To measure and assess nurses’ moral courage, the development of culturally and internationally validated instruments is needed. Objective: The objective of this study was to validate the Dutch-language version of the four-component Nurses’ Moral Courage Scale originally developed and validated in Finnish data. Research design: This methodological study used (...) non-experimental, cross-sectional exploratory design. Participants and research context: A total of 559 nurses from two hospitals in Flanders, Belgium, completed the Dutch-language version of the Nurses’ Moral Courage Scale. Ethical considerations: Good scientific inquiry guidelines were followed throughout the study. Permission to translate the Nurses’ Moral Courage Scale was obtained from the copyright holder, and the ethical approval and permissions to conduct the study were obtained from the participating university and hospitals, respectively. Findings: The four-component 21-item, Dutch-language version of the Nurses’ Moral Courage Scale proved to be valid and reliable as the original Finnish Nurses’ Moral Courage Scale. The scale’s internal consistency reliability was high (0.91) corresponding with the original Nurses’ Moral Courage Scale validation study (0.93). The principal component analysis confirmed the four-component structure of the original Nurses’ Moral Courage Scale to be valid also in the Belgian data explaining 58.1% of the variance. Confirmatory factor analysis based on goodness-of-fit indices provided evidence of the scale’s construct validity. The use of a comparable sample of Belgian nurses working in speciality care settings as in the Finnish study supported the stability of the structure. Discussion and conclusion: The Dutch-language version of the Nurses’ Moral Courage Scale is a reliable and valid instrument to measure nurses’ self-assessed moral courage in speciality care nursing environments. Further validation studies in other countries, languages and nurse samples representing different healthcare environments would provide additional evidence of the scale’s validity and initiatives for its further development. (shrink)

The experimental revolution in the social sciences is one of the most significant methodological shifts undergone by the field since the ‘quantitative revolution’ in the nineteenth century. One of the often valued features of social science experimentation is precisely the fact that there are clear methodological rules regarding hypothesis testing that come from the methods of the natural sciences and from the methodology of RCTs in the biomedical sciences, and that allow for the adjudication among contentious causal claims. We examine (...) critically this claim and argue that some current understandings of the practices that surround social science experimentation overestimate the degree to which experiments can actually fulfil this role as “objective” adjudicators, by neglecting the importance of shared background knowledge or assumptions and of consensus regarding the validity of the constructs involved in an experiment. We take issue with the way the distinction between internal and external validity is often used to comment on the inferential import of experiments, used both among practitioners and among philosophers of science. We describe the ways in which the more common use of the internal/external distinction differs from Cook and Campbell’s original methodological project, in which construct validity and the four-fold validity typology were all important in assessing the inferential import of experiments. We argue that the current uses of the labels internal and external, as applied to experimental validity, help to encroach a simplistic view on the inferential import of experiments that, in turn, misrepresents their capacity to provide objective knowledge about the causal relations between variables. (shrink)

Workplace Incivility (WI) occurs worldwide and has negative consequences on individuals and organizations. Valid and comprehensive instruments have been used, specifically in English speaking countries, to measure such adverse process at work, but it is not available a validated instrument for research carried out in Spanish speaking countries. In this study we aim to test the psychometric properties of the Matthews and Ritter’s four-item Workplace Incivility Scale (2016) with Spanish workers (N= 407) from different sectors. Participants’ mean age was 38.73 (...) (SD= 10.45) years old and the percentage of female employees was 59.2%. Confirmatory factor analysis using AMOS 19.0 was carried out, presenting a good fit. The internal consistency, convergent and concurrent validity of the scale were examined. Results show good scale reliability and expected high correlations with social undermining. Moreover, the scale related to propensity to leave a job, job satisfaction, and psychological well-being in the expected way. After configural invariance across groups was established, testing for metric invariance and scalar invariance was performed. Considering Δχ² and ΔCFI tests for two nested models, the 4-item scale was invariant when the employment status is considered (permanent vs temporal, full-time vs part-time and supervisor vs non supervisors). Overall, our findings showed good psychometric properties of the shorter version of the Workplace Incivility Scale in Spain. Theoretical and practical implications of this study are discussed. (shrink)

Ethical decision making measures are widely applied as the principal dependent variable used in studies of research integrity. However, evidence bearing on the internal and external validity of these measures is not available. In this study, ethical decision making measures were administered to 102 graduate students in the biological, health, and social sciences, along with measures examining exposure to ethical breaches and the severity of punishments recommended. The ethical decision making measure was found to be related to exposure (...) to ethical events and the severity of punishments awarded. The implications of these findings for the application of ethical decision making measures are discussed. (shrink)

This study examined the validity and reliability of a Turkish version of the Modified Moral Sensitivity Questionnaire for Student Nurses. After obtaining permission to adapt the MMSQSN into Turkish, the translation/back-translation method was used with expert opinions to determine content validity. Factor analysis was conducted to examine the construct validity and test–retest was performed on the questionnaire to determine reliability. Cronbach’s alpha coefficients were calculated to assess for internal consistency. Participants included 272 baccalaureate degree student nurses (...) who took ethics lessons prior to their clinical internship. The factor analysis revealed that even though the factor structure in the original scale was the same, relevant items were categorized with similar components, and factor loads were sufficient. The correlation coefficient in the analyses of test–retest scores was.66 for the total scale and the Cronbach’s alpha was.73 for the total scale. The translated MMSQSN is a valid and reliable measure of ethical sensitivity in student nurses in Turkey. (shrink)

Discussions of reproducibility are casting doubts on the credibility of experimental outcomes in the life sciences. Although experimental evolution is not typically included in these discussions, this field is also subject to low reproducibility, partly because of the inherent contingencies affecting the evolutionary process. A received view in experimental studies more generally is that standardization (i.e., rigorous homogenization of experimental conditions) is a solution to some issues of significance and internal validity. However, this solution hides several difficulties, including (...) a reduction of external validity and reproducibility. After explaining the meaning of these two notions in the context of experimental evolution, we import from the fields of animal research and ecology and suggests that systematic heterogenization of experimental factors could prove a promising alternative. We also incorporate into our analysis some philosophical reflections on the nature and diversity of research objectives in experimental evolution. (shrink)

Introduction:The concept of mentalizing is nowadays widely used in research as well as in clinical practice. Despite its popularity, the development of an economic assessment is still challenging. The Mentalization Scale appears to be a promising measurement with good psychometric properties but lacking convergent validity with the Reflective Functioning Scale.Objective:This study aims to test the construct validity of the Mentalization Scale through correlations with the gold standard, the Reflective Functioning Scale, within a clinical sample. Furthermore, it was of (...) interest to replicate its internal consistency.Methods:Twenty-six inpatients of an acute psychiatric ward in Vienna were given the Mentalization Scale (MentS). They were interviewed with the Brief Reflective Function Interview, which was coded with the Reflective Functioning Scale. Correlations and internal consistency were calculated.Results:Concerning the primary aim of this study, the validity was satisfactory for the MentS whole-scale mentalizing as well as for the subscales self- and other-oriented mentalizing. Internal consistency was lower to the findings of the developer and close to the 0.70 threshold.Conclusion:Our findings could foster the psychometric properties of the MentS. Furthermore, the MentS seems to be a promising measurement tool for detecting different dimensions of reflective functioning. Limitations and further research are discussed. (shrink)

A commonplace misconception identifies Kelsen as a one-dimensional legal positivist and Habermas as a one-dimensional legal moralist. I argue, on the contrary, that both theorists defend a complex normative conception of democratic proceduralism that straddles the positivism/naturalism divide. I then show how their extension of this conception to international law commits them to a monistic human rights regime. I conclude that their realistic acknowledgment of the fragmented nature of legal paradigms and regimes entails a complementary qualification of their monism. Section (...) 10.1 situates Kelsen and Habermas’s proceduralism between natural law reasoning and formal positivism in opposition to Schmitt’s political-theological defense of decisionism. Section 10.2 compares the different methods by which Kelsen and Habermas defend democratic proceduralism. Section 10.3 shows how they extend this conception to international law in defending a monistic human rights regime. Section 10.4 discusses their respective views about the decisive role played by courts and constitutional review in this regime, and critically examines their proceduralist understanding of constitutional review. Section 10.5 concludes with an assessment of the limits and possibilities of constitutionalizing humanitarian law in international law in the face of persistent legal pluralization. (shrink)

Using data from four different samples of full-time employees (Ntotal = 2,474), the present study was aimed to introduce and demonstrate the validity and reliability of the Organizational-Based General Self-esteem Scale (OB-GSE) a new six-item self-report scale to measure organizational-based self-esteem (OBSE) at work. Results provided evidence of (1) validity (internal, external, and convergent), (2) reliability, and (3) temporal stability of the OB-GSE scale. All in all, results attested the usefulness and the effectiveness of the OB-GSE scale.

Background: Moral courage is required at all levels of nursing. However, there is a need for development of instruments to measure nurses’ moral courage. Objectives: The objective of this study is to develop a scale to measure nurses’ self-assessed moral courage, to evaluate the scale’s psychometric properties, and to briefly describe the current level of nurses’ self-assessed moral courage and associated socio-demographic factors. Research design: In this methodological study, non-experimental, cross-sectional exploratory design was applied. The data were collected using Nurses’ (...) Moral Courage Scale and analysed statistically. Participants and research context: The data were collected from a convenience sample of 482 nurses from four different clinical fields in a major university hospital in Finland for the final testing of the scale. The pilot comprised a convenience sample of 129 nurses. Ethical considerations: The study followed good scientific inquiry guidelines. Ethical approval was obtained from the university ethics committee and permission to conduct the study from the participating hospital. Findings: Psychometric evaluation showed that the 4-sub-scale, 21-item Nurses’ Moral Courage Scale demonstrates good reliability and validity at its current state of development showing a good level of internal consistency for a new scale, the internal consistency values ranging from 0.73 to 0.82 for sub-scales and 0.93 for the total scale, thus well exceeding the recommended Cronbach’s alpha value of >0.7. Principal component analysis and confirmatory factor analysis supported the theoretical construct of Nurses’ Moral Courage Scale. Face validity and expert panel assessments markedly contributed to the relevance of items in establishing content validity. Discussion and conclusion: Nurses’ Moral Courage Scale provides a new generic instrument intended for measuring nurses’ self-assessed moral courage. Recognizing the importance of moral courage as a part of nurses’ moral competence and its assessment offers possibilities to develop interventions and educational programs for enhancement of moral courage. Research should focus on further validation measures of Nurses’ Moral Courage Scale in international contexts. (shrink)

Professionals in business and law, healthcare providers, educators, policymakers, consumers, and higher education practitioners value ethical reasoning skills. Because of this, we concentrated campus-wide reaccreditation efforts to help students actively engage in ER. In doing so, we re-conceptualized the ER process, implemented campus-wide ER interventions designed to be experienced by all undergraduate students, and created the ethical reasoning identification test to measure students’ ability to engage in a foundational step in the ER process. Using factor analysis, we demonstrated internal (...) validity evidence for ERIT scores. More specifically, confirmatory factor analysis provided support for a unidimensional factor structure, meaning stakeholders can report and analyze ERIT total scores. The unidimensional factor structure was replicated using two independent samples. Across all samples, ERIT scores demonstrated reliability consistent with professional standards. In addition, we collected external validity evidence for ERIT scores. The ERIT was sensitive to slight differences in ER training. That is, students experiencing a 75-min intervention performed better on the test compared to students without this experience. Overall, results suggested that our ER intervention may effectively increase students ER abilities and the ERIT demonstrated great potential for assessing foundational ethical reasoning skills. To further examine validity, researchers should consider known groups analyses with varying “doses” of the ER intervention, as well as measurement invariance studies. (shrink)

This paper examines the properties of the validity and scope of arguments as standards for evaluating the epistemic qualities of particular deliberative exchanges within a context of value pluralism where parties can hold differing views of the common good based on incommensurable basic values. In this context, the task of political decisions is to maximise the interests of all, only judging between internally coherent versions of the common good on the basis of their mutual impact. The paper argues open, (...) democratic, deliberation provides the best chance of discovering such a path, through developing mutual understanding across incommensurable positions. Identifying the validity and scope of a deliberative exchange enhances this potential. Any deliberative exchange may be characterised in terms of its validity – the reasons that support its conclusions – and scope – the unquestioned assumptions that mark the boundaries of that reasoning. The paper explains the epistemic role of these two features in developing understanding across plural positions. Clarity about the validity of an exchange reveals positions that can be shared. Acknowledgement of its scope avoids over-extending its conclusions and reveals how positions differ, providing the starting point for further deliberation about their co-ordination. The paper ends by drawing the conclusion that deliberation characterised in this way should be democratic and open. (shrink)

This article describes the development of a computerized version of a measure of ethical sensitivity to racial and gender intolerance, the Racial Ethical Sensitivity Test. The REST was based on James Rest's 4-component model of moral development and the professional codes of ethics from school-based professions. The new version, Racial and Ethical Sensitivity Test-Compact Disk, consists of 5 videotaped scenarios followed by an interactive "interview" presented on compact discs. Data from a study with 58 students provides initial validation of the (...) REST-CD. Ethical sensitivity to racial and gender intolerance in schools, as measured by the REST-CD, was moderately related to attitudes toward racial and gender equity issues in society as measured by the Quick Discrimination Index. The results provide evidence for both interrater and internal reliability of the REST-CD scores. This study also tests the hypothesized relationship between REST-CD scores and previous multicultural and ethics course work. Students with multicultural and ethics course experience have scored significantly higher on the REST-CD than students without course work. The paper-and-pencil tests are not significantly related to previous ethics/multicultural course work. In this article, we discuss the implications of the results and directions for future research. (shrink)

Objective: to develop and test the factorial structure of a new self-determination theory-based measure of behavioral regulation in children. Method: 590 (F = 51.7%) children aged 7-11 years completed the Motivation to Exercise and Diet (MED-C) questionnaire, which comprises 16 items (8 for exercise and 8 for diet) grouped into eight-factors (5 motivations and 3 needs). Psychometric testing included confirmatory factor analysis and internal consistency. Measurement invariance analyses were also performed to evaluate whether the factorial structure of the MED-C (...) was equivalent for gender (male vs. female), age ( 10yo) and the perception of having at least one parent with overweight or obesity (yes vs. no). Results: factorial analysis confirmed an acceptable factors solution for the MED-C and a good fit to the data for both the exercise and the diet subscales assessed independently. The Maximal Reliability coefficient revealed good reliability for the exercise and the diet subscales. Moreover, the MED-C factor structure was invariant across group comparisons. Discussion: findings support the construct validity and reliability of the MED-C. Therefore, it represents the first validated instrument simultaneously measuring motivational regulation and psychological need satisfaction in the context of children’s exercise and diet. Considering the goodness of these results, scale percentile ranks of the total score distribution as well as the z-score and the T-score were provided for clinical and research purposes. Conclusion: The MED-C might support the understanding of motivations and needs of children with weight problems and assist their process of behavioural change in primary and secondary prevention programs. Psychological factors represent, in fact, potential targets for interventions to increase children’s motivation to exercise and diet. (shrink)

The importance of self-regulated learning has increased during the COVID-19 pandemic and measures for assessing students’ self-regulation skills and knowledge are greatly needed. We present the results of the first thorough adaptation of the Children’s Perceived use of Self-Regulated Learning Inventory. The inventory, consisting of 15 scales measuring nine components of SRL, was administered to a sample of 541 Slovenian ninth graders. Confirmatory factor analyses supported internal structure validity of most components, but two components required some structural modifications. (...) Internal consistency coefficients were acceptable for the majority of scale scores and were highly comparable to the original ones. While metric invariance across gender was confirmed, the scalar invariance of some scales needs further examination. Meaningful correlations with relevant externally assessed and self-reported self-regulation and school performance variables indicated good criterion validity of the inventory. The Slovenian version of the CP-SRLI thus proved to be a sufficiently valid and reliable instrument for assessing pupils’ learning self-regulation. (shrink)

Cognitive load theory has been widely used to help understand the process of learning and to design teaching interventions. The Cognitive Load Scale developed by Leppink and colleagues has emerged as one of the most validated and widely used self-report measures of intrinsic load, extraneous load, and germane load. In this paper we investigated an expansion of the CLS by using a multidimensional conceptualization of the EL construct that is relevant for physical and online teaching environments. The Multidimensional Cognitive Load (...) Scale for Physical and Online Lectures goes beyond the CLS's operationalization of EL by expanding the EL component which originally included factors related to instructions/explanations with sub-dimensions including EL stemming from noises, and EL stemming from both media and devices within the environment. Through three studies, we investigated the reliability, and internal and external validity of the MCLS-POL using the Partial Credit Model, Confirmatory Factor Analysis, and differences between students either attending a lecture physically or online. The results of Study 1 provide initial evidence for the validity and reliability of the MCLS-POL within a higher education sample, but also highlighted several potential improvements which could be made to the measure. These changes were made before re-evaluating the validity and reliability of the measure in a new sample of higher education psychology students, and psychological testing students. Together the studies provide evidence for a multidimensional conceptualization cognitive load and provide evidence of the validity, reliability, and sensitivity of the MCLS-POL and provide suggestions for future research directions. (shrink)

BackgroundHealth-related quality of life is known to be impaired in individuals with coronary artery disease, especially in those after a recent acute coronary syndrome. Heart failure is a common burden in this population that significantly contributes to worsening HRQoL. To accurately measure the level of HRQoL in individuals with CAD after ACS, disease-specific scales, such as the Minnesota living with heart failure questionnaire, are recommended. Nevertheless, to date, there has not been a study that would comprehensively evaluate the psychometric properties (...) of the MLHFQ in a large sample of individuals with CAD after ACS. The debate regarding the internal structure of MLHFQ is also still present. Hence, this study aimed to translate the MLHFQ and evaluate its internal structure, reliability/precision, and validity in individuals with CAD following ACS in Lithuania.MethodsIn the cross-sectional study, 1,083 participants were evaluated for sociodemographic and clinical characteristics. HRQoL was measured using the MLHFQ and the Short Form-36 health survey. In addition, exercise capacity was also evaluated in the study patients, using a standardized computer-driven bicycle ergometer.ResultsThe internal consistency of the MLHFQ subscales was found to be good. Confirmatory factor analysis provided the support for the three-factor model of the MLHFQ and showed acceptable fit [comparative fit indices = 0.894; goodness-of-fit = 0.898; non-normal fit index = 0.879, and root mean square error of approximation = 0.073]. Regarding convergent evidence, significant associations were found between the MLHFQ domains and the SF-36 domains and EC.ConclusionThe current study completed cultural validation and provided further information on the psychometric characteristics of the MLHFQ in Lithuania, suggesting MLHFQ as a valid and reliable instrument to measure HRQoL. The Lithuanian version of MLHFQ is best described by a three-factor solution, measuring physical, social, and emotional dimensions of HRQoL among individuals with CAD following ACS. (shrink)

BackgroundThe purpose of this study is to assess the psychometric properties of the French version of the Positivity scale (P scale), a self-report measure of positivity, which is the tendency to view and address life and experience with a positive outlook. Positivity is seen as a latent factor underlying multiple cognitive concepts such as self-esteem, life satisfaction, and optimism.MethodsWe recruited 666 volunteers (540 women and 126 men). They completed the P scale online, as well as self-report measures of psychological well-being, (...) self-esteem, satisfaction with life, general health, and personality dimensions. The study sample was randomly split into two sub-groups, one used for exploratory factor analysis and the other for confirmatory factor analysis.ResultsWe found conflictual results related to the uni-dimensionality of the French version of the P scale. We found good internal consistency and high concurrent validity.ConclusionThe French version of the P scale demonstrated good psychometric qualities and is a reliable tool that can now be used by French researchers and clinicians to assess positivity. (shrink)

In response to the severe lack of leadership assessment tools in the Chinese context, the Service Leadership Behavior Scale was developed based on the Service Leadership Model proposed by Po Chung, the co-founder of DHL International. Utilizing responses from 4,486 Hong Kong undergraduates, this paper reports the findings of a validation study on the Short-Form Service Leadership Behavior Scale (SLB-SF-65). Previous findings based on exploratory factor analysis revealed a six-factor 48-item solution (SLB-SF-48). With the removal of ten items, confirmatory factor (...) analysis showed that the final 38-item scale (SLB-SF-38) possessed excellent psychometric properties and factorial stability based on multigroup invariance analyses. The SLB-SF-38 also exhibited excellent reliability and convergent validity. Overall speaking, the present study underscored the utility of the SLB-SF-38 as an objective assessment instrument of service leadership behavior in the education, research and personnel training contexts. (shrink)

Exposure to pesticides during infancy is associated with numerous adverse health outcomes. The assessment of knowledge and perception of pesticides exposure and risk among children has not been thoroughly studied. The aim of the study was to evaluate the reliability and validity of a questionnaire that measures the knowledge and perception of exposure to organophosphate pesticides among rural schoolchildren. The questionnaire was administered to 151 schoolchildren between 9 and 13years from four Chilean rural schools. An internal consistency analysis (...) of the ordinal alpha coefficient and a polychoric factor analysis for categorical data were used. The results show that the ordinal alpha was 0.95. Polychoric matrices of rotated components show the 17 questions summarized pesticide knowledge in five factors extracted after promax rotation. This factorial model explains 56.3% of the variance. The questions were grouped as follows: knowledge about pesticides ; knowledge of health effects related to pesticides exposure ; pesticide exposure through the growing of fruits and vegetables ; perception and action against pesticides exposure at school ; and perception and action against pesticides exposure at home. The questionnaire provides a useful tool for examining pesticide exposure in agricultural regions, allowing younger community members to participate. (shrink)

The extent to which people anticipate and are influenced by the potential future consequences of their current behavior is called Consideration of Future Consequences. A well-established tool to measure this construct is the 14-item Consideration of Future Consequences Scale. The CFC-14 has shown appropriate psychometric properties in several languages. This scale comprises two factors: the CFC-Immediate and the CFC-Future. The main goal of this study was to assess the psychometric properties and internal consistency of the CFC-14 Scale in Spanish, (...) using an Argentine sample. A secondary goal was to determine its convergent validity with impulsivity, and determine differences across gender and age groups. Using a web-based survey, we collected data from 512 participants aged 13-74 years. Confirmatory Factor Analysis showed a 2-factor model as the best solution for 13-items version. Standardized regression weights ranged from.50 to.66 for CFC-F and between.43 and.83 for CFC-I. Composite reliability was also adequate: CFC-F achieve? =.80 and CFC-I? =.82. There were no differences across gender and age. The CFC-F subscale and UPPS-P subscales correlations, were negative and significant, highlighting the negative and moderate correlation between CFC-F and the lack of premeditation, a dimension strictly related to intertemporal decisions making. Thus, CFC-14 has adequate psychometric properties in an Argentinian population, although more studies are necessary to determine the robustness of these findings. (shrink)

Background: nursing students are required to think reflectively in both real and simulated clinical practice. Although the Reflective Thinking instrument is reliable in its measurement of reflective thinking, its validity is unknown. Method: confirmatory factor analysis was undertaken in an iterative manner within a non-equivalent control-group study to measure nursing students’ reflective thinking and satisfaction with high-fidelity simulation. The validity and reliability of the Reflective Thinking instrument was tested. Results: the resulting instrument consisted of 15 items across four (...) factors. The final model was plausible as it demonstrated ‘goodness of fit’; however, it had neither convergent or discriminatory validity, nor reliability. Internal consistency was fair to reasonable for the four subscales. Conclusion: the testing of the Reflective Thinking instrument using confirmatory factor analysis is a vital initial step in the modification of this instrument. Further development using exploratory factor analysis will enhance the instrument’s relevance within high-fidelity simulation. (shrink)

Many semantic theories become trivial when extended with a naïve validity predicate due to the validity paradoxes. The non-classical semantic theories are the ones that allegedly preserve the naïveté of the validity predicate while being capable of avoiding the validity paradoxes. This blocking, on the other hand, usually comes at a high cost. In this paper, we argue that the pre-theoretical notion of validity that the naïve validity predicate intends to capture is unattainable.

Roger Shepard's proposals and supporting experiments concerning evolutionary internalized regularities have been very influential in the study of vision and in other areas of psychology and cognitive science. This paper examines issues concerning the need, nature, explanatory role, and justification for postulating such internalized constraints. In particular, I seek further clarification from Shepard on how best to understand his claim that principles of kinematic geometry underlie phenomena of motion perception. My primary focus is on the ecological validity of Shepard's (...) kinematic constraint in the context of ordinary motion perception. First, I explore the analogy Shepard draws between internalized circadian rhythms and the supposed internalization of kinematic geometry. Next, questions are raised about how to interpret and justify applying results from his own and others' experimental studies of apparent motion to more everyday cases of motion perception in richer environments. Finally, some difficulties with Shepard's account of the evolutionary development of his kinematic constraint are considered. Key Words: apparent motion; circadian rhythms; constraints; ecological validity; evolution; internalizated regularities; kinematic principle. (shrink)

Stress in health care is affected by moral factors. When people are prevented from doing ‘good’ they may feel that they have not done what they ought to or that they have erred, thus giving rise to a troubled conscience. Empirical studies show that health care personnel sometimes refer to conscience when talking about being in ethically difficult everyday care situations. This study aimed to construct and validate the Stress of Conscience Questionnaire (SCQ), a nine-item instrument for assessing stressful situations (...) and the degree to which they trouble the conscience. The items were based on situations previously documented as causing negative stress for health care workers. Content and face validity were established by expert panels and pilot studies that selected relevant items and modified or excluded ambiguous ones. A convenience sample of 444 health care personnel indicated that the SCQ had acceptable validity and internal consistency (Cronbach’s alpha exceeded 0.83 for the overall scale). Explorative factor analysis identified and labelled two factors: ‘internal demands’ and ‘external demands and restrictions’. The findings suggest that the SCQ is a concise and practical instrument for use in various health care contexts. (shrink)

The Gratitude Questionnaire-Six Item Form (GQ-6; McCullough et al., 2002) is a well-established instrument for measuring gratitude. Recently, the Multi-Component Gratitude Measure (MCGM) was developed as a more holistic approach (Morgan et al., 2017). While the GQ-6 mainly focuses on the emotional component of gratitude, the MCGM encompasses conceptual, attitudinal and behavioral aspects. As of today, there is no validated German measure for gratitude. In order to close that research gap, the present study focused on validating the German versions of (...) the GQ-6 (GQ-6-G) and of the MCGM (MCGM-G). In addition, multi-group comparisons were conducted to test for cultural measurement invariance. Construct validity was tested similar to original validation studies of the two scales focusing on affect, well-being, empathy, anxiety and depression. The online survey was completed in random order by 508 participants. The one-factor model of the GQ-6-G and the hierarchical structure of the MCGM-G could be replicated. However, model fit of the Gratitude Questionnaire was significantly better after eliminating one item (GQ-5-G). Multi-group comparisons revealed cultural measurement invariance was established for the GQ-5-G and partial measurement invariance for five of six factors of the MCGM-G, respectively. Reliability analyses revealed good internal consistency for both instruments and measures for criterion-related and discriminant validity have shown hypothesized relationships. Thus, the GQ-5-G and the MCGM-G are two instruments with good reliability and validity for measuring gratitude in Germany. (shrink)

International criminal law (ICL) is an achievement, but at the same time a challenge to the traditional conception of the principle of legality (_lex praevia_, _scripta_, and _stricta_ – Sect. 1). International criminal tribunals have often based conviction for international crimes on unwritten norms the existence and scope of which they have failed to substantiate. In so doing, they have evaded the objection that they were applying _ex post facto_ criminal laws. This approach, the relaxation of the concept of law (...) by including norms whose existence is doubtful, has apparently served to maintain a concept of strict legality, but it is unsatisfying (Sect. 2). In my opinion, the strict principle of legality that has linked its absolute validity to the positivity of law is not the correct premise. It makes sense to state that positivity and validity do not necessarily go hand in hand (Sect. 3). Applied to ICL, this means that it is neither necessary nor convincing to “conceal” supra-positive law as positive law, as some decisions of the international criminal tribunals do. For this reason, I consider that Radbruch’s formula, consisting in admitting that there are supra-positive limits which positive law must respect in order to be valid, is well-founded (Sect. 4). The path taken by this significant philosopher of law is methodologically convincing, and it squarely faces the problem of the value of positive law. Nevertheless, if we admit Radbruch’s formula and thereby the limited value of positive law (if we claim that the validity of the law depends on it respecting supra-positive minimums of justice), we must also face the problem of the definition of supra-positive values, the epistemological difficulties of having access to them (Sect. 5), and the question of the scope and enforceability of supra-positive law (Sect. 6). In summary, this article aims to explain why Radbruch’s formula offers a convincing conceptual basis for international criminal legality and, in doing so, aims to contribute to the discussion about the foundations of ICL. (shrink)

Development and targeting efforts by academic organizations to effectively promote research integrity can be enhanced if they are able to collect reliable data to benchmark baseline conditions, to assess areas needing improvement, and to subsequently assess the impact of specific initiatives. To date, no standardized and validated tool has existed to serve this need. A web- and mail-based survey was administered in the second half of 2009 to 2,837 randomly selected biomedical and social science faculty and postdoctoral fellows at 40 (...) academic health centers in top-tier research universities in the United States. Measures included the Survey of Organizational Research Climate (SORC) as well as measures of perceptions of organizational justice. Exploratory and confirmatory factor analyses yielded seven subscales of organizational research climate, all of which demonstrated acceptable internal consistency (Cronbach’s α ranging from 0.81 to 0.87) and adequate test–retest reliability (Pearson r ranging from 0.72 to 0.83). A broad range of correlations between the seven subscales and five measures of organizational justice (unadjusted regression coefficients ranging from 0.13 to 0.95) document both construct and discriminant validity of the instrument. The SORC demonstrates good internal (alpha) and external reliability (test–retest) as well as both construct and discriminant validity. (shrink)

This book represents a unique endeavor to elucidate the story of Kosovo's unilateral quest for statehood. It is an inquiry into the international legal aspects and processes that shaped and surrounded the creation of the state of Kosovo. Being created outside the post-colonial context, Kosovo offers a unique yet controversial example of state emergence both in the theory and practice of creation of states. Accordingly, the book investigates the legal pathways, strategies, developments and policy positions of international agencies/actors and regional (...) players (in particular the EU) that helped Kosovo to establish its independence and gradually acquire statehood. Although contested, Kosovo, and its quest for statehood, represents a unique example of successful unilateral secession. The book therefore explores and analyses patterns of state formation and nation-building in Kosovo, and its transition to democracy. It presents a three-level assessment. First, seen from a historical perspective, the book examines the validity of the right of Kosovar-Albanians to self-determination and remedial secession. Second, from a legal positivist perspective, it scrutinizes all of the legalist arguments that support Kosovo's right to statehood, and claims that both traditional and legality-based criteria for statehood remain insufficient to determine whether Kosovo has achieved statehood. Third, from a post-factum perspective, the book analyzes the scope and extent to which the internationally blended element was decisive in Kosovo's state-formation and state-building processes. It explains how the EU's involvement as an 'internationally blended element' in Kosovo's efforts to achieve statehood was instrumental and played a crucial role in shaping the emerging state. In particular, the book elaborates on how the EU was able to streamline its mode of intervention in the context of state-building and reform. (shrink)

Background: Nurses, social workers, and medical residents are ethically mandated to engage in policy advocacy to promote the health and well-being of patients and increase access to care. Yet, no instrument exists to measure their level of engagement in policy advocacy. Research objective: To describe the development and validation of the Policy Advocacy Engagement Scale, designed to measure frontline healthcare professionals’ engagement in policy advocacy with respect to a broad range of issues, including patients’ ethical rights, quality of care, culturally (...) competent care, preventive care, affordability/accessibility of care, mental healthcare, and community-based care. Research design: Cross-sectional data were gathered to estimate the content and construct validity, internal consistency, and test–retest reliability of the Policy Advocacy Engagement Scale. Participants and context: In all, 97 nurses, 94 social workers, and 104 medical residents (N = 295) were recruited from eight acute-care hospitals in Los Angeles County. Ethical considerations: Informed consent was obtained via Qualtrics and covered purposes, risks and benefits; voluntary participation; confidentiality; and compensation. Institutional Review Board approval was obtained from the University of Southern California and all hospitals. Findings: Results supported the validity of the concept and the instrument. In confirmatory factor analysis, seven items loaded onto one component with indices indicating adequate model fit. A Pearson correlation coefficient of.36 supported the scale’s test–retest stability. Cronbach’s α of.93 indicated strong internal consistency. Discussion: The Policy Advocacy Engagement Scale demonstrated satisfactory psychometric properties in this initial test. Findings should be considered within the context of the study’s limitations, which include a low response rate and limited geographic scope. Conclusion: The Policy Advocacy Engagement Scale appears to be the first validated scale to measure frontline healthcare professionals’ engagement in policy advocacy. With it, researchers can analyze variations in professionals’ levels of policy advocacy engagement, understand what factors are associated with it, and remedy barriers that might exist to their provision of it. (shrink)