Grand challenges stress the importance of multi-disciplinary research, a multi-actor approach in examining the current state of affairs and exploring possible solutions, multi-level governance and policy coordination across geographical boundaries and policy areas, and a policy environment for enabling change both in science and technology and in society. The special nature of grand challenges poses certain needs in evaluation practice: the need for learning at the operational, policy and, especially, system level; and the importance of a wider set (...) of impacts and behavioural change. The examination of the usefulness of evaluations as learning tools thus becomes relevant as does the way current evaluation practices address broader impacts and issues such as behavioural additionality. The suitability of existing evaluation contexts in meeting the specific issues posed by the ‘grand challenges’ orientation is also worth examining. The paper argues that learning at the policy and system levels is largely unaddressed while concepts such as behavioural additionality are still underexploited. (shrink)

Investing in research is a long-term, risky proposition. In agriculture, it could take fifteen years or more for a research finding to show an improvement in a farmer’s field. Yet, research institutions, like other organizations it needs to be evaluated. For more than twenty years, independent panels of outside experts have evaluated each of the international research centers that the Consultative Group of International Agricultural Research (CGIAR) supports. This paper examines the evolution of this review (...) system, outlines the key methodological challenges faced, and draws lessons for others engaged in evaluating research institutions. It notes that the scope of the CGIAR reviews have been broadened over time in response to users’ concerns. Reviews now cover four dimensions of performance: research results, quality and relevance of research, vision and strategic directions, and management efficiency. The methodological challenges faced in measurement, valuation, and attribution are reviewed, along with practices found to be helpful in addressing these concerns. The paper concludes that the panel approach to institutional evaluation has served CGIAR’s needs well, and recommends it as an evaluation technique for integrating quantitative and qualitative dimensions of institutional performance. (shrink)

Evaluation of clinical ethical case consultations has been discussed as an important research task in recent decades. A rigid framework of evaluation is essential to improve quality of consultations and, thus, quality of patient care. Different approaches to evaluate those services appropriately and to determine adequate empirical endpoints have been proposed. A key challenge is to provide an answer to the question as to which empirical endpoints—and for what reasons—should be considered when evaluating the quality of a (...) service. In this paper, we argue for an approach that adopts the role of ethics consultants as its point of departure. In a first step, we describe empirical and ethical characteristics of evaluating clinical ethical case. We show that the mode of action and the explicit normative character of the interventions constitute two characteristics which pose challenges to the selection of appropriate quality criteria and require special attention. In a second step, we outline the way in which an analysis of the role of ethics consultants in the context of a clinical ethical case consultation services can account for the existing challenges by linking empirically measurable endpoints with normative theory. Finally, we discuss practical implications of our model for evaluation research. (shrink)

Critical Thinking : A Methodology for Interpreting Information 'deconstructs' common errors in thinking and teaches students to become smarter consumers of research results. Written to complement a textbook or a collection of readings, this brief methods book strengthens students' ability to interpret information whenever and wherever data are used. It includes a wide range of examples along with end of chapter exercises for further discussion. This book will be a coursebook for the undergraduate social science courses where critical thinking, (...) numeracy, and data literacy are common learning objectives"--Provided by publisher. (shrink)

The basic hypothesis tested in the article is that the existence of Freedom of Information legislation in a state enhances utilization of evaluation research. The investigation of this research question leads to a tentative rejection of this hypothesis. Factors such as weak Freedom of Information Acts, unsympathetic implementation, and the lack of useful and timely information in agency-sponsored evaluations may discourage legislatures from actively using Freedom of Information provisions to obtain such studies.

Background Despite recent developments aimed at creating international guidelines for ethical global health research, critical disconnections remain between how global health research is conducted in the field and the institutional ethics frameworks intended to guide research practice. Discussion In this paper we attempt to map out the ethical tensions likely to arise in global health fieldwork as researchers negotiate the challenges of balancing ethics committees’ rules and bureaucracies with actual fieldwork processes in local contexts. Drawing from our (...) research experiences with an implementation and evaluation project in Jamaica, we argue that ethical research is produced through negotiated spaces and reflexivity practices that are centred on relationships between researchers and study participants and which critically examine issues of positionality and power that emerge at multiple levels. In doing so, we position ethical research practice in global health as a dialectical movement between the spoken and unspoken, or, more generally, between operationalized rules and the embodied relational understanding of persons. Summary Global health research ethics should be premised not upon passive accordance with existing guidelines on ethical conduct, but on tactile modes of knowing that rely upon being engaged with, and responsive to, research participants. Rather than focusing on the operationalization of ethical practice through forms and procedures, it is crucial that researchers recognize that each ethical dilemma encountered during fieldwork is unique and rooted in social contexts, interpersonal relationships, and personal narratives. (shrink)

Background: Black, Asian and minority ethnic groups have a high need for organ transplantation but deceased donation is low. This restricts the availability of well-matched organs and results in relatively long waiting times for transplantation, with increased mortality risks. Objective: To identify barriers to organ donor registration and family consent among the BAME population, and to develop and evaluate a training intervention to enhance communication with ethnic minority families and identify impacts on family consent. Methods: Three-phase programme comprising community-based (...) class='Hi'>research involving two systematic reviews examining attitudes and barriers to organ donation and effective interventions followed by 22 focus groups with minority ethnic groups; hospital-based research examining staff practices and influences on family consent through ethics discussion groups with staff, a study on intensive care units and interviews with bereaved ethnic minority families; and development and evaluation of a training package to enhance cultural competence among ICU staff. Setting: Community focus group study in eight London boroughs with high prevalence of ethnic minority populations. Hospital studies at five NHS hospital trusts. Participants: Community studies: 228 focus group participants; hospital studies: 35 nurses, 28 clinicians, 19 hospital chaplains, 25 members of local Organ Donation Committees, 17 bereaved family members; and evaluation: 66 health professionals. Data sources: Focus groups with community residents, systematic reviews, qualitative interviews and observation in ICUs, EDGs with ICU staff, bereaved family interviews and questionnaires for trial evaluation. Review methods: Systematic review and narrative synthesis. Results: Community studies: Organ Donor Register – different ethnic/faith and age groups were at varying points on the ‘pathway’ to organ donor registration, with large numbers lacking knowledge and remaining at a pre-contemplation stage. Key attitudinal barriers were uncertainties regarding religious permissibility, bodily concerns, lack of trust in health professionals and little priority given to registration, with the varying significance of these factors varying by ethnicity/faith and age. National campaigns focusing on ethnic minorities have had limited impact, whereas characteristics of effective educational interventions are being conducted in a familiar environment; addressing the groups’ particular concerns; delivery by trained members of the lay community; and providing immediate access to registration. Interventions are also required to target those at specific stages of the donation pathway. Hospital studies: family consent to donation – many ICU staff, especially junior nurses, described a lack of confidence in communication and supporting ethnic minority families, often reflecting differences in emotional expression, faith and cultural beliefs, and language difficulties. The continuing high proportion of family donation discussions that take place without the collaboration of a specialist nurse for organ donation reflected consultants’ views of their own role in family consent to donation, a lack of trust in SNODs and uncertainties surrounding controlled donations after circulatory death. Hospital chaplains differed in their involvement in ICUs, reflecting their availability/employment status, personal interests and the practices of ICU staff. Evaluation: professional development package – a digital versatile disk-based training package was developed to promote confidence and skills in cross-cultural communication. Initial evaluation produced positive feedback and significant affirmative attitudinal change but no significant difference in consent rate over the short follow-up period with requirements for longer-term evaluation. Limitations: Participants in the focus group study were mainly first-generation migrants of manual socioeconomic groups. It was not permitted to identify non-consenting families for interview with data regarding the consent process were therefore limited to consenting families. Conclusions: The research presents guidance for the effective targeting of donation campaigns focusing on minority ethnic groups and provides the first training package in cultural competence in the NHS. Future work: Greater evaluation is required of community interventions in the UK to enhance knowledge of effective practice and analysis of the experiences of non-consenting ethnic minority families. Funding: The National Institute for Health Research Programme Grants for Applied Research programme. (shrink)

Original research is of course what scientists are expected to do. Therefore the research project is in many ways the unit of science in the making: it is the center of the professional life of the individual scientist and his coworkers. It is also the means towards the culmination of their specific activities: the original publication they hope to contribute to the scientific literature. The scientific project should therefore be of central interest to all the students of science, (...) particularly the philosophers and sociologists of science. We shall focus on the preliminary evaluation of research projects—the specific task of referees—and will emphasize the problem of their scientificity—the chief concern of scientific gatekeepers. In the past such an examination aimed only at protecting the taxpayer from swindlers and incompetent amateurs, such as the inventors of continuous motion artifacts. In recent times a similar issue has resurfaced with regard to some of the most prestigious and most handsomely funded projects, namely work on string theory and many-worlds cosmology. Indeed, some of their faithful have claimed that these theories are so elegant, and so full of high-grade mathematics, that they should be exempted from empirical tests. This claim provoked the spirited rebuttal of the well-known cosmologists Ellis and Silk, which the present paper is intended to reinforce. Indeed, we shall try to show why empirical testability is necessary though insufficient for a piece of work to qualify as scientific. Finally, the present paper may also be regarded as an indirect contribution to the current debate over the reliability of quantitative indicators of scientific worth, such as the h-index of scientific productivity. But we shall touch only tangentially on the sociological, political, and economics of research teams: our focus will be the acquisition of new scientific knowledge. (shrink)

The concept of public participation is one of growing interest in the UK and elsewhere, with a commensurate growth in mechanisms to enable this. The merits of participation, however, are difficult to ascertain, as there are relatively few cases in which the effectiveness of participation exercises have been studied in a structured manner. This seems to stem largely from uncertainty in the research community as to how to conduct evaluations. In this article, one agenda for conducting evaluation (...) class='Hi'>research that might lead to the systematic acquisition of knowledge is presented. This agenda identifies the importance of defining effectiveness and of operationalizing one’s definition. The article includes analysis of the nature of past evaluations, discussion of potential difficulties in the enactment of the proposed agenda, and discussion of some potential solutions. (shrink)

In order to fully implement the new development concept, bring into full play the potential of sports development, and maintain the resilience of China’s sports development. This paper studies the resilience evaluation and spatial correlation of Chinese sports development under the new development concept. First, we constructed Resilience Evaluation Indexes System for Sports Development in China based on the analysis of the resilience features of sports development and the DPSIR model, which is from the five aspects of “driving (...) force – pressure – state – influence – response.” Second, used Coefficient of Variation and Technique for Order Preference by Similarity to an Ideal Solution Method to measure the resilience level of sports development in 31 provinces in China from 2013 to 2017. Then, we introduced the obstacle degree model to identify the obstacle factors that hinder the resilience of Chinese sports development in different periods. Finally, we used the global and local Moran indexes to analyze the spatial correlation of China sports regional development. The results showed that: overall, the development level of sports resilience in 31 provinces in China showed an upward trend from 2013 to 2017, while some provinces showed obvious fluctuations. The obstacles to the development of sports resilience in China mainly include sports scientific research equipment, the number of national fitness monitoring stations, the number of national fitness centers, the full-time equivalent of personnel, and the number of sports scientific research projects. The response subsystem is the main obstacle factor that affects the improvement of the resilience level of sports development in China. There is a positive spatial autocorrelation between the resilience level of sports development and regional spatial distribution, and the correlation shows a weakening trend, and the internal difference is significant. Finally, we concluded that we must take the new development philosophy as the guiding principle. First, we should stick to innovation-driven development to fully upgrade the resilience of China’s sports development. Second, we should adhere to the principle of coordinated development to promote the overall and balanced development of sports. Lastly, we should promote shared development so as to deliver benefits for all in an equal way. (shrink)

This article advocates for the validity of Realist Evaluation (RE) as a manifestation of Critical Realism in evaluation research despite criticisms suggesting that the former disregards principles from Bhaskarian ontology. Specifically, I argue that critics overstate RE's philosophical actualism in their argument that its inclination towards technocratic knowledge impedes its scrutiny of stratified social systems. Notwithstanding its limitations in fully elucidating causal structural mechanisms in social inquiry, I argue that RE's research rationale can contribute to the (...) stages of explanatory research based on CR by bridging the comprehension of mechanisms linked to micro-interventions with exploring potential structural forces operating across levels of reality. To illustrate this point, I present a case of a policy evaluation study I led that demonstrates how a RE-oriented research design facilitated a transition from investigating specific programme mechanisms within the interventions' context to proposing transcendental questions about the governance of the education system in Colombia. (shrink)

The current process towards formalization within evaluation research, in particular the use of pre-set standards and the focus on predefined outcomes, implies a shift of ownership from the people who are actually involved in real clinical ethics support services in a specific context to external stakeholders who increasingly gain a say in what ‘good CESS’ should look like. The question is whether this does justice to the insights and needs of those who are directly involved in actual CESS (...) practices, be it as receivers or providers. We maintain that those actually involved in concrete CESS practices should also be involved in its evaluation, not only as respondents, but also in setting the agenda of the evaluation process and in articulating the criteria by which CESS is evaluated. Therefore, we propose a participatory approach to CESS evaluation. It focuses on the concrete contexts in which CESS takes place, reflective and dialogical learning processes, and how to be democratic and inclusive. In particular, this approach to CESS evaluation is akin to realist evaluation, dialogical evaluation, and responsive evaluation. An example of a participatory approach to evaluating CESS is presented and some critical issues concerning this approach are discussed. (shrink)

BackgroundCommunity engagement in research has gained momentum as an approach to improving research, to helping ensure that community concerns are taken into account, and to informing ethical decision-making when research is conducted in contexts of vulnerability. However, guidelines and scholarship regarding community engagement are arguably unsettled, making it difficult to implement and evaluate.DiscussionWe describe normative guidelines on community engagement that have been offered by national and international bodies in the context of HIV-related research, which set the (...) stage for similar work in other health related research. Next, we review the scholarly literature regarding community engagement, outlining the diverse ethical goals ascribed to it. We then discuss practical guidelines that have been issued regarding community engagement. There is a lack of consensus regarding the ethical goals and approaches for community engagement, and an associated lack of indicators and metrics for evaluating success in achieving stated goals. To address these gaps we outline a framework for developing indicators for evaluating the contribution of community engagement to ethical goals in health research.SummaryThere is a critical need to enhance efforts in evaluating community engagement to ensure that the work on the ground reflects the intentions expressed in the guidelines, and to investigate the contribution of specific community engagement practices for making research responsive to community needs and concerns. Evaluation mechanisms should be built into community engagement practices to guide best practices in community engagement and their replication across diverse health research settings. (shrink)

A team of philosophers and scientists at Dartmouth College worked for three years to create, train faculty and pilot test an adequate and exportable class in research methods for graduate students of science and engineering. Developing and testing methods for evaluating students’ progress in learning research ethics were part of the project goals. Failure of methods tried in the first year led to the refinement of methods for the second year. These were used successfully in the pilot course (...) and in one university setting external to Dartmouth. The process of development and justification for the final methods are discussed here. (shrink)

BackgroundAmidst expanding roles in education and policy making, questions have been raised about the ability of Clinical Ethics Committees (CEC) s to carry out effective ethics consultations (CECons). However recent reviews of CECs suggest that there is no uniformity to CECons and no effective means of assessing the quality of CECons. To address this gap a systematic scoping review of prevailing tools used to assess CECons was performed to foreground and guide the design of a tool to evaluate the quality (...) of CECons.MethodsGuided by Levac et al’s (2010) methodological framework for conducting scoping reviews, the research team performed independent literature reviews of accounts of assessments of CECons published in six databases. The included articles were independently analyzed using content and thematic analysis to enhance the validity of the findings.ResultsNine thousand sixty-six abstracts were identified, 617 full-text articles were reviewed, 104 articles were analyzed and four themes were identified – the purpose of the CECons evaluation, the various domains assessed, the methods of assessment used and the long-term impact of these evaluations.ConclusionThis review found prevailing assessments of CECons to be piecemeal due to variable goals, contextual factors and practical limitations. The diversity in domains assessed and tools used foregrounds the lack of minimum standards upheld to ensure baseline efficacy.To advance a contextually appropriate, culturally sensitive, program specific assessment tool to assess CECons, clear structural and competency guidelines must be established in the curation of CECons programs, to evaluate their true efficacy and maintain clinical, legal and ethical standards. (shrink)

While some form of evaluation has always been employed in science (e.g. peer review, hiring), formal systems of evaluation of research and researchers have recently come to play a more prominent role in many countries because of the adoption of new models of governance. According to such models, the quality of the output of both researchers and their institutions is measured, and issues such as eligibility for tenure or the allocation of public funding to research institutions (...) crucially depends on the outcomes of such measures. However, concerns have been raised over the risk that such evaluation may be threatening epistemic pluralism by penalizing the existent heterodox schools of thought and discouraging the pursuit of new ones. It has been proposed that this may happen because of epistemic bias favouring mainstream research programmes. In this paper, I claim that (1) epistemic pluralism is desirable and should be preserved; (2) formal evaluation exercises may threaten epistemic pluralism because they may be affected by some form of epistemic bias; therefore, (3) to preserve epistemic pluralism, we need some strategy to actively dampen epistemic bias. (shrink)

The Qur’an was formed into the book and took the name muṣḥaf during the caliphate of Abu Bakr. Naturally, this muṣḥaf, recorded with the script of the period, was subjected to various arrangements over time in terms of its script and form. Activities such as the dots that help to separate letters from each other, lines that make the movements specific, the intervals (fāṣila) separating the verses from each other and the punctuations can be mentioned among them. In this article, (...) it is discussed when, by whom and for what reason the verse numbers were formed for the first time as separate digits, either in the interlude marks that were added to the muṣḥaf over time and used to separate the verses from each other or at the beginning or end of the verses. In this context, the aim is not to discuss the issue of determining the number of verses, but try to reveal the date and purpose of writing the numbers of the Qur’anic verses, the number of which is already known, in the muṣḥaf. In the research, carried out by data collection, analysis and evaluation method, some of accessible manuscripts and printed muṣhafs will be reviewed and the history and historical background of the writing of verse numbers in the muṣḥaf will be tried to be explored. As a result, it has been achieved that Abraham Hinckelmann was the first person who added the number of all verses to muṣḥaf in 1694. (shrink)

Evaluation of clinical ethics support services (CESS) has attracted considerable interest in recent decades. However, few evaluation studies are explicit about normative presuppositions which underlie the goals and the research design of CESS evaluation. In this paper, we provide an account of normative premises of different approaches to CESS evaluation and argue that normativity should be a focus of considerations when designing and conducting evaluation research of CESS. In a first step, we present (...) three different approaches to CESS evaluation from published literature. Next to a brief sketch of the well-established approaches of ‘descriptive evaluation’ and ‘evaluation of outcomes’, we will give a more detailed description of a third approach to evaluation—‘reconstructing quality norms of CESS’—which is explicit about the normative presuppositions of its research (design). In the subsequent section, we will analyse the normative premises of each of the three approaches to CESS evaluation. We will conclude with a brief argument for more sensitivity towards the normativity of CESS and its evaluation research. (shrink)

The National Health Service in the United Kingdom categorises research and research-like activities in five ways, such as ‘service evaluation’, ‘clinical audit’, ‘surveillance’, ‘usual practice’ and ‘research’. Only activities classified as ‘research’ require review by the Research Ethics Committees. It is argued, in this position paper, that the current governance of research and research-like activities does not provide sufficient ethical oversight for projects classified as ‘service evaluation’. The distinction between the categories (...) of ‘research’ and ‘service evaluation’ can be a grey area. A considerable percentage of studies are considered as non-research and therefore not eligible to be reviewed by the Research Ethics Committee, which scrutinises research proposals rigorously to ensure they conform to established ethical standards, protecting research participants from harm, preserving their rights and providing reassurance to the public. This article explores the ethical discomfort potentially inherent in the activity currently labelled as ‘service evaluation’. (shrink)

This article investigates whether or not theories of justice from political philosophy, first, support the position that health research should contribute to justice in global health, and second, provide guidance about what is owed by international clinical research (ICR) actors to parties in low- and middle-income countries. Four theories—John Rawls's theory of justice, the rights-based cosmopolitan theories of Thomas Pogge and Henry Shue, and Jennifer Ruger's health capability paradigm—are evaluated. The article shows that three of the four theories (...) require the conduct of health research for justice in global health. The theories help identify the ends of justice to which ICR is to contribute, but they cannot tell us how to organize ICR to promote these ends. Aside from Ruger's health capability paradigm, the theories also lack an allocative principle for assigning specific duties to specific actors. This creates difficulties for establishing obligations for certain types of ICR actors. (shrink)

Research agendas and academic evaluation are inevitably linked. By means of economic incentives, promotion, research funding, and reputation academic evaluation is a powerful influence on the production of knowledge; moreover, it is often conceived as a universal instrument without consideration of the context in which it is applied. Evaluation systems are social constructions in dispute, being the current focus of international debates regarding criteria, indicators, and their associated methods. A universalist type of productivity indicators is (...) gaining centrality in academic evaluation with profound effects on the content of research that is conducted everywhere. Specifically, evaluation systems based on this type of indicators are sending negative signals to scientists willing to conduct research on contextualized agendas, particularly those negotiated with non scientists. On the basis of theoretical and empirical studies documented on the specialized literature and extensive personal engagement with university research policy in Uruguay, we argue that the consolidation of evaluation practices of alleged universal validity deteriorates and discourages a type of research which is undeniably important in developing contexts. (shrink)

This article explores issues in the evaluation of research through an examination of the situation in the field of international development. It is increasingly recognized that traditional evaluation, which served largely a policing function, is not useful in assessing the impact of the development research process. It is argued that the role and perception of evaluation must change if it is to provide a reflection of the learning which takes place in research. The field (...) of international development research provides a rich ground in which to explore the argument. The field is subject to the difficulties of evaluating research and to the difficulties of evaluating development—in both cases, we are dealing with long time frames and the influence of many factors other than the activity itself. If evaluation is to serve a learning function, then the shift must be to a purpose ofempowerment. This article explores the changes which are implicit in such a shift through an examination of three key areas: changing perspectives on evaluation; changing patterns in development; and changing patterns in research for development. (shrink)

The new field of meta-research investigates industry bias, publication bias, contradictions between studies, and other trends in medical research. I argue that its findings should be used as meta-evidence for evaluating therapies. ‘Meta-evidence’ is evidence about the support that direct ‘first-order evidence’ provides the hypothesis. I consider three objections to my proposal: the irrelevance objection, the screening-off objection, and the underdetermination objection. I argue that meta-research evidence works by rationally revising our confidence in first-order evidence and, consequently, (...) in the hypothesis—typically, downward. (shrink)

The subject of journal quality has received little attention in the business ethics literature. While there are reasons for this past neglect, there are important new considerations which make it vital that researchers now address this topic. First, virtually all business school departments use evaluations of journal quality as an important indicator of scholarly achievement, yet business ethics has no such studies. Second, as many schools are beginning to ask ethicists to publish in the wider management literature, it is important (...) to find a way to compare journal quality across these domains. In the absence of such studies, performance review committees (including tenure decisions) may well make incorrect inferences about journal quality within business ethics or assume that ethics journals are not prestigious unless a candidate can provide evidence to the contrary (i.e. as in a study like this one). This study addresses these two issues. It relies on an opinion-based survey to establish journal quality by incorporating a list of journals within business ethics and the wider management literature. The target population is active business ethics researchers within the Society for Business Ethics (SBE). We present the results of the study and discuss their implications. (shrink)

A systematic literature review on evaluation of clinical ethics support services in mental healthcare is presented and discussed. The focus was on (a) forms of clinical ethics support services, (b) evaluation of clinical ethics support services, (c) contexts and participants and (d) results. Five studies were included. The ethics support activities described were moral case deliberations and ethics rounds. Different qualitative and quantitative research methods were utilized. The results show that (a) participants felt that they gained an (...) increased insight into moral issues through systematic reflection; (b) there was improved cooperation among multidisciplinary team members; (c) it was uncertain whether clinical ethics support services led to better patient care; (d) the issue of patient and client participation is complex; and (e) the implementation process is challenging. Clinical ethics support services have mainly been studied through the experiences of the participating facilitators and healthcare professionals. Hence, there is limited knowledge of whether and how various types of clinical ethics support services influence the quality of care and how patients and relatives may evaluate clinical ethics support services. Based on the six excluded ‘grey zone articles’, in which there was an implicit focus on ethics reflection, other ways of working with ethical reflection in practice are discussed. Implementing and evaluating clinical ethics support services as approaches to clinical ethics support that are more integrated into the development of good practice are in focus. In order to meet some of the shortcomings of the field of clinical ethics support services, a research project that aims to strengthen ethics support in the mental health services, including patients’ and caregivers’ views on ethical challenges, is presented. (shrink)

Biomedical research on humans is an important part of medical progress. But, when lives are at risk, safety and ethical practices need to be the top priority. The need for the committees that regulate and oversee such research -- institutional review boards, or IRBs -- is growing. IRB members face difficult decisions every day. Evaluating the Science and Ethics of Research on Humans is a guide for new and veteran members of IRBs that will help them better (...) understand the issues involved and the tasks they will be required to perform. The most important purpose of an IRB is to protect the lives of human participants. For three major research areas -- drugs, medical devices, and genetic information -- Dennis J. Mazur shares the methods he has found useful in protecting human participants through the systematic review of scientific protocols and informed consent forms and through adherence to the federal regulations that apply. New members will gain understanding of how proposed research projects are to be reviewed from both scientific and ethical dimensions, how and when to ask key questions of principal investigators, how to work with principal investigators and research teams to ensure the best protection of human participants, and why to schedule regularly spaced reviews of a project that may have adverse outcomes. Based on Mazur's thirty years of research experience, this accessible and informative guide will give all IRB members the tools they need to protect human lives and facilitate the research process. (shrink)

This article addresses the question how philosophy should be evaluated in a research-grant funding environment. It offers a new conception of philosophy that is inclusive and builds on familiar elements of professional, philosophical practice. Philosophy systematically questions the questions we ask, the concepts we use, and the values we hold. Its product is therefore rarely conclusive but can be embodied in everything we do. This is typical of explorative research and differentiates it from exploitative research, which constitutes (...) the bulk of funded research activity. This article argues that exploratory research is crucial for long-term progress and requires a distinct evaluative regime. (shrink)

La bibliografía reporta amplitud en lo concerniente al campo de la edición de revistas científicas donde los avances científico tecnológicos aportaron una nueva dinámica. Las nuevas tecnologías de la información y la comunicación sirven de herramientas y han transformado radicalmente el escenario de la evaluación de la publicación científica. Variedad de perspectivas, instrumentos e indicadores impactan en los procesos de evaluación. El objetivo de este trabajo es ofrecer una valoración del proceso actual de evaluación de las publicaciones científicas seriadas. Los (...) procedimientos utilizados son la revisión bibliográfica, análisis de textos y síntesis de los hallazgos desde lo teórico. Se concluye que la publicación científica seriada ha pasado a ser, más que un proceso singular de la comunicación científica, el modo fundamental de evaluación de la calidad del trabajo científico, de ahí la importancia de tener claridad y propuestas propias de los indicadores de la evaluación. There is amplitude in bibliography, regarding the edition of scientific journals, where the scientific technological achievements that have been made in recent times have contributed with a new dynamic. The edition in digital format has its name due to the appearance of the new information and communication technologies. The recently emerged perspectives, instruments and indicators impact evaluation of publications processes and the accreditation in the higher education. The aim of this document is to offer an assessment on the current situation of the evaluation process of serialized scientific publications through the use of indicators. The text analysis and bibliographic review procedures were used to achieve the previous goal. In conclusion, the serialized scientific publications have become the main way quality of scientific research evaluation rather than a specific process of scientific communication. That is why is important to be certain of the combination of indicators for evaluating the scientific publications. (shrink)

BackgroundThis study aims to quantitatively and qualitatively evaluate the activities of a Bioethics Unit (BU) 5 years since its implementation (2016–2020). The BU is a research unit providing empirical research on ethical issues related to clinical practice, clinical ethics consultation, and ethical education for health care professionals (HPS).MethodsWe performed an explanatory, sequential, mixed-method, observational study, using the subsequent qualitative data to explain the initial quantitative findings. Quantitative data were collected from an internal database and analyzed by descriptive analysis. (...) Qualitative evaluation was performed by semi-structured interviews with 18 HPs who were differently involved in the BU’s activities and analyzed by framework analysis.ResultsQuantitative results showed an extensive increment of the number of BU research projects over the years and the number of work collaborations with other units and wards. Qualitative findings revealed four main themes, concerning: 1. the reasons for contacting the BU and the type of collaboration; 2. the role of the bioethicist; 3. the impact of BU activities on HPs, in terms of developing deeper and more mature thinking; 4. the need to extend ethics support to other settings. Overall, our results showed that performing both empirical bioethics research and more traditional clinical ethics activities at the same unit would produce an impetus to increase collaboration and spread an 'ethical culture' among local HPs.ConclusionsOur findings contribute to a growing body of literature on the models of clinical ethics support services and the role of empirical research in bioethics internationally. They also prepare the ground for the implementation of a multidisciplinary Clinical Ethics Committee (CEC) that aims to support the BU’s ethics consultation service within the local context. (shrink)

Previous research suggested a role of gaze in preference formation, not merely as an expression of preference, but also as a causal influence. According to the gaze cascade hypothesis, the longer subjects look at an item, the more likely they are to develop a preference for it. However, to date the connection between viewing and liking has been investigated predominately with self-paced viewing conditions in which the subjects were required to select certain items from simultaneously presented stimuli on the (...) basis of perceived visual attractiveness. Such conditions might promote a default, but non-mandatory connection between viewing and liking. To explore whether the connection is separable, we examined the evaluative processing of single naturalistic food images in a 2 x 2 design, conducted completely within subjects, in which we varied both the type of exposure (self-paced versus time-controlled) and the type of evaluation (non-exclusive versus exclusive). In the self-paced exclusive evaluation, longer viewing was associated with a higher likelihood of a positive evaluation. However, in the self-paced non-exclusive evaluation, the trend reversed such that longer viewing durations were associated with lesser ratings. Furthermore, in the time-controlled tasks, both with non-exclusive and exclusive evaluation, there was no significant relationship between the viewing duration and the evaluation. The overall pattern of results was consistent for viewing times measured in terms of exposure duration (i.e., the duration of stimulus presentation on the screen) and in terms of actual gaze duration (i.e., the amount of time the subject effectively gazed at the stimulus on the screen). The data indicated that viewing does not intrinsically lead to a higher evaluation when evaluating single food images; instead, the relationship between viewing duration and evaluation depends on the type of task. We suggest that self-determination of exposure duration may be a prerequisite for any influence from viewing time on evaluative processing, regardless of whether the influence is facilitative. Moreover, the purported facilitative link between viewing and liking appears to be limited to exclusive evaluation, when only a restricted number of items can be included in a chosen set. (shrink)

Toulmin’s scheme for the layout of arguments (1958, The Uses of Argument, Cambridge University Press, Cambridge) represents an influential tool for the analysis of arguments. The scheme enriches the traditional premises-conclusion model of arguments by distinguishing additional elements, like warrant, backing and rebuttal. The present paper contains a formal elaboration of Toulmin’s scheme, and extends it with a treatment of the formal evaluation of Toulmin-style arguments, which Toulmin did not discuss at all. Arguments are evaluated in terms of a (...) so-called dialectical interpretation of their assumptions. In such an interpretation, an argument’s assumptions can be evaluated as defeated, e.g., when there is a defeating reason against the assumption. The present work builds on recent research on defeasible argumentation (cf. e.g. the work of Pollock, Reiter, Loui, Vreeswijk, Prakken, Hage and Dung). More specifically, the author’s work on the dialectical logic DEFLOG and the argumentation tool ARGUMED serve as starting points. (shrink)

We have national guidelines for the responsible conduct of research (RCR) and procedures for handling allegations of misconduct in Finland. The guidelines have been formulated and updated by the Finnish Advisory Board on Research Integrity (TENK). In this article, we introduce and evaluate the national RCR guidelines. We also present statistics of alleged and proven RCR violation cases and frequency of appeals to TENK on the decisions or procedures of the primary institutions. In addition, we analyze the available (...) data on seven investigated cases in more detail. Positive aspects in the Finnish system are a fairly good infrastructure to investigate suspected RCR violations and a wide concept of RCR violations, which consists of fabrication, falsification, plagiarism, misappropriation, and other misbehaviors. However, the guidelines contain poorly elaborated definitions, do not treat the complainant and the suspect in an equal way, and need to be revised. Confusion about the concepts and criteria of the RCR violations seems to be common in primary institutions and among the complainants. Even if research institutions and universities have officially adhered to the national RCR guidelines, slipping from the guidelines occurs quite commonly. All these factors lead to frequent dissatisfaction with the decisions or procedures applied, high rate of appeals to TENK, and far from optimal functionality of the system. (shrink)

This paper demarcates a theoretically interesting class of "evaluational adjectives." This class includes predicates expressing various kinds of normative and epistemic evaluation, such as predicates of personal taste, aesthetic adjectives, moral adjectives, and epistemic adjectives, among others. Evaluational adjectives are distinguished, empirically, in exhibiting phenomena such as discourse-oriented use, felicitous embedding under the attitude verb `find', and sorites-susceptibility in the comparative form. A unified degree-based semantics is developed: What distinguishes evaluational adjectives, semantically, is that they denote context-dependent measure functions (...) ("evaluational perspectives")—context-dependent mappings to degrees of taste, beauty, probability, etc., depending on the adjective. This perspective-sensitivity characterizing the class of evaluational adjectives cannot be assimilated to vagueness, sensitivity to an experiencer argument, or multidimensionality; and it cannot be demarcated in terms of pretheoretic notions of subjectivity, common in the literature. I propose that certain diagnostics for "subjective" expressions be analyzed instead in terms of a precisely specified kind of discourse-oriented use of context-sensitive language. I close by applying the account to `find x PRED' ascriptions. (shrink)

Evaluative processes have their roots in early evolutionary history, as survival is dependent on an organism’s ability to identify and respond appropriately to positive, rewarding or otherwise salubrious stimuli as well as to negative, noxious, or injurious stimuli. Consequently, evaluative processes are ubiquitous in the animal kingdom and are represented at multiple levels of the nervous system, including the lowest levels of the neuraxis. While evolution has sculpted higher level evaluative systems into complex and sophisticated information-processing networks, they do not (...) come to replace, but rather to interact with more primitive lower level representations. Indeed, there are basic features of the underlying neuroarchitectural plan for evaluative processes that are common across levels of organization—including that of evaluative bivalence. (shrink)

Criteria for the evaluation of most scholars’ work have recently received wider attention due to high-profile cases of scientific misconduct which are perceived to be linked to these criteria. However, in the competition for career advancement and funding opportunities almost all scholars are subjected to the same criteria. Therefore these evaluation criteria act as ‘switchmen’, determining the tracks along which scholarly work is pushed by the dynamic interplay of interests of both scholars and their institutions. Currently one of (...) the most important criteria is the impact of publications. In this research, the extent to which publish or perish, a long standing evaluation criterion, led to scientific misconduct is examined briefly. After this the strive for high impact publications will be examined, firstly by identifying the period in which this became an important evaluation criterion, secondly by looking at variables contributing to the impact of scholarly papers by means of a non-structured literature study, and lastly by combining these data into a quantitative analysis. (shrink)

Background: Moral case deliberation is increasingly becoming part of various Dutch healthcare organizations. Although some evaluation studies of moral case deliberation have been carried out, research into the results of moral case deliberation within aged care is scarce. Research questions: How did participants evaluate moral case deliberation? What has moral case deliberation brought to them? What has moral case deliberation contributed to care practice? Should moral case deliberation be further implemented and, if so, how? Research design: (...) Quantitative analysis of a questionnaire study among participants of moral case deliberation, both caregivers and team leaders. Qualitative analysis of written answers to open questions, interview study and focus group meetings among caregivers and team leaders. Participants and research context: Caregivers and team leaders in a large organization for aged care in the Netherlands. A total of 61 moral case deliberation sessions, carried out on 16 care locations belonging to the organization, were evaluated and perceived results were assessed. Ethical considerations: Participants gave informed consent and anonymity was guaranteed. In the Netherlands, the law does not prescribe independent ethical review by an Institutional Review Board for this kind of research among healthcare professionals. Findings: Moral case deliberation was evaluated positively by the participants. Content and atmosphere of moral case deliberation received high scores, while organizational issues regarding the moral case deliberation sessions scored lower and merit further attention. Respondents indicated that moral case deliberation has the potential to contribute to care practice as relationships among team members improve, more openness is experienced and more understanding for different perspectives is fostered. If moral case deliberation is to be successfully implemented, top-down approaches should go hand in hand with bottom-up approaches. Conclusion: The relevance of moral case deliberation for care practice received wide acknowledgement from the respondents. It can contribute to the team’s cohesion as mutual understanding for one another’s views is fostered. If implemented well, moral case deliberation has the potential to improve care, according to the respondents. (shrink)