This systematic review evaluates the implementation of treatment integrity procedures in outcome studies of youth interventions targeting behavioral problems. The Implementation of Treatment Integrity Procedures Scale (ITIPS), developed by Perepletchikova, Treat, and Kazdin (2007), was adapted (ITIPS-A) and used to evaluate 32 outcome studies of evidence-based interventions for youths with externalizing behavioral problems. Integrity measures were found to be still rare in these studies. Of the studies that took integrity into account, 80% approached adequacy in implementing procedures for treatment integrity. The ITIPS-A is recommended as an instrument to guide development of integrity instruments and the implementation of treatment integrity procedures in youth care.
DOCUMENT
The security of online assessments is a major concern due to widespread cheating. One common form of cheating is impersonation, where students invite unauthorized persons to take assessments on their behalf. Several techniques exist to handle impersonation. Some researchers recommend use of integrity policy, but communicating the policy effectively to the students is a challenge. Others propose authentication methods like, password and fingerprint; they offer initial authentication but are vulnerable thereafter. Face recognition offers post-login authentication but necessitates additional hardware. Keystroke Dynamics (KD) has been used to provide post-login authentication without any additional hardware, but its use is limited to subjective assessment. In this work, we address impersonation in assessments with Multiple Choice Questions (MCQ). Our approach combines two key strategies: reinforcement of integrity policy for prevention, and keystroke-based random authentication for detection of impersonation. To the best of our knowledge, it is the first attempt to use keystroke dynamics for post-login authentication in the context of MCQ. We improve an online quiz tool for the data collection suited to our needs and use feature engineering to address the challenge of high-dimensional keystroke datasets. Using machine learning classifiers, we identify the best-performing model for authenticating the students. The results indicate that the highest accuracy (83%) is achieved by the Isolation Forest classifier. Furthermore, to validate the results, the approach is applied to Carnegie Mellon University (CMU) benchmark dataset, thereby achieving an improved accuracy of 94%. Though we also used mouse dynamics for authentication, but its subpar performance leads us to not consider it for our approach.
DOCUMENT
Objectives: The Toddler Oral Health Intervention (TOHI) was launched in 2017 to promote oral health prevention at well-baby clinics, with a focus on parents with chil- dren aged 6–48 months. This study aims to evaluate the integrity of motivational in- terviewing (MI) as one of the core intervention pillars in the TOHI study. Methods: The TOHI study was conducted at nine well-baby clinics in the central and southern regions of the Netherlands, with 11 trained oral health coaches (OHCs) de- livering a tailored individual counselling programme. Audio recordings of counselling sessions were uploaded by the OHCs into an online portal for feedback and integrity evaluation purposes. A trained independent assessor evaluated MI integrity using the MITI 4.2.1 coding scale. IBM SPSS Statistics was used to analyse the data, with rat- ings on technical and relational components and behavior counts computed by add- ing up the scores and categorizing them into six key MI skills. Descriptive statistics, including frequencies, percentages and median scores with interquartile ranges, were calculated. Results: The median ratings on the technical and relational components were 2.5 (IQR 2.0–3.5) and 3.5 (IQR 3.0–4.0) out of a maximum of 5, with 45% and 58% of record- ings showing fair or good MI integrity, respectively. A median of 38% (IQR 25–55%) of complex reflections and a reflection-to-question ratio of 0.7 (IQR 0.4–1.0), with 47% and 24% of recordings showing fair or good MI integrity, respectively. Median counts of MI-adherent and non-adherent statements were 3.0 (IQR 2.0–5.0) and 0.0 (IQR 0.0–1.0), respectively. The duration of recordings and MI integrity varied among oral health coaches. Conclusion: Overall, this study revealed that, while intensive training was provided, not all OHCs in the TOHI study met fair thresholds for MI integrity. These findings emphasize the necessity of ongoing training, reflection and support to achieve and maintain a fair or good level of MI integrity in clinical practice.
LINK
Objective: To prepare a set of statements for randomised clinical trials (RCT) integrity through an international multi-stakeholder consensus. Methods: The consensus was developed via: multi-country multidisciplinary stakeholder group composition and engagement; evidence synthesis of 55 systematic reviews concerning RCT integrity; anonymised two-round modified Delphi survey with consensus threshold based on the average percentage of majority opinions; and, a final consensus development meeting. Prospective registrations: (https://osf.io/bhncy, https://osf.io/3ursn). Results: There were 30 stakeholders representing 15 countries from five continents including triallists, ethicists, methodologists, statisticians, consumer representatives, industry representatives, systematic reviewers, funding body panel members, regulatory experts, authors, journal editors, peer-reviewers and advisors for resolving integrity concerns. Delphi survey response rate was 86.7% (26/30 stakeholders). There were 111 statements (73 stakeholder-provided, 46 systematic review-generated, 8 supported by both) in the initial long list, with eight additional statements provided during the consensus rounds. Through consensus the final set consolidated 81 statements (49 stakeholder-provided, 41 systematic review-generated, 9 supported by both). The entire RCT life cycle was covered by the set of statements including general aspects (n = 6), design and approval (n = 11), conduct and monitoring (n = 19), reporting of protocols and findings (n = 20), post-publication concerns (n = 12), and future research and development (n = 13). Conclusion: Implementation of this multi-stakeholder consensus statement is expected to enhance RCT integrity.
MULTIFILE
This study analyses how the social construction of integrity takes place within the context of football in the Netherlands. Combining a contextual approach to sports integrity with the analytic lens of sensemaking, this qualitative multi-method case study analyses – in one extreme case in Dutch youth amateur football – why and when the ‘incident’ was perceived as an ‘integrity issue’, and how the meaning of (the) integrity (issue) was socially constructed by (interactions between) stakeholders involved in the case. Our findings show why, when, and how moral norms and values are (not) debated and at stake, and that the social construction of sports integrity is intertwined with the institutional context and the role of secondary stakeholders. It provides insights that can help sports organizations to identify risks in their moral sports culure and to develop measures or policies to safeguard integrity in sport.
DOCUMENT
This study meta-analytically examined the effect of treatment integrity on client outcomes of evidence-based interventions for juveniles with antisocial behavior. A total of 17 studies, from which 91 effect sizes could be retrieved, were included in the present 3-level meta-analysis. All included studies, to a certain level, adequately implemented procedures to establish, assess, evaluate and report the level of treatment integrity. A moderator analysis revealed that a medium-to-large effect of evidence-based interventions was found when the level of treatment integrity was high (d = 0.633, p < 0.001), whereas no significant effect was found when integrity was low (d = 0.143, ns). Treatment integrity was significantly associated with effect size even when adjusted for other significant moderators, indicating the specific contribution of high levels of treatment integrity to positive client outcomes. This implies that delivering interventions with high treatment integrity to youth with antisocial behavior is vital.
DOCUMENT
Performance feedback and supervision are essential to the adoption of evidence-based interventions with high treatment integrity in child and youth care organizations. Little is known about the use of treatment integrity measurements in these organizations. For this study, 12 interventions for children and young people in the Netherlands with externalizing behavioral problems were selected. For each intervention, an expert, two supervisors, and two therapists were approached for an interview. In total, 54 semi-structured interviews were conducted. The results show that almost all interventions used treatment integrity instruments (N = 11, 91.7%). Only two used measurements for both QA procedures (certification and recertification) and supervision purposes. Therapists regard treatment integrity measurements as valuable when they are used for multiple purposes and feedback is provided. The results of this study suggest the feasibility of the use of measurements for multiple purposes. Collaborative action is required to develop instruments that effectively contribute to continuous improvement.
DOCUMENT
Among politicians and businessmen in the Netherlands, the general feeling is that integrity comes first in their businesslike relationships. Corruption is something that goes on in the Third World. This perception is strengthened annually by Transparency International’s publication of the so-called ‘Corruption Perceptions Index’ (CPI), which ranks the Netherlands, more often than not, among the top ten countries of the world in terms of integrity.What do observers from their posts in international agencies see as the reality? Do they agree? The following documentation contains data and views from sources made available by UNODC, UN Global Compact, OECD, GRECO (Council of Europe), Transparency International, European Union, and others, which do not conform to the prevailing views held by Dutch politicians and businesspeople concerning their own integrity.
MULTIFILE
Over the last decades or so, courses an programs on sustainability not only focus on sustainability issues but also increasingly foster the practices, ways of being, and skills needed to be an effective sustainable leader. This is in line with the UNESCO’s agenda on Education of Sustainable Development (ESD). In addition, Global Citizenship Education courses share the concern for ‘education that opens people’s eyes and minds to the realities of the world and awakens them to bring about a world of greater justice and human rights for all.’(Maastricht Global Education Declaration, 2002). In this contribution, which is partly based on my recent experience with a research-action project on the skills and qualities needed to achieve the Sustainable Development Goals (EmpowerSDGs) I would like to explore the place of ethics and integrity in such programs, an how such qualities can be fostered.
LINK
