Search results

Effective reflection

Adherence to Structured Risk Assessment Guidelines: Development and Preliminary Evaluation of an Adherence Scale for the START:AV

Risk assessment instruments are widely used to predict risk of adverse outcomes, such as violence or victimization, and to allocate resources for managing these risks among individuals involved in criminal justice and forensic mental health services. For risk assessment instruments to reach their full potential, they must be implemented with fidelity. A lack of information on administration fidelity hinders transparency about the implementation quality, as well as the interpretation of negative or inconclusive findings from predictive validity studies. The present study focuses on adherence, a dimension of fidelity. Adherence denotes the extent to which the risk assessment is completed according to the instrument’s guidelines. We developed an adherence measure, tailored to the ShortTerm Assessment of Risk and Treatability: Adolescent Version (START:AV), an evidence-based risk assessment instrument for adolescents. With the START:AV Adherence Rating Scale, we explored the degree to which 11 key features of the instrument were adhered to in 306 START:AVs forms, completed by 17 different evaluators in a Dutch residential youth care facility over a two-year period. Good to excellent interrater reliability was found for all adherence items. We identified differences in adherence scores on the various START:AV features, as well as significant improvement in adherence for those who attended a START:AV refresher workshop. Outcomes of risk assessment instruments potentially impact decision-making, for example, whether a youth’s secure placement should be extended. Therefore, we recommend fidelity monitoring to ensure the risk assessment practice was delivered as intended.

Augmenting outpatient alcohol treatment as usual with online alcohol avoidance training

Background: Recent theoretical models emphasize the role of impulsive processes in alcohol addiction, which can be retrained with computerized Cognitive Bias Modification (CBM) training. In this study, the focus is on action tendencies that are activated relatively automatically. Objective: The aim of the study is to examine the effectiveness of online CBM Alcohol Avoidance Training using an adapted Approach-Avoidance Task as a supplement to treatment as usual (TAU) in an outpatient treatment setting. Methods: The effectiveness of 8 online sessions of CBM Alcohol Avoidance Training added to TAU is tested in a double-blind, randomized controlled trial with pre- and postassessments, plus follow-up assessments after 3 and 6 months. Participants are adult patients (age 18 years or over) currently following Web-based or face-to-face TAU to reduce or stop drinking. These patients are randomly assigned to a CBM Alcohol Avoidance or a placebo training. The primary outcome measure is a reduction in alcohol consumption. We hypothesize that TAU + CBM will result in up to a 13-percentage point incremental effect in the number of patients reaching the safe drinking guidelines compared to TAU + placebo CBM. Secondary outcome measures include an improvement in health status and a decrease in depression, anxiety, stress, and possible mediation by the change in approach bias. Finally, patients’ adherence, acceptability, and credibility will be examined. Results: The trial was funded in 2014 and is currently in the active participant recruitment phase (since May 2015). Enrolment will be completed in 2019. First results are expected to be submitted for publication in 2020. Conclusions: The main purpose of this study is to increase our knowledge about the added value of online Alcohol Avoidance Training as a supplement to TAU in an outpatient treatment setting. If the added effectiveness of the training is proven, the next step could be to incorporate the intervention into current treatment.

Implementation of treatment integrity procedures

This systematic review evaluates the implementation of treatment integrity procedures in outcome studies of youth interventions targeting behavioral problems. The Implementation of Treatment Integrity Procedures Scale (ITIPS), developed by Perepletchikova, Treat, and Kazdin (2007), was adapted (ITIPS-A) and used to evaluate 32 outcome studies of evidence-based interventions for youths with externalizing behavioral problems. Integrity measures were found to be still rare in these studies. Of the studies that took integrity into account, 80% approached adequacy in implementing procedures for treatment integrity. The ITIPS-A is recommended as an instrument to guide development of integrity instruments and the implementation of treatment integrity procedures in youth care.

Treatment Fidelity of an Evidence-Based Nurse-Led Intervention in a Proactive Primary Care Program for Older People

Background In a large randomized trial, Utrecht PROactive Frailty Intervention Trial (U‐PROFIT), we evaluated the effectiveness of an integrated program on the preservation of daily functioning in older people in primary care that consisted of a frailty identification tool and a multicomponent nurse‐led care program. Examination of treatment fidelity is critical to successful translation of evidence‐based interventions into practice. Aims To assess treatment delivery, dose and content of nursing care delivered within the nurse‐led care program, and to explore if the delivery may have influenced the trial results. Methods A mixed‐methods study was conducted. Type and dose of nursing care were collected during the trial. Shortly after the trial, a focus group with nurses was conducted to explore reasons for the observed differences between the type and dose of nursing care delivered. Results A total of 835 older persons were included in the nurse‐led care program. The mean age was 75 years, 64% were female and 53.5% were living alone. The most frequent self‐reported conditions were loneliness (60.8%) and cognitive problems (59.4%). One‐third of the patients with a geriatric condition received an additional assessment (e.g., Mini‐Mental State Examination), and the majority of these patients received at least one nurse intervention (>85%). Most nursing care was delivered to patients at risk of falling and to those with urinary incontinence. Patients with nutrition problems seldom received nursing interventions. The nurses explained that differences in type and dose were influenced by the preference of the patient, the type of geriatric problem, and the time required to apply a nurse intervention. Linking Evidence to Action All intervention components were delivered; however, differences were observed in the type and dose of nursing care delivered across geriatric conditions. The findings better explain the treatment fidelity and suggest that there is room for improvement that may result in more beneficial patient outcomes.

Video Feedback to Enhance Fidelity in Practice-Based Interventions for Young People, a Small-<i>n</i> Study

Competent delivery of interventions in child and youth social care is important, due to the direct effect on client outcomes. This is acknowledged in evidence-based interventions (EBI) when, post-training, continued support is available to ensure competent delivery of the intervention. In addition to EBI, practice-based interventions (PBI) are used in the Netherlands. The current paper discusses to what extent competent delivery of PBI can be influenced by introducing supervision for professionals. This study used a mixed-method design: (1) A small-n study consisting of six participants in a non-concurrent multiple baseline design (MBL). Professionals were asked to record conversations with clients during a baseline period (without supervision) and an intervention period (with supervision). Visual inspection, the non-overlap of all pairs (NAP), and the Combinatorial Inference Technique (CIT) scores were calculated. (2) Qualitative interviews with the six participants, two supervisors, and one lead supervisor focused on the feasibility of the supervision. Four of six professionals showed improvement in treatment fidelity or one of its sub-scales. Had all participants shown progress, this could have been interpreted as an indication that targeted support of professionals contributes to increasing treatment integrity. Interviews have shown that supervision increased the professionals’ enthusiasm, self-confidence, and awareness of working with the core components of the intervention. The study has shown that supervision can be created for PBI and that this stimulates professionals to work with the core components of the intervention. The heterogeneous findings on intervention fidelity can be the result of supervision being newly introduced.