Search results

Treatment Fidelity of an Evidence-Based Nurse-Led Intervention in a Proactive Primary Care Program for Older People

Background In a large randomized trial, Utrecht PROactive Frailty Intervention Trial (U‐PROFIT), we evaluated the effectiveness of an integrated program on the preservation of daily functioning in older people in primary care that consisted of a frailty identification tool and a multicomponent nurse‐led care program. Examination of treatment fidelity is critical to successful translation of evidence‐based interventions into practice. Aims To assess treatment delivery, dose and content of nursing care delivered within the nurse‐led care program, and to explore if the delivery may have influenced the trial results. Methods A mixed‐methods study was conducted. Type and dose of nursing care were collected during the trial. Shortly after the trial, a focus group with nurses was conducted to explore reasons for the observed differences between the type and dose of nursing care delivered. Results A total of 835 older persons were included in the nurse‐led care program. The mean age was 75 years, 64% were female and 53.5% were living alone. The most frequent self‐reported conditions were loneliness (60.8%) and cognitive problems (59.4%). One‐third of the patients with a geriatric condition received an additional assessment (e.g., Mini‐Mental State Examination), and the majority of these patients received at least one nurse intervention (>85%). Most nursing care was delivered to patients at risk of falling and to those with urinary incontinence. Patients with nutrition problems seldom received nursing interventions. The nurses explained that differences in type and dose were influenced by the preference of the patient, the type of geriatric problem, and the time required to apply a nurse intervention. Linking Evidence to Action All intervention components were delivered; however, differences were observed in the type and dose of nursing care delivered across geriatric conditions. The findings better explain the treatment fidelity and suggest that there is room for improvement that may result in more beneficial patient outcomes.

Effective reflection

Adherence to Structured Risk Assessment Guidelines: Development and Preliminary Evaluation of an Adherence Scale for the START:AV

Risk assessment instruments are widely used to predict risk of adverse outcomes, such as violence or victimization, and to allocate resources for managing these risks among individuals involved in criminal justice and forensic mental health services. For risk assessment instruments to reach their full potential, they must be implemented with fidelity. A lack of information on administration fidelity hinders transparency about the implementation quality, as well as the interpretation of negative or inconclusive findings from predictive validity studies. The present study focuses on adherence, a dimension of fidelity. Adherence denotes the extent to which the risk assessment is completed according to the instrument’s guidelines. We developed an adherence measure, tailored to the ShortTerm Assessment of Risk and Treatability: Adolescent Version (START:AV), an evidence-based risk assessment instrument for adolescents. With the START:AV Adherence Rating Scale, we explored the degree to which 11 key features of the instrument were adhered to in 306 START:AVs forms, completed by 17 different evaluators in a Dutch residential youth care facility over a two-year period. Good to excellent interrater reliability was found for all adherence items. We identified differences in adherence scores on the various START:AV features, as well as significant improvement in adherence for those who attended a START:AV refresher workshop. Outcomes of risk assessment instruments potentially impact decision-making, for example, whether a youth’s secure placement should be extended. Therefore, we recommend fidelity monitoring to ensure the risk assessment practice was delivered as intended.

Video Feedback to Enhance Fidelity in Practice-Based Interventions for Young People, a Small-<i>n</i> Study

Competent delivery of interventions in child and youth social care is important, due to the direct effect on client outcomes. This is acknowledged in evidence-based interventions (EBI) when, post-training, continued support is available to ensure competent delivery of the intervention. In addition to EBI, practice-based interventions (PBI) are used in the Netherlands. The current paper discusses to what extent competent delivery of PBI can be influenced by introducing supervision for professionals. This study used a mixed-method design: (1) A small-n study consisting of six participants in a non-concurrent multiple baseline design (MBL). Professionals were asked to record conversations with clients during a baseline period (without supervision) and an intervention period (with supervision). Visual inspection, the non-overlap of all pairs (NAP), and the Combinatorial Inference Technique (CIT) scores were calculated. (2) Qualitative interviews with the six participants, two supervisors, and one lead supervisor focused on the feasibility of the supervision. Four of six professionals showed improvement in treatment fidelity or one of its sub-scales. Had all participants shown progress, this could have been interpreted as an indication that targeted support of professionals contributes to increasing treatment integrity. Interviews have shown that supervision increased the professionals’ enthusiasm, self-confidence, and awareness of working with the core components of the intervention. The study has shown that supervision can be created for PBI and that this stimulates professionals to work with the core components of the intervention. The heterogeneous findings on intervention fidelity can be the result of supervision being newly introduced.

TARGET-tool

Secondary school physical education (PE) teachers are continuously challenged to find ways to support students learning and motivate them for an active and healthy lifestyle. To address this complexity, continuing teacher professional development (TPD) is key. Technological tools can facilitate the effective delivery of TPD in this context. Successful implementation of this technology, however, is not self-evident. Based on the general aim of effectively integrating technologies in the educational process and focusing on the needs of educators, this study examines how the evidence-based theoretical TARGET framework for creating a motivating PE learning climate might be embedded into a digital professional development tool for PE teachers, useful in everyday practice. It presents a case study in which a multidisciplinary team of researchers, designers, and end-users iteratively went through several phases of need identification, idea generation, designing, development, and testing. By using a participatory approach, we were able to collect contextualized data and gain insights into users’ preferences, requirements, and ideas for designing and engaging with the tool. Based on these insights the TPD TARGET-tool for PE teachers was ultimately developed. The most prominent characteristics of this tool are (1) the combination of an evaluative function with teaching strategy support, (2) the strong emphasis on ease of use due to the complex PE teaching context, (3) the avoidance of social comparison, and suggestions of normative judgment, and (4) the allowance for a high level of customization and teacher autonomy.

Development and evaluation of a fidelity tool in a post-discharge responsive parenting intervention program for very preterm born children

The TOP program is a fully implemented responsive parenting intervention for very preterm born infants. Fidelity monitoring of interventions is important for preserving program adherence, impact outcomes and to make evidence-based adaptations. The aim of this study was to develop a fidelity tool for the TOP program following an iterative and co-creative process and subsequently evaluate the reliability of the tool. Three consecutive phases were carried out. Phase I: Initial development and pilot testing two methods namely self-report and video based observation. Phase II: Adaptations and refinements. Phase III: Evaluation of the psychometric properties of the tool based on 20 intervention videos rated by three experts.The interrater reliability of the adherence and competence subscales was good (ICC.81 to .84) and varied from moderate to excellent for specific items (ICC between .51 and .98). The FITT displayed a high correlation (Spearman’s rho.79 to.82) between the subscales and total impression item. The co-creative and iterative process resulted in a clinical useful and reliable tool for evaluating fidelity in the TOP program. This study offers insights in the practical steps in the development of a fidelity assessment tool which can be used by other intervention developers.