Competent delivery of interventions in child and youth social care is important, due to the direct effect on client outcomes. This is acknowledged in evidence-based interventions (EBI) when, post-training, continued support is available to ensure competent delivery of the intervention. In addition to EBI, practice-based interventions (PBI) are used in the Netherlands. The current paper discusses to what extent competent delivery of PBI can be influenced by introducing supervision for professionals. This study used a mixed-method design: (1) A small-n study consisting of six participants in a non-concurrent multiple baseline design (MBL). Professionals were asked to record conversations with clients during a baseline period (without supervision) and an intervention period (with supervision). Visual inspection, the non-overlap of all pairs (NAP), and the Combinatorial Inference Technique (CIT) scores were calculated. (2) Qualitative interviews with the six participants, two supervisors, and one lead supervisor focused on the feasibility of the supervision. Four of six professionals showed improvement in treatment fidelity or one of its sub-scales. Had all participants shown progress, this could have been interpreted as an indication that targeted support of professionals contributes to increasing treatment integrity. Interviews have shown that supervision increased the professionals’ enthusiasm, self-confidence, and awareness of working with the core components of the intervention. The study has shown that supervision can be created for PBI and that this stimulates professionals to work with the core components of the intervention. The heterogeneous findings on intervention fidelity can be the result of supervision being newly introduced.
DOCUMENT
The TOP program is a fully implemented responsive parenting intervention for very preterm born infants. Fidelity monitoring of interventions is important for preserving program adherence, impact outcomes and to make evidence-based adaptations. The aim of this study was to develop a fidelity tool for the TOP program following an iterative and co-creative process and subsequently evaluate the reliability of the tool. Three consecutive phases were carried out. Phase I: Initial development and pilot testing two methods namely self-report and video based observation. Phase II: Adaptations and refinements. Phase III: Evaluation of the psychometric properties of the tool based on 20 intervention videos rated by three experts.The interrater reliability of the adherence and competence subscales was good (ICC.81 to .84) and varied from moderate to excellent for specific items (ICC between .51 and .98). The FITT displayed a high correlation (Spearman’s rho.79 to.82) between the subscales and total impression item. The co-creative and iterative process resulted in a clinical useful and reliable tool for evaluating fidelity in the TOP program. This study offers insights in the practical steps in the development of a fidelity assessment tool which can be used by other intervention developers.
MULTIFILE
Background: Multimodal prehabilitation programs are effective at reducing complications after colorectal surgery in patients with a high risk of postoperative complications due to low aerobic capacity and/or malnutrition. However, high implementation fidelity is needed to achieve these effects in real-life practice. This study aimed to investigate the implementation fidelity of an evidence-based prehabilitation program in the real-life context of a Dutch regional hospital.Methods: In this observational cohort study with multiple case analyses, all patients who underwent colorectal surgery from January 2023 to June 2023 were enrolled. Patients meeting the criteria for low aerobic capacity or malnutrition were advised to participate in a prehabilitation program. According to recent scientific insights and the local care context, this program consisted of four exercise modalities and three nutrition modalities. Implementation fidelity was investigated by evaluating: (1) coverage (participation rate), (2) duration (number of days between the start of prehabilitation and surgery), (3) content (delivery of prescribed intervention modalities), and (4) frequency (attendance of sessions and compliance with prescribed parameters). An aggregated percentage of content and frequency was calculated to determine overall adherence.Results: Fifty-eight patients intended to follow the prehabilitation care pathway, of which 41 performed a preoperative risk assessment (coverage 80%). Ten patients (24%) were identified as high-risk and participated in the prehabilitation program (duration of 33-84 days). Adherence was high (84-100%) in five and moderate (72-73%) in two patients. Adherence was remarkably low (25%, 53%, 54%) in three patients who struggled to execute the prehabilitation program due to multiple physical and cognitive impairments.Conclusion: Implementation fidelity of an evidence-based multimodal prehabilitation program for high-risk patients preparing for colorectal surgery in real-life practice was moderate because adherence was high for most patients, but low for some patients. Patients with low adherence had multiple impairments, with consequences for their preparation for surgery. For healthcare professionals, it is recommended to pay attention to high-risk patients with multiple impairments and further personalize the prehabilitation program. More knowledge about identifying and treating high-risk patients is needed to provide evidence-based recommendations and to obtain higher effectiveness.
LINK