The TOP program is a fully implemented responsive parenting intervention for very preterm born infants. Fidelity monitoring of interventions is important for preserving program adherence, impact outcomes and to make evidence-based adaptations. The aim of this study was to develop a fidelity tool for the TOP program following an iterative and co-creative process and subsequently evaluate the reliability of the tool. Three consecutive phases were carried out. Phase I: Initial development and pilot testing two methods namely self-report and video based observation. Phase II: Adaptations and refinements. Phase III: Evaluation of the psychometric properties of the tool based on 20 intervention videos rated by three experts.The interrater reliability of the adherence and competence subscales was good (ICC.81 to .84) and varied from moderate to excellent for specific items (ICC between .51 and .98). The FITT displayed a high correlation (Spearman’s rho.79 to.82) between the subscales and total impression item. The co-creative and iterative process resulted in a clinical useful and reliable tool for evaluating fidelity in the TOP program. This study offers insights in the practical steps in the development of a fidelity assessment tool which can be used by other intervention developers.
MULTIFILE
Secondary school physical education (PE) teachers are continuously challenged to find ways to support students learning and motivate them for an active and healthy lifestyle. To address this complexity, continuing teacher professional development (TPD) is key. Technological tools can facilitate the effective delivery of TPD in this context. Successful implementation of this technology, however, is not self-evident. Based on the general aim of effectively integrating technologies in the educational process and focusing on the needs of educators, this study examines how the evidence-based theoretical TARGET framework for creating a motivating PE learning climate might be embedded into a digital professional development tool for PE teachers, useful in everyday practice. It presents a case study in which a multidisciplinary team of researchers, designers, and end-users iteratively went through several phases of need identification, idea generation, designing, development, and testing. By using a participatory approach, we were able to collect contextualized data and gain insights into users’ preferences, requirements, and ideas for designing and engaging with the tool. Based on these insights the TPD TARGET-tool for PE teachers was ultimately developed. The most prominent characteristics of this tool are (1) the combination of an evaluative function with teaching strategy support, (2) the strong emphasis on ease of use due to the complex PE teaching context, (3) the avoidance of social comparison, and suggestions of normative judgment, and (4) the allowance for a high level of customization and teacher autonomy.
DOCUMENT
Risk assessment instruments are widely used to predict risk of adverse outcomes, such as violence or victimization, and to allocate resources for managing these risks among individuals involved in criminal justice and forensic mental health services. For risk assessment instruments to reach their full potential, they must be implemented with fidelity. A lack of information on administration fidelity hinders transparency about the implementation quality, as well as the interpretation of negative or inconclusive findings from predictive validity studies. The present study focuses on adherence, a dimension of fidelity. Adherence denotes the extent to which the risk assessment is completed according to the instrument’s guidelines. We developed an adherence measure, tailored to the ShortTerm Assessment of Risk and Treatability: Adolescent Version (START:AV), an evidence-based risk assessment instrument for adolescents. With the START:AV Adherence Rating Scale, we explored the degree to which 11 key features of the instrument were adhered to in 306 START:AVs forms, completed by 17 different evaluators in a Dutch residential youth care facility over a two-year period. Good to excellent interrater reliability was found for all adherence items. We identified differences in adherence scores on the various START:AV features, as well as significant improvement in adherence for those who attended a START:AV refresher workshop. Outcomes of risk assessment instruments potentially impact decision-making, for example, whether a youth’s secure placement should be extended. Therefore, we recommend fidelity monitoring to ensure the risk assessment practice was delivered as intended.
DOCUMENT
Background In a large randomized trial, Utrecht PROactive Frailty Intervention Trial (U‐PROFIT), we evaluated the effectiveness of an integrated program on the preservation of daily functioning in older people in primary care that consisted of a frailty identification tool and a multicomponent nurse‐led care program. Examination of treatment fidelity is critical to successful translation of evidence‐based interventions into practice. Aims To assess treatment delivery, dose and content of nursing care delivered within the nurse‐led care program, and to explore if the delivery may have influenced the trial results. Methods A mixed‐methods study was conducted. Type and dose of nursing care were collected during the trial. Shortly after the trial, a focus group with nurses was conducted to explore reasons for the observed differences between the type and dose of nursing care delivered. Results A total of 835 older persons were included in the nurse‐led care program. The mean age was 75 years, 64% were female and 53.5% were living alone. The most frequent self‐reported conditions were loneliness (60.8%) and cognitive problems (59.4%). One‐third of the patients with a geriatric condition received an additional assessment (e.g., Mini‐Mental State Examination), and the majority of these patients received at least one nurse intervention (>85%). Most nursing care was delivered to patients at risk of falling and to those with urinary incontinence. Patients with nutrition problems seldom received nursing interventions. The nurses explained that differences in type and dose were influenced by the preference of the patient, the type of geriatric problem, and the time required to apply a nurse intervention. Linking Evidence to Action All intervention components were delivered; however, differences were observed in the type and dose of nursing care delivered across geriatric conditions. The findings better explain the treatment fidelity and suggest that there is room for improvement that may result in more beneficial patient outcomes.
LINK
To prepare medical students appropriately for the management of toxicological emergencies, we have developed a simulation-based medical education (SBME) training in acute clinical toxicology. Our aim is to report on the feasibility, evaluation and lessons learned of this training. Since 2019, each year approximately 180 fifth-year medical students are invited to participate in the SBME training. The training consists of an interactive lecture and two SBME stations. For each station, a team of students had to perform the primary assessment and management of an intoxicated patient. After the training, the students completed a questionnaire about their experiences and confidence in clinical toxicology. Overall, the vast majority of students agreed that the training provided a fun, interactive and stimulating way to teach about clinical toxicology. Additionally, they felt more confident regarding their skills in this area. Our pilot study shows that SBME training was well-evaluated and feasible over a longer period.
DOCUMENT
Background: Phantom limb pain is a frequent and persistent problem following amputation. Achieving sustainable favorable effects on phantom limb pain requires therapeutic interventions such as mirror therapy that target maladaptive neuroplastic changes in the central nervous system. Unfortunately, patients’ adherence to unsupervised exercises is generally poor and there is a need for effective strategies such as telerehabilitation to support long-term self-management of patients with phantom limb pain. Objective: The main aim of this study was to describe the user-centered approach that guided the design and development of a telerehabilitation platform for patients with phantom limb pain. We addressed 3 research questions: (1) Which requirements are defined by patients and therapists for the content and functions of a telerehabilitation platform and how can these requirements be prioritized to develop a first prototype of the platform? (2) How can the user interface of the telerehabilitation platform be designed so as to match the predefined critical user requirements and how can this interface be translated into a medium-fidelity prototype of the platform? (3) How do patients with phantom limb pain and their treating therapists judge the usability of the medium-fidelity prototype of the telerehabilitation platform in routine care and how can the platform be redesigned based on their feedback to achieve a high-fidelity prototype?
DOCUMENT
The HCR-20V3 is a violence risk assessment tool that is widely used in forensic clinical practice for risk management planning. The predictive value of the tool, when used in court for legal decisionmaking, is not yet intensively been studied and questions about legal admissibility may arise. This article aims to provide legal and mental health practitioners with an overview of the strengths and weaknesses of the HCR-20V3 when applied in legal settings. The HCR-20V3 is described and discussed with respect to its psychometric properties for different groups and settings. Issues involving legal admissibility and potential biases when conducting violence risk assessments with the HCR-20V3 are outlined. To explore legal admissibility challenges with respect to the HCR-20V3, we searched case law databases since 2013 from Australia, Canada, Ireland, the Netherlands, New Zealand, the UK, and the USA. In total, we found 546 cases referring to the HCR-20/HCR-20V3. In these cases, the tool was rarely challenged (4.03%), and when challenged, it never resulted in a court decision that the risk assessment was inadmissible. Finally, we provide recommendations for legal practitioners for the cross-examination of risk assessments and recommendations for mental health professionals who conduct risk assessments and report to the court. We conclude with suggestions for future research with the HCR-20V3 to strengthen the evidence base for use of the instrument in legal contexts.
DOCUMENT
Objective: To evaluate the implementation of a multicomponent lifestyle intervention at two different worksites. Methods: Data on eight process components were collected by means of questionnaires and interviews. Data on the effectiveness were collected using questionnaires. Results: The program was implemented partly as planned, and 84.0% (max 25) and 85.7% (max 14) of all planned interventions were delivered at the university and hospital, respectively. Employees showed high reach (96.6%) and overall participation (75.1%) but moderate overall satisfaction rates (6.8 ± 1.1). Significant intervention effects were found for days of fruit consumption (β = 0.44 days/week, 95% CI: 0.02 to 0.85) in favor of the intervention group. Conclusions: The study showed successful reach, dose, and maintenance but moderate fidelity and satisfaction. Mainly relatively simple and easily implemented interventions were chosen, which were effective only in improving employees’ days of fruit consumption.
DOCUMENT
PURPOSE: The current article provides a description of the construction process of a short questionnaire that measures patients' experiences with a motivational interviewing consultation by a (sports) counselor in rehabilitation. Subsequently, results from confirmatory factor analyses are presented to investigate a first perspective on factorial construct validity of the questionnaire.MATERIAL AND METHODS: Based on motivational interviewing literature, an initial item pool was created. All items were critically reviewed, resulting in the new "Evaluation of Motivational Interviewing Consultation on Active Lifestyle and Sports" questionnaire. The final items were determined by a confirmatory factor analysis based on 890 completed questionnaires.RESULTS: The initial 26-item questionnaire consisted of four inter-correlated subscales. Factor analyses underpinned the proposed factors: acceptance, evocation, partnership, and non-adherent. After removing six items, an alternative model remained and showed an acceptable model fit. The internal consistency of the subscales derived varied from 0.70 to 0.90.CONCLUSION: The shortened questionnaire provides a feasible and easy to administer tool and may provide a cost saving method of assessing motivational interviewing fidelity from a patient's perspective in disability and rehabilitation. Implications for rehabilitation Many persons with a physical disability do not obtain the recommended amount of physical activity in order to maintain health. Stimulation of a physically active lifestyle through motivational interviewing is promising. Measuring motivational interviewing treatment fidelity is time consuming and often from a counselor's perspective. We developed a short questionnaire facilitating the assessment of treatment fidelity at the side of the client. Our questionnaire provides a feasible and easy to administer tool for assessing MI fidelity in daily rehabilitation practice.
DOCUMENT
Introduction: Sensor-feedback systems can be used to support people after stroke during independent practice of gait. The main aim of the study was to describe the user-centred approach to (re)design the user interface of the sensor feedback system “Stappy” for people after stroke, and share the deliverables and key observations from this process. Methods: The user-centred approach was structured around four phases (the discovery, definition, development and delivery phase) which were fundamental to the design process. Fifteen participants with cognitive and/or physical limitations participated (10 women, 2/3 older than 65). Prototypes were evaluated in multiple test rounds, consisting of 2–7 individual test sessions. Results: Seven deliverables were created: a list of design requirements, a personae, a user flow, a low-, medium- and high-fidelity prototype and the character “Stappy”. The first six deliverables were necessary tools to design the user interface, whereas the character was a solution resulting from this design process. Key observations related to “readability and contrast of visual information”, “understanding and remembering information”, “physical limitations” were confirmed by and “empathy” was additionally derived from the design process. Conclusions: The study offers a structured methodology resulting in deliverables and key observations, which can be used to (re)design meaningful user interfaces for people after stroke. Additionally, the study provides a technique that may promote “empathy” through the creation of the character Stappy. The description may provide guidance for health care professionals, researchers or designers in future user interface design projects in which existing products are redesigned for people after stroke.
DOCUMENT
