Aim: To evaluate healthcare professionals' performance and treatment fidelity in the Cardiac Care Bridge (CCB) nurse-coordinated transitional care intervention in older cardiac patients to understand and interpret the study results. Design: A mixed-methods process evaluation based on the Medical Research Council Process Evaluation framework. Methods: Quantitative data on intervention key elements were collected from 153 logbooks of all intervention patients. Qualitative data were collected using semi-structured interviews with 19 CCB professionals (cardiac nurses, community nurses and primary care physical therapists), from June 2017 until October 2018. Qualitative data-analysis is based on thematic analysis and integrated with quantitative key element outcomes. The analysis was blinded to trial outcomes. Fidelity was defined as the level of intervention adherence. Results: The overall intervention fidelity was 67%, ranging from severely low fidelity in the consultation of in-hospital geriatric teams (17%) to maximum fidelity in the comprehensive geriatric assessment (100%). Main themes of influence in the intervention performance that emerged from the interviews are interdisciplinary collaboration, organizational preconditions, confidence in the programme, time management and patient characteristics. In addition to practical issues, the patient's frailty status and limited motivation were barriers to the intervention. Conclusion: Although involved healthcare professionals expressed their confidence in the intervention, the fidelity rate was suboptimal. This could have influenced the non-significant effect of the CCB intervention on the primary composite outcome of readmission and mortality 6 months after randomization. Feasibility of intervention key elements should be reconsidered in relation to experienced barriers and the population. Impact: In addition to insight in effectiveness, insight in intervention fidelity and performance is necessary to understand the mechanism of impact. This study demonstrates that the suboptimal fidelity was subject to a complex interplay of organizational, professionals' and patients' issues. The results support intervention redesign and inform future development of transitional care interventions in older cardiac patients.
DOCUMENT
Introduction: Depression can be a serious problem in young adult students. There is a need to implement and monitor prevention interventions for these students. Emotion-regulating improvisational music therapy (EIMT) was developed to prevent depression. The purpose of this study was to evaluate the feasibility of EIMT for use in practice for young adult students with depressive symptoms in a university context. Method: A process evaluation was conducted embedded in a larger research project. Eleven students, three music therapists and five referrers were interviewed. The music therapists also completed evaluation forms. Data were collected concerning client attendance, treatment integrity, musical components used to synchronise, and experiences with EIMT and referral. Results: Client attendance (90%) and treatment integrity were evaluated to be sufficient (therapist adherence 83%; competence 84%). The music therapists used mostly rhythm to synchronise (38 of 99 times). The students and music therapists reported that EIMT and its elements evoked changes in all emotion regulation components. The students reported that synchronisation elicited meaningful experiences of expressing joy, feeling heard, feeling joy and bodily responses of relaxation. The music therapists found the manual useful for applying EIMT. The student counsellors experienced EIMT as an appropriate way to support students due to its preventive character. Discussion: EIMT appears to be a feasible means of evoking changes in emotion regulation components in young adult students with depressive symptoms in a university context. More studies are needed to create a more nuanced and evidence-based understanding of the feasibility of EIMT, processes of change and treatment integrity.
DOCUMENT
Background: Implementation of an eRehabilitation intervention named Fit After Stroke @Home (Fast@home) – including cognitive/physical exercise applications, activity-tracking, psycho-education – after stroke resulted in health-related improvements. This study investigated what worked and why in the implementation. Methods: Implementation activities (information provision, integration of Fast@home, instruction and motivation) were performed for 14 months and evaluated, using the Medical Research Council framework for process evaluations which consists of three evaluation domains (implementation, mechanisms of impact and contextual factors). Implementation activities were evaluated by field notes/surveys/user data, it’s mechanisms of impact by surveys and contextual factors by field notes/interviews among 11 professionals. Surveys were conducted among 51 professionals and 73 patients. User data (n=165 patients) were extracted from the eRehabilitation applications. Results: Implementation activities were executed as planned. Of the professionals trained to deliver the intervention (33 of 51), 25 (75.8%) delivered it. Of the 165 patients, 82 (49.7%) were registered for Fast@home, with 54 patient (65.8%) using it. Mechanisms of impact showed that professionals and patients were equally satisfied with implementation activities (median score 7.0 [IQR 6.0–7.75] versus 7.0 [6.0–7.5]), but patients were more satisfied with the intervention (8.0 [IQR 7.0–8.0] versus 5.5 [4.0–7.0]). Guidance by professionals was seen as most impactful for implementation by patients and support of clinical champions and time given for training by professionals. Professionals rated the integration of Fast@home as insufficient. Contextual factors (financial cutbacks and technical setbacks) hampered the implementation. Conclusion: Main improvements of the implementation of eRehabilitation are related to professionals’ perceptions of the intervention, integration of eRehabilitation and contextual factors.
DOCUMENT
OBJECTIVES: To improve transmural palliative care for acutely admitted older patients, the PalliSupport transmural care pathway was developed. Implementation of this care pathway was challenging. The aim of this study was to improve understanding why the implementation partly failed.DESIGN: A qualitative process evaluation study.SETTING/PARTICIPANTS: 17 professionals who were involved in the PalliSupport program were interviewed.METHODS: Online semi-structured interviews. Thematic analysis to create themes according to the implementation framework of Grol & Wensing.RESULTS: From this study, themes within four levels of implementation emerged: 1) The innovation: challenges in current palliative care, the setting of the pathway and boost for improvement; 2) Individual professional: feeling (un)involved and motivation; 3) Organizational level: project management; 4) Political and economic level: project plan and evaluation.CONCLUSION AND IMPLICATIONS: We learned that the challenges involved in implementing a transmural care pathway in palliative care should not be underestimated. For successful implementation, we emphasize the importance of creating a program that fits the complexity of transmural palliative care. We suggest starting on a small scale and invest in project management. This could help to involve all stakeholders and anticipate current challenges in palliative care. To increase acceptance, create one care pathway that can start and be used in all care settings. Make sure that there is sufficient flexibility in time and room to adjust the project plan, so that a second pilot study can possibly be performed, and choose a scientific evaluation with both rigor and practical usefulness to evaluate effectiveness.
DOCUMENT
Abstract Background: Several interventions have been developed to improve physical health and lifestyle behaviour of people with a severe mental illness (SMI). Recently, we conducted a pragmatic cluster-randomised controlled trial which evaluated the efects of the one-year Severe Mental Illness Lifestyle Evaluation (SMILE) lifestyle intervention compared with usual care in clients with SMI. The SMILE intervention is a 12-month group-based lifestyle intervention with a focus on increased physical activity and healthy food intake. The aim of the current study was to explore the experiences of people with SMI and healthcare professionals (HCPs) regarding implementation feasibility of the SMILE intervention and the fdelity to the SMILE intervention. Methods: A process evaluation was conducted alongside the pragmatic randomized controlled trial. The experiences of clients and HCPs in the lifestyle intervention group were studied. First, descriptive data on the implementation of the intervention were collected. Next, semi-structured interviews with clients (n=15) and HCPs (n=13) were performed. Interviews were audiotaped and transcribed verbatim. A thematic analysis of the interview data was performed using MAXQDA software. In addition, observations of group sessions were performed to determine the fdelity to the SMILE intervention using a standardised form. Results: Ten out of 26 HCPs who conducted the group sessions discontinued their involvement with the intervention, primarily due to changing jobs. 98% of all planned group sessions were performed. Four main themes emerged from the interviews: 1) Positive appraisal of the SMILE intervention, 2) Suggestions for improvement of the SMILE intervention 3) Facilitators of implementation and 4) Barriers of implementation. Both clients and HCPs had positive experiences regarding the SMILE intervention. Clients found the intervention useful and informative. The intervention was found suitable and interesting for all people with SMI, though HCPs sometimes had to tailor the intervention to individual characteristics of patients (e.g., with respect to cognitive functioning). The handbook of the SMILE intervention was perceived as user-friendly and helpful by HCPs. Combining SMILE with daily tasks, no support from other team members, and lack of staf and time were experienced as barriers for the delivery of the intervention Conclusion: The SMILE intervention was feasible and well-perceived by clients and HCPs. However, we also identifed some aspects that may have hindered efective implementation and needs to be considered when implementing the SMILE intervention in daily practice
DOCUMENT
Background: The Nurses in the Lead (NitL) programme consists of a systematic approach and training to 1) empower community nurses in implementing evidence, targeted at encouraging functional activities of older adults, and 2) train community nurses in enabling team members to change their practice. This article aims to describe the process evaluation of NitL. Methods: A mixed-methods formative process evaluation with a predominantly qualitative approach was conducted. Qualitative data were collected by interviews with community nurses (n = 7), focus groups with team members (n = 31), and reviewing seven implementation plans and 28 patient records. Quantitative data were collected among community nurses and team members (N = 90) using a questionnaire to assess barriers in encouraging functional activities and attendance lists. Data analysis was carried out through descriptive statistics and content analysis. Results: NitL was largely executed according to plan. Points of attention were the use and value of the background theory within the training, completion of implementation plans, and reporting in patient records by community nurses. Inhibiting factors for showing leadership and encouraging functional activities were a lack of time and a high complexity of care; facilitating factors were structure and clear communication within teams. Nurses considered the systematic approach useful and the training educational for their role. Most team members considered NitL practical and were satisfied with the coaching provided by community nurses. To optimise NitL, community nurses recommended providing the training first and extending the training. The team members recommended continuing clinical lessons, which were an implementation strategy from the community nurses. Conclusions: NitL was largely executed as planned, and appears worthy of further application in community care practice. However, adaptations are recommended to make NitL more promising in practice in empowering community nurse leadership in implementing evidence.
DOCUMENT
Standard SARS-CoV-2 testing protocols using nasopharyngeal/throat (NP/T) swabs are invasive and require trained medical staff for reliable sampling. In addition, it has been shown that PCR is more sensitive as compared to antigen-based tests. Here we describe the analytical and clinical evaluation of our in-house RNA extraction-free saliva-based molecular assay for the detection of SARS-CoV-2. Analytical sensitivity of the test was equal to the sensitivity obtained in other Dutch diagnostic laboratories that process NP/T swabs. In this study, 955 individuals participated and provided NP/T swabs for routine molecular analysis (with RNA extraction) and saliva for comparison. Our RT-qPCR resulted in a sensitivity of 82,86% and a specificity of 98,94% compared to the gold standard. A false-negative ratio of 1,9% was found. The SARS-CoV-2 detection workflow described here enables easy, economical, and reliable saliva processing, useful for repeated testing of individuals.
LINK
Learning activities in a makerspace are hands-on and characterized by design and inquiry. Evaluation is needed both for learners and their coaches in order to effectively guide the learning process of the children and for feedback on the effectiveness of the after-school maker activities. Due to its constructionist nature, learning in a makerspace requires specific forms of evaluation. In this paper we describe the development of an instrument that facilitates and captures reflection on the activities that children undertook in a library makerspace. Our aim is to capture learning in this context with multiple instruments: analysis of the artifacts that are made, observation of hands-on activities and interviews - which all are time consuming methods. Hence, we developed an easy to use tool for self-evaluation of maker learner activities for children. We build on the design of a visual instrument used for learning by design and inquiry in primary education. The findings and results are transferable to (formative) assessment and evaluation of learning activities by learners in other types of education and specific in maker education.
DOCUMENT
Introduction: In March 2014, the New South Wales (NSW) Government (Australia) announced the NSW Integrated Care Strategy. In response, a family-centred, population-based, integrated care initiative for vulnerable families and their children in Sydney, Australia was developed. The initiative was called Healthy Homes and Neighbourhoods. A realist translational social epidemiology programme of research and collaborative design is at the foundation of its evaluation. Theory and Method: The UK Medical Research Council (MRC) Framework for evaluating complex health interventions was adapted. This has four components, namely 1) development, 2) feasibility/piloting, 3) evaluation and 4) implementation. We adapted the Framework to include: critical realist, theory driven, and continuous improvement approaches. The modified Framework underpins this research and evaluation protocol for Healthy Homes and Neighbourhoods. Discussion: The NSW Health Monitoring and Evaluation Framework did not make provisions for assessment of the programme layers of context, or the effect of programme mechanism at each level. We therefore developed a multilevel approach that uses mixed-method research to examine not only outcomes, but also what is working for whom and why.
LINK
Qualitative and quantitative research methods were used to establish the role of the website in the educational process of Bedrijfsmanagement MKB students, and the use of the website in the student recruitment process.
DOCUMENT
