Comprehensive understanding of the merits of bottom-up urban development is lacking, thus hampering and complicating associated collaborative processes. Therefore, and given the assumed relevancies, we mapped the social, environmental and economic values generated by bottom-up developments in two Dutch urban areas, using theory-based evaluation principles. These evaluations raised insights into the values, beneficiaries and path dependencies between successive values, confirming the assumed effect of placemaking accelerating further spatial developments. It also revealed broader impacts of bottom-up endeavors, such as influences on local policies and innovations in urban development.
MULTIFILE
Introduction: In March 2014, the New South Wales (NSW) Government (Australia) announced the NSW Integrated Care Strategy. In response, a family-centred, population-based, integrated care initiative for vulnerable families and their children in Sydney, Australia was developed. The initiative was called Healthy Homes and Neighbourhoods. A realist translational social epidemiology programme of research and collaborative design is at the foundation of its evaluation. Theory and Method: The UK Medical Research Council (MRC) Framework for evaluating complex health interventions was adapted. This has four components, namely 1) development, 2) feasibility/piloting, 3) evaluation and 4) implementation. We adapted the Framework to include: critical realist, theory driven, and continuous improvement approaches. The modified Framework underpins this research and evaluation protocol for Healthy Homes and Neighbourhoods. Discussion: The NSW Health Monitoring and Evaluation Framework did not make provisions for assessment of the programme layers of context, or the effect of programme mechanism at each level. We therefore developed a multilevel approach that uses mixed-method research to examine not only outcomes, but also what is working for whom and why.
LINK
While traditional crime rates are decreasing, cybercrime is on the rise. As a result, the criminal justice system is increasingly dealing with criminals committing cyber-dependent crimes. However, to date there are no effective interventions to prevent recidivism in this type of offenders. Dutch authorities have developed an intervention program, called Hack_Right. Hack_Right is an alternative criminal justice program for young first-offenders of cyber-dependent crimes. In order to prevent recidivism, this program places participants in organizations where they are taught about ethical hacking, complete (technical) assignments and reflect on their offense. In this study, we have evaluated the Hack_Right program and the pilot interventions carried out thus far. By examining the program theory (program evaluation) and implementation of the intervention (process evaluation), the study adds to the scarce literature about cybercrime interventions. During the study, two qualitative research methods have been applied: 1) document analysis and 2) interviews with intervention developers, imposers, implementers and participants. In addition to the observation that the scientific basis for linking specific criminogenic factors to cybercriminals is still fragile, the article concludes that the theoretical base and program integrity of Hack_Right need to be further developed in order to adhere to principles of effective interventions.
DOCUMENT
Background: The Nurses in the Lead (NitL) programme consists of a systematic approach and training to 1) empower community nurses in implementing evidence, targeted at encouraging functional activities of older adults, and 2) train community nurses in enabling team members to change their practice. This article aims to describe the process evaluation of NitL. Methods: A mixed-methods formative process evaluation with a predominantly qualitative approach was conducted. Qualitative data were collected by interviews with community nurses (n = 7), focus groups with team members (n = 31), and reviewing seven implementation plans and 28 patient records. Quantitative data were collected among community nurses and team members (N = 90) using a questionnaire to assess barriers in encouraging functional activities and attendance lists. Data analysis was carried out through descriptive statistics and content analysis. Results: NitL was largely executed according to plan. Points of attention were the use and value of the background theory within the training, completion of implementation plans, and reporting in patient records by community nurses. Inhibiting factors for showing leadership and encouraging functional activities were a lack of time and a high complexity of care; facilitating factors were structure and clear communication within teams. Nurses considered the systematic approach useful and the training educational for their role. Most team members considered NitL practical and were satisfied with the coaching provided by community nurses. To optimise NitL, community nurses recommended providing the training first and extending the training. The team members recommended continuing clinical lessons, which were an implementation strategy from the community nurses. Conclusions: NitL was largely executed as planned, and appears worthy of further application in community care practice. However, adaptations are recommended to make NitL more promising in practice in empowering community nurse leadership in implementing evidence.
DOCUMENT
Cooperatives are special because the members not only own the cooperative, but also patronize it. CEO’s decision has an impact on the overall members’ interests. Understanding how CEOs differ from members regarding their evaluations on cooperative performance and what causes the differences, is valuable for CEOs to best serve the members. This paper evaluates the difference between CEO and member evaluation regarding their cooperatives, and further examines the role of governance in predicting the evaluations and differences in evaluations, based on a set of first-hand data containing Chinese agricultural cooperatives (240 CEOs and 543 members). Cooperative performance is measured by three indicators: member profitability, social influence in the local community, and overall performance. The results show that members have higher scores than CEOs regarding member profitability and overall performance, while CEOs have a higher evaluation regarding social influence. “This is an Accepted Manuscript of an article published by Taylor & Francis in 'The Social Science Journal' on 27 Jan. 2020 available online: https://www.tandfonline.com/doi/abs/10.1016/j.soscij.2019.01.006. LinkedIn: https://www.linkedin.com/in/xiao-peng-20466772/
MULTIFILE
Living labs are complex multi-stakeholder collaborations that often employ a usercentred and design-driven methodology to foster innovation. Conventional management tools fall short in evaluating them. However, some methods and tools dedicated to living labs' special characteristics and goals have already been developed. Most of them are still in their testing phase. Those tools are not easily accessible and can only be found in extensive research reports, which are difficult to dissect. Therefore, this paper reviews seven evaluation methods and tools specially developed for living labs. Each section of this paper is structured in the following manner: tool’s introduction (1), who uses the tool (2), and how it should be used (3). While the first set of tools, namely “ENoLL 20 Indicators”, “SISCODE Self-assessment”, and “SCIROCCO Exchange Tool” assess a living lab as an organisation and are diving deeper into the organisational activities and the complex context, the second set of methods and tools, “FormIT” and “Living Lab Markers”, evaluate living labs’ methodologies: the process they use to come to innovations. The paper's final section presents “CheRRIes Monitoring and Evaluation Tool” and “TALIA Indicator for Benchmarking Service for Regions”, which assess the regional impact made by living labs. As every living lab is different regarding its maturity (as an organisation and in its methodology) and the scope of impact it wants to make, the most crucial decision when evaluating is to determine the focus of the assessment. This overview allows for a first orientation on worked-out methods and on possible indicators to use. It also concludes that the existing tools are quite managerial in their method and aesthetics and calls for designers and social scientists to develop more playful, engaging and (possibly) learning-oriented tools to evaluate living labs in the future. LinkedIn: https://www.linkedin.com/in/overdiek12345/ https://www.linkedin.com/in/mari-genova-17a727196/?originalSubdomain=nl
DOCUMENT
The use of games as interventions in the domain of health care is of-ten paired with evaluating the effects in randomized clinical trials. The iterative design and development process of games usually also involves an evaluation phase, aimed at identifying improvements for subsequent iterations. Since game design theory and theories from associated fields provide no unified framework for designing successful interventions, interpreting evaluation results and for-mulating improvements is complicated. This case study explores an approach of monitoring design decisions and corresponding theories throughout the design and development cycle, allowing evaluation results to be attributed to design decisions. Such an approach may allow the game design and development pro-cess to iterate the game more efficiently towards use in practice.3rd European Conference on Gaming and Playful Interaction in Health Care.
DOCUMENT
Introduction: Depression can be a serious problem in young adult students. There is a need to implement and monitor prevention interventions for these students. Emotion-regulating improvisational music therapy (EIMT) was developed to prevent depression. The purpose of this study was to evaluate the feasibility of EIMT for use in practice for young adult students with depressive symptoms in a university context. Method: A process evaluation was conducted embedded in a larger research project. Eleven students, three music therapists and five referrers were interviewed. The music therapists also completed evaluation forms. Data were collected concerning client attendance, treatment integrity, musical components used to synchronise, and experiences with EIMT and referral. Results: Client attendance (90%) and treatment integrity were evaluated to be sufficient (therapist adherence 83%; competence 84%). The music therapists used mostly rhythm to synchronise (38 of 99 times). The students and music therapists reported that EIMT and its elements evoked changes in all emotion regulation components. The students reported that synchronisation elicited meaningful experiences of expressing joy, feeling heard, feeling joy and bodily responses of relaxation. The music therapists found the manual useful for applying EIMT. The student counsellors experienced EIMT as an appropriate way to support students due to its preventive character. Discussion: EIMT appears to be a feasible means of evoking changes in emotion regulation components in young adult students with depressive symptoms in a university context. More studies are needed to create a more nuanced and evidence-based understanding of the feasibility of EIMT, processes of change and treatment integrity.
DOCUMENT
Aim: To evaluate healthcare professionals' performance and treatment fidelity in the Cardiac Care Bridge (CCB) nurse-coordinated transitional care intervention in older cardiac patients to understand and interpret the study results. Design: A mixed-methods process evaluation based on the Medical Research Council Process Evaluation framework. Methods: Quantitative data on intervention key elements were collected from 153 logbooks of all intervention patients. Qualitative data were collected using semi-structured interviews with 19 CCB professionals (cardiac nurses, community nurses and primary care physical therapists), from June 2017 until October 2018. Qualitative data-analysis is based on thematic analysis and integrated with quantitative key element outcomes. The analysis was blinded to trial outcomes. Fidelity was defined as the level of intervention adherence. Results: The overall intervention fidelity was 67%, ranging from severely low fidelity in the consultation of in-hospital geriatric teams (17%) to maximum fidelity in the comprehensive geriatric assessment (100%). Main themes of influence in the intervention performance that emerged from the interviews are interdisciplinary collaboration, organizational preconditions, confidence in the programme, time management and patient characteristics. In addition to practical issues, the patient's frailty status and limited motivation were barriers to the intervention. Conclusion: Although involved healthcare professionals expressed their confidence in the intervention, the fidelity rate was suboptimal. This could have influenced the non-significant effect of the CCB intervention on the primary composite outcome of readmission and mortality 6 months after randomization. Feasibility of intervention key elements should be reconsidered in relation to experienced barriers and the population. Impact: In addition to insight in effectiveness, insight in intervention fidelity and performance is necessary to understand the mechanism of impact. This study demonstrates that the suboptimal fidelity was subject to a complex interplay of organizational, professionals' and patients' issues. The results support intervention redesign and inform future development of transitional care interventions in older cardiac patients.
DOCUMENT
Background: Implementation of an eRehabilitation intervention named Fit After Stroke @Home (Fast@home) – including cognitive/physical exercise applications, activity-tracking, psycho-education – after stroke resulted in health-related improvements. This study investigated what worked and why in the implementation. Methods: Implementation activities (information provision, integration of Fast@home, instruction and motivation) were performed for 14 months and evaluated, using the Medical Research Council framework for process evaluations which consists of three evaluation domains (implementation, mechanisms of impact and contextual factors). Implementation activities were evaluated by field notes/surveys/user data, it’s mechanisms of impact by surveys and contextual factors by field notes/interviews among 11 professionals. Surveys were conducted among 51 professionals and 73 patients. User data (n=165 patients) were extracted from the eRehabilitation applications. Results: Implementation activities were executed as planned. Of the professionals trained to deliver the intervention (33 of 51), 25 (75.8%) delivered it. Of the 165 patients, 82 (49.7%) were registered for Fast@home, with 54 patient (65.8%) using it. Mechanisms of impact showed that professionals and patients were equally satisfied with implementation activities (median score 7.0 [IQR 6.0–7.75] versus 7.0 [6.0–7.5]), but patients were more satisfied with the intervention (8.0 [IQR 7.0–8.0] versus 5.5 [4.0–7.0]). Guidance by professionals was seen as most impactful for implementation by patients and support of clinical champions and time given for training by professionals. Professionals rated the integration of Fast@home as insufficient. Contextual factors (financial cutbacks and technical setbacks) hampered the implementation. Conclusion: Main improvements of the implementation of eRehabilitation are related to professionals’ perceptions of the intervention, integration of eRehabilitation and contextual factors.
DOCUMENT
