Learning activities in a makerspace are hands-on and characterized by design and inquiry. Evaluation is needed both for learners and their coaches in order to effectively guide the learning process of the children and for feedback on the effectiveness of the after-school maker activities. Due to its constructionist nature, learning in a makerspace requires specific forms of evaluation. In this paper we describe the development of an instrument that facilitates and captures reflection on the activities that children undertook in a library makerspace. Our aim is to capture learning in this context with multiple instruments: analysis of the artifacts that are made, observation of hands-on activities and interviews - which all are time consuming methods. Hence, we developed an easy to use tool for self-evaluation of maker learner activities for children. We build on the design of a visual instrument used for learning by design and inquiry in primary education. The findings and results are transferable to (formative) assessment and evaluation of learning activities by learners in other types of education and specific in maker education.
DOCUMENT
Communication plays an important role in manyprofessional contexts. This is especially truefor students in the field of social work. Theaim of this study was to develop formative,self-regulated multimedia self-assessment ofsocial-communicative competencies for socialwork students. First, a pilot study wasconducted to gain insight into the students'specific characteristics. This insight was usedto design guidelines for the development of theassessment instrument in order to tune these tothe students' perceptions, instructionalpreferences, and personalities and thusenhancing the students' enthusiasm to use theself-assessment instrument. This might increasethe chance for successful implementation ofthis new form of assessment. A first version of a multimedia test wasdeveloped. A quality expert meeting wasorganised to gain insight into expertjudgements on the quality of the test and toobtain indications for improvement of theassessment. A second version of the test wasconstructed and put on the Internet. Nearly 400students completed the assessment and expressedtheir opinions on this new way of communicationassessment. We found it was possible to testsocial-communicative competence by means ofmultimedia, with the help of digital video. Theuse of Internet makes assessments available atany time to fit curriculum needs and alsoresolves time and space constraints. Ourconclusion was that the multimedia test isreasonably valid. All students reported havingliked the multimedia assessment.
LINK
Objective: To examine the underlying factor structure and psychometric properties of the Assessment of Self-management in Anxiety and Depression (ASAD) questionnaire, which was specifically designed for patients with (chronic) anxiety and depressive disorders. Moreover, this study assesses whether the number of items in the ASAD can be reduced without significantly reducing its precision. Methods: The ASAD questionnaire was completed by 171 participants across two samples: one sample comprised patients with residual anxiety or depressive symptoms, while the other consisted of patients who have been formally diagnosed with a chronic anxiety or depressive disorder. All participants had previously undergone treatment. Both exploratory (EFA) and confirmatory factor analyses (CFA) were conducted. Internal consistency and test–retest reliability were also assessed. Results: Both EFA and CFA indicated three solid factors: Seeking support, Daily life strategies and Taking ownership [Comparative Fit Index = 0.80, Tucker Lewis Index = 0.78, Root Mean Square Error of Approximation = 0.09 (CI 0.08–1.00), Standardized Root Mean Square Residual = 0.09 ($2 = 439.35, df = 168)]. The ASAD was thus reduced from 45 items to 21 items, which resulted in the ASAD-Short Form (SF). All sub-scales had a high level of internal consistency (> a = 0.75) and test–retest reliability (ICC > 0.75). Discussion: The first statistical evaluation of the ASAD indicated a high level of internal consistency and test–retest reliability, and identified three distinctive factors. This could aid patients and professionals’ assessment of types of self-management used by the patient. Given that this study indicated that the 21-item ASAD-SF is appropriate, this version should be further explored and validated among a sample of patients with (chronic or partially remitted) anxiety and depressive disorders. Alongside this, to increase generalizability, more studies are required to examine the English version of the ASAD within other settings and countries.
DOCUMENT
Background: The aim of this study is to validate a newly developed nurses' self-efficacy sources inventory. We test the validity of a five-dimensional model of sources of self-efficacy, which we contrast with the traditional four-dimensional model based on Bandura's theoretical concepts. Methods: Confirmatory factor analysis was used in the development of the newly developed self-efficacy measure. Model fit was evaluated based upon commonly recommended goodness-of-fit indices, including the χ2 of the model fit, the Root Mean Square Error of approximation (RMSEA), the Tucker-Lewis Index (TLI), the Standardized Root Mean Square Residual (SRMR), and the Bayesian Information Criterion (BIC). Results: All 22 items of the newly developed five-factor sources of self-efficacy have high factor loadings (range .40-.80). Structural equation modeling showed that a five-factor model is favoured over the four-factor model. Conclusions and implications: Results of this study show that differentiation of the vicarious experience source into a peer- and expert based source reflects better how nursing students develop self-efficacy beliefs. This has implications for clinical learning environments: a better and differentiated use of self-efficacy sources can stimulate the professional development of nursing students.
DOCUMENT
This study explores the evaluation of research pathways of self-management health innovations from discovery to implementation in the context of practice-based research. The aim is to understand how a new process model for evaluating practice-based research provides insights into the implementation success of innovations. Data were collected from nine research projects in the Netherlands. Through document analysis and semi-structured interviews, we analysed how the projects start, evolve, and contribute to the healthcare practice. Building on previous researchevaluation approaches to monitor knowledge utilization, we developed a Research Pathway Model. The model’s process character enables us to include and evaluate the incremental work required throughout the lifespan of an innovation project and it helps to foreground that innovation continues during implementation in real-life settings. We found that in each researchproject, pathways are followed that include activities to explore a new solution, deliver a prototype and contribute to theory. Only three projects explored the solution in real life and included activities to create the necessary changes for the solutions to be adopted. These three projects were associated with successful implementation. The exploration of the solution in a real-life environment in which users test a prototype in their own context seems to be a necessaryresearch activity for the successful implementation of self-management health innovations.
LINK
Abstract: Background: Chronic obstructive pulmonary disease (COPD) and asthma have a high prevalence and disease burden. Blended self-management interventions, which combine eHealth with face-to-face interventions, can help reduce the disease burden. Objective: This systematic review and meta-analysis aims to examine the effectiveness of blended self-management interventions on health-related effectiveness and process outcomes for people with COPD or asthma. Methods: PubMed, Web of Science, COCHRANE Library, Emcare, and Embase were searched in December 2018 and updated in November 2020. Study quality was assessed using the Cochrane risk of bias (ROB) 2 tool and the Grading of Recommendations, Assessment, Development, and Evaluation. Results: A total of 15 COPD and 7 asthma randomized controlled trials were included in this study. The meta-analysis of COPD studies found that the blended intervention showed a small improvement in exercise capacity (standardized mean difference [SMD] 0.48; 95% CI 0.10-0.85) and a significant improvement in the quality of life (QoL; SMD 0.81; 95% CI 0.11-1.51). Blended intervention also reduced the admission rate (relative ratio [RR] 0.61; 95% CI 0.38-0.97). In the COPD systematic review, regarding the exacerbation frequency, both studies found that the intervention reduced exacerbation frequency (RR 0.38; 95% CI 0.26-0.56). A large effect was found on BMI (d=0.81; 95% CI 0.25-1.34); however, the effect was inconclusive because only 1 study was included. Regarding medication adherence, 2 of 3 studies found a moderate effect (d=0.73; 95% CI 0.50-0.96), and 1 study reported a mixed effect. Regarding self-management ability, 1 study reported a large effect (d=1.15; 95% CI 0.66-1.62), and no effect was reported in that study. No effect was found on other process outcomes. The meta-analysis of asthma studies found that blended intervention had a small improvement in lung function (SMD 0.40; 95% CI 0.18-0.62) and QoL (SMD 0.36; 95% CI 0.21-0.50) and a moderate improvement in asthma control (SMD 0.67; 95% CI 0.40-0.93). A large effect was found on BMI (d=1.42; 95% CI 0.28-2.42) and exercise capacity (d=1.50; 95% CI 0.35-2.50); however, 1 study was included per outcome. There was no effect on other outcomes. Furthermore, the majority of the 22 studies showed some concerns about the ROB, and the quality of evidence varied. Conclusions: In patients with COPD, the blended self-management interventions had mixed effects on health-related outcomes, with the strongest evidence found for exercise capacity, QoL, and admission rate. Furthermore, the review suggested that the interventions resulted in small effects on lung function and QoL and a moderate effect on asthma control in patients with asthma. There is some evidence for the effectiveness of blended self-management interventions for patients with COPD and asthma; however, more research is needed. Trial Registration: PROSPERO International Prospective Register of Systematic Reviews CRD42019119894; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=119894
DOCUMENT
This study was conducted in accordance with the Declaration of Helsinki, and the protocol was approved by the institutional medical ethic committee (number CWO -1911) and funded by Altrecht Mental Health Care. All participants of this study signed informed consent. The participants of this study did not give written consent for their data to be shared publicly outside of the Mental Health Institute were the data were generated. Derived data will be available conform APA policy to other researchers upon request. All authors had full access to the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis. The authors have no conflicts of interest to report. Abstract Epistemic trust (ET) refers to the predisposition to trust information as authentic, trustworthy and relevant to the self. Epistemic distrust – resulting from early adversity – may interfere with openness to social learning within the therapeutic encounter, reducing the ability to benefit from treatment. The self-report Questionnaire Epistemic Trust (QET) is a newly developed instrument that aims to assess ET. This study presents the first results on the psychometric properties of the QET in both a community and a clinical sample. Our findings indicate that the QET is composed of four meaningful subscales with good to excellent internal consistency. The QET shows relevant associations with related constructs like personality functioning, symptom distress and quality of life. QET scores clearly distinguish between a clinical and community sample and are associated with the quality of the therapeutic alliance. The QET provides a promising, brief and user-friendly instrument that could be used for a range of clinical and research purposes. Future studies with larger samples are needed to strengthen construct validity and to investigate the value of the QET to predict differential treatment responses or to study mechanisms of change.
LINK
Introduction: Self-management is considered a potential answer to the increasing demand for family medicine by people suffering from a chronic condition or multi-morbidity. A key element of self-management is goal setting. Goal setting is often defined as a moment of agreement between a professional and a patient. In the self-management literature, however, goal setting is regarded as a circular process. Still, it is unclear how professionals working in family medicine can put it into practice. This background paper aims to contribute to the understanding of goal setting within self-management and to identify elements that need further development for practical use. Debate: Four questions for debate emerge in this article: (1) What are self-management goals? (2) What is necessary to accomplish the process of goal setting within self-management? (3) How can professionals decide on the degree of support needed for goal setting within self-management? (4) How can patients set their goals and how can they be supported? Implications: Self-management goals can be set for different (life) domains. Using a holistic framework will help in creating an overview of patients’ goals that do not merely focus on medical issues. It is a challenge for professionals to coach their patients to think about and set their goals themselves. More insight in patients’ willingness and ability to set self-management goals is desirable. Moreover, as goal setting is a circular process, professionals need to be supported to go through this process with their patients.
DOCUMENT
Introduction: In March 2014, the New South Wales (NSW) Government (Australia) announced the NSW Integrated Care Strategy. In response, a family-centred, population-based, integrated care initiative for vulnerable families and their children in Sydney, Australia was developed. The initiative was called Healthy Homes and Neighbourhoods. A realist translational social epidemiology programme of research and collaborative design is at the foundation of its evaluation. Theory and Method: The UK Medical Research Council (MRC) Framework for evaluating complex health interventions was adapted. This has four components, namely 1) development, 2) feasibility/piloting, 3) evaluation and 4) implementation. We adapted the Framework to include: critical realist, theory driven, and continuous improvement approaches. The modified Framework underpins this research and evaluation protocol for Healthy Homes and Neighbourhoods. Discussion: The NSW Health Monitoring and Evaluation Framework did not make provisions for assessment of the programme layers of context, or the effect of programme mechanism at each level. We therefore developed a multilevel approach that uses mixed-method research to examine not only outcomes, but also what is working for whom and why.
LINK
