Learning activities in a makerspace are hands-on and characterized by design and inquiry. Evaluation is needed both for learners and their coaches in order to effectively guide the learning process of the children and for feedback on the effectiveness of the after-school maker activities. Due to its constructionist nature, learning in a makerspace requires specific forms of evaluation. In this paper we describe the development of an instrument that facilitates and captures reflection on the activities that children undertook in a library makerspace. Our aim is to capture learning in this context with multiple instruments: analysis of the artifacts that are made, observation of hands-on activities and interviews - which all are time consuming methods. Hence, we developed an easy to use tool for self-evaluation of maker learner activities for children. We build on the design of a visual instrument used for learning by design and inquiry in primary education. The findings and results are transferable to (formative) assessment and evaluation of learning activities by learners in other types of education and specific in maker education.
DOCUMENT
Objective: To examine the underlying factor structure and psychometric properties of the Assessment of Self-management in Anxiety and Depression (ASAD) questionnaire, which was specifically designed for patients with (chronic) anxiety and depressive disorders. Moreover, this study assesses whether the number of items in the ASAD can be reduced without significantly reducing its precision. Methods: The ASAD questionnaire was completed by 171 participants across two samples: one sample comprised patients with residual anxiety or depressive symptoms, while the other consisted of patients who have been formally diagnosed with a chronic anxiety or depressive disorder. All participants had previously undergone treatment. Both exploratory (EFA) and confirmatory factor analyses (CFA) were conducted. Internal consistency and test–retest reliability were also assessed. Results: Both EFA and CFA indicated three solid factors: Seeking support, Daily life strategies and Taking ownership [Comparative Fit Index = 0.80, Tucker Lewis Index = 0.78, Root Mean Square Error of Approximation = 0.09 (CI 0.08–1.00), Standardized Root Mean Square Residual = 0.09 ($2 = 439.35, df = 168)]. The ASAD was thus reduced from 45 items to 21 items, which resulted in the ASAD-Short Form (SF). All sub-scales had a high level of internal consistency (> a = 0.75) and test–retest reliability (ICC > 0.75). Discussion: The first statistical evaluation of the ASAD indicated a high level of internal consistency and test–retest reliability, and identified three distinctive factors. This could aid patients and professionals’ assessment of types of self-management used by the patient. Given that this study indicated that the 21-item ASAD-SF is appropriate, this version should be further explored and validated among a sample of patients with (chronic or partially remitted) anxiety and depressive disorders. Alongside this, to increase generalizability, more studies are required to examine the English version of the ASAD within other settings and countries.
DOCUMENT
Background: The aim of this study is to validate a newly developed nurses' self-efficacy sources inventory. We test the validity of a five-dimensional model of sources of self-efficacy, which we contrast with the traditional four-dimensional model based on Bandura's theoretical concepts. Methods: Confirmatory factor analysis was used in the development of the newly developed self-efficacy measure. Model fit was evaluated based upon commonly recommended goodness-of-fit indices, including the χ2 of the model fit, the Root Mean Square Error of approximation (RMSEA), the Tucker-Lewis Index (TLI), the Standardized Root Mean Square Residual (SRMR), and the Bayesian Information Criterion (BIC). Results: All 22 items of the newly developed five-factor sources of self-efficacy have high factor loadings (range .40-.80). Structural equation modeling showed that a five-factor model is favoured over the four-factor model. Conclusions and implications: Results of this study show that differentiation of the vicarious experience source into a peer- and expert based source reflects better how nursing students develop self-efficacy beliefs. This has implications for clinical learning environments: a better and differentiated use of self-efficacy sources can stimulate the professional development of nursing students.
DOCUMENT
In the last decade, the automotive industry has seen significant advancements in technology (Advanced Driver Assistance Systems (ADAS) and autonomous vehicles) that presents the opportunity to improve traffic safety, efficiency, and comfort. However, the lack of drivers’ knowledge (such as risks, benefits, capabilities, limitations, and components) and confusion (i.e., multiple systems that have similar but not identical functions with different names) concerning the vehicle technology still prevails and thus, limiting the safety potential. The usual sources (such as the owner’s manual, instructions from a sales representative, online forums, and post-purchase training) do not provide adequate and sustainable knowledge to drivers concerning ADAS. Additionally, existing driving training and examinations focus mainly on unassisted driving and are practically unchanged for 30 years. Therefore, where and how drivers should obtain the necessary skills and knowledge for safely and effectively using ADAS? The proposed KIEM project AMIGO aims to create a training framework for learner drivers by combining classroom, online/virtual, and on-the-road training modules for imparting adequate knowledge and skills (such as risk assessment, handling in safety-critical and take-over transitions, and self-evaluation). AMIGO will also develop an assessment procedure to evaluate the impact of ADAS training on drivers’ skills and knowledge by defining key performance indicators (KPIs) using in-vehicle data, eye-tracking data, and subjective measures. For practical reasons, AMIGO will focus on either lane-keeping assistance (LKA) or adaptive cruise control (ACC) for framework development and testing, depending on the system availability. The insights obtained from this project will serve as a foundation for a subsequent research project, which will expand the AMIGO framework to other ADAS systems (e.g., mandatory ADAS systems in new cars from 2020 onwards) and specific driver target groups, such as the elderly and novice.
Due to their diverse funding sources, theatres are under increasing pressure to demonstrate impact on society. The Raad voor Cultuur (2023) for example advised the secretary of state to include societal impact as an additional evaluation measure next to artistic value. Many theaters, such as the Chassé Theater and Parkstad Limburg Theaters, have reformulated their missions to focus on impact of performances on visitors. This is a profound transformation from merely selling tickets and filling seats, and requires new measurement instruments to monitor, manage, and improve impact. Currently available instruments are insufficient, and effective monitoring is crucial to larger future projects that theaters are currently planning to systematically broaden impacts of performances on their communities. The specific goal of this project is to empower theaters to monitor and improve impact by developing a brief experience impact questionnaire, taking existing data from student projects conducted at the Chassé Theater about performing arts experiences on one hand, and experience impact theory innovations on the other, as starting points. We will develop potential items to measure and benchmark against established measures of valued societal outcomes, such as subjective well-being and quality of life. These will be measured in questionnaires developed with project partners Chassé Theater and Parkstad Limburg Theaters and administered before and after performances across a wide range of genres. The resulting data will enable comparison of new questionnaire items with benchmarked measures of valued societal outcomes. The final product of the project will be a brief impact questionnaire, which within several brief self-report instruments and just a few minutes can effectively be used to quantify the impact of a performing arts experience. A workshop and practice-oriented article will make this questionnaire implementable, thereby mobilizing the key enabling methodology of monitoring and impact measurement in the performing arts sector.
Due to their diverse funding sources, theatres are under increasing pressure to demonstrate impact on society. The Raad voor Cultuur (2023) for example advised the secretary of state to include societal impact as an additional evaluation measure next to artistic value. Many theaters, such as the Chassé Theater and Parkstad Limburg Theaters, have reformulated their missions to focus on impact of performances on visitors. This is a profound transformation from merely selling tickets and filling seats, and requires new measurement instruments to monitor, manage, and improve impact. Currently available instruments are insufficient, and effective monitoring is crucial to larger future projects that theaters are currently planning to systematically broaden impacts of performances on their communities.The specific goal of this project is to empower theaters to monitor and improve impact by developing a brief experience impact questionnaire, taking existing data from student projects conducted at the Chassé Theater about performing arts experiences on one hand, and experience impact theory innovations on the other, as starting points. We will develop potential items to measure and benchmark against established measures of valued societal outcomes, such as subjective well-being and quality of life. These will be measured in questionnaires developed with project partners Chassé Theater and Parkstad Limburg Theaters and administered before and after performances across a wide range of genres. The resulting data will enable comparison of new questionnaire items with benchmarked measures of valued societal outcomes. The final product of the project will be a brief impact questionnaire, which within several brief self-report instruments and just a few minutes can effectively be used to quantify the impact of a performing arts experience. A workshop and practice-oriented article will make this questionnaire implementable, thereby mobilizing the key enabling methodology of monitoring and impact measurement in the performing arts sector.Societal issueThe specific goal of this project is to empower theaters to monitor and improve impact by developing a brief experience impact questionnaire, taking existing data about performing arts experiences on one hand, and experience impact theory innovations on the other, as starting points. Benefit to societyWe will develop potential items to measure and benchmark against established measures of valued societal outcomes, such as subjective well-being and quality of life. Collaborative partnersChassé Theater N.V., Parkstad Limburg Theaters N.V.
