In programmatic assessment (PA), an arrangement of different assessment methods is deliberately designed across the entire curriculum, combined and planned to support both robust decision-making and student learning. In health sciences education, evidence about the merits and pitfalls of PA is emerging. Although there is consensus about the theoretical principles of PA, programs make diverse design choices based on these principles to implement PA in practice, fitting their own contexts. We therefore need a better understanding of how the PA principles are implemented across contexts—within and beyond health sciences education. In this study, interviews were conducted with teachers/curriculum designers representing nine different programs in diverse professional domains. Research questions focused on: (1) design choices made, (2) whether these design choices adhere to PA principles, (3) student and teacher experiences in practice, and (4) context-specific differences between the programs. A wide range of design choices were reported, largely adhering to PA principles but differing across cases due to contextual alignment. Design choices reported by almost all programs include a backbone of learning outcomes, data-points connected to this backbone in a longitudinal design allowing uptake of feedback, intermediate reflective meetings, and decision-making based on a multitude of data-points made by a committee and involving multi-stage procedures. Contextual design choices were made aligning the design to the professional domain and practical feasibility. Further research is needed in particular with regard to intermediate-stakes decisions.
LINK
Teachers’ assessment literacy affects the quality of assessments and is, therefore, an essential part of teachers’ competence. Recent studies define assessment literacy as a dynamic, contextual and social construct, situated in practice and mediated by teachers’ identity and conceptions of assessment. This study provides a further elaboration of assessment literacy by exploring teachers’ conceptions of assessment literacy from a sociocultural perspective. Eleven online focus group interviews were conducted within the context of Dutch higher professional education between June and December 2020. A template analysis method was used to analyse the data. Seven interrelated aspects of assessment literacy were identified, namely ‘continuously developing assessment literacy’, ‘conscientious decision making’, ‘aligning’, ‘collaborating’, ‘discussing’, ‘improving and innovating’, and ‘coping with tensions’. This representation of assessment literacy, based on teachers’ conceptions, may guide teachers’ development of assessment literacy in practice.
LINK
from the article: "While previous studies have stressed the importance of feedback delivered by experts, it is unclear whether students' oral presentation competence can be fostered through innovative technology for delivering feedback. This experimental study examined the effectiveness of a virtual reality-based task, in which first-year undergraduate students practiced their presentation in a virtual environment and received feedback produced by the system, on their presentation competence components (i.e. cognition, behaviour and attitudes towards presenting). The effects were compared with a control condition, which was a face-to-face presentation task with expert feedback. The students’ performance was measured using pre- and post-test multiple-choice tests, validated rubrics, and self-evaluation instruments. Results revealed significant improvements from pre-test to post-test in all three presentation competence components, without a difference between the conditions. Furthermore, the self-evaluation tests showed that students who presented in virtual reality were appreciative of the detailed and analytical feedback they received. Because of sample size limitations, the effects found could not be generalised. Therefore, future research on a larger sample is needed to examine population effects. Follow-up studies should focus on the extent to which virtual reality-based tasks can encourage self-regulation skills for the effective and efficient integration of these tasks in presentation courses. "
LINK
Teachers have a crucial role in bringing about the extensive social changes that are needed in the building of a sustainable future. In the EduSTA project, we focus on sustainability competences of teachers. We strengthen the European dimension of teacher education via Digital Open Badges as means of performing, acknowledging, documenting, and transferring the competencies as micro-credentials. EduSTA starts by mapping the contextual possibilities and restrictions for transformative learning on sustainability and by operationalising skills. The development of competence-based learning modules and open digital badge-driven pathways will proceed hand in hand and will be realised as learning modules in the partnering Higher Education Institutes and badge applications open for all teachers in Europe.Societal Issue: Teachers’ capabilities to act as active facilitators of change in the ecological transition and to educate citizens and workforce to meet the future challenges is key to a profound transformation in the green transition.Teachers’ sustainability competences have been researched widely, but a gap remains between research and the teachers’ practise. There is a need to operationalise sustainability competences: to describe direct links with everyday tasks, such as curriculum development, pedagogical design, and assessment. This need calls for an urgent operationalisation of educators’ sustainability competences – to support the goals with sustainability actions and to transfer this understanding to their students.Benefit to society: EduSTA builds a community, “Academy of Educators for Sustainable Future”, and creates open digital badge-driven learning pathways for teachers’ sustainability competences supported by multimodal learning modules. The aim is to achieve close cooperation with training schools to actively engage in-service teachers.Our consortium is a catalyst for leading and empowering profound change in the present and for the future to educate teachers ready to meet the challenges and act as active change agents for sustainable future. Emphasizing teachers’ essential role as a part of the green transition also adds to the attractiveness of teachers’ work.
