Formative assessment (FA) is an effective educational approach for optimising student learning and is considered as a promising avenue for assessment within physical education (PE). Nevertheless, implementing FA is a complex and demanding task for in-service PE teachers who often lack formal training on this topic. To better support PE teachers in implementing FA into their practice, we need better insight into teachers’ experiences while designing and implementing formative strategies. However, knowledge on this topic is limited, especially within PE. Therefore, this study examined the experiences of 15 PE teachers who participated in an 18-month professional development programme. Teachers designed and implemented various formative activities within their PE lessons, while experiences were investigated through logbook entries and focus groups. Findings indicated various positive experiences, such as increased transparency in learning outcomes and success criteria for students as well as increased student involvement, but also revealed complexities, such as shifting teacher roles and insufficient feedback literacy among students. Overall, the findings of this study underscore the importance of a sustained, collaborative, and supported approach to implementing FA.
DOCUMENT
Paperpresentatie tijdens EAPRIL, Tartu, Estonia, 27-29 november 2019
DOCUMENT
Earlier research argues that educational programmes based on social cognitive theory are successful in improving students’ self-efficacy. Focusing on some formative assessment characteristics, this qualitative research intends to study in-depth how student teachers’ assessment experiences contribute to their self-efficacy. We interviewed 15 second year student teachers enrolled in a competence based teacher educational programme. Thematic content analysis results reveal that the assessment characteristics ‘authenticity’ and ‘feedback’ exert a positive influence on student teachers self-efficacy during all phases of the portfolio competence assessment. The results provide a fine-grained view of several types of self-efficacy information connected with these assessment phases.
DOCUMENT
A growing number of higher education programmes in the Netherlands has implemented programmatic assessment. Programmatic assessment is an assessment concept in which the formative and summative function of assessment is intertwined. Although there is consensus about the theoretical principles of programmatic assessment, programs make various specific design choices, fitting with their own context. In this factsheet we give insight into the design choices Dutch higher education programmes make when implementing programmatic assessment.
DOCUMENT
CC-BY-NC-NDObjective: In the past decade, several authors have advocated that formative assessment programmes have an impact on teachers’ knowledge. Consequently, various requirements have been proposed in the literature for the design of these programmes. Only few studies, however, have focused on a direct comparison between programmes with respect to differences observed in their effect on teachers’ knowledge. Therefore in this study we explored the impact of three formative assessment programmes on teachers’ knowledge about supporting students’ reflection.Methods: Our study was carried out in the domain of vocational nursing education. Teachers were assigned to an expertise-based assessment programme, a self-assessment combined with collegial feedback programme, or a negotiated assessment programme. We scored the verbal transcriptions of teachers’ responses to video vignette interviews in order to measure their knowledge in a pre- and post-test. Multilevel regression analyses were performed to investigate differences in teachers’ knowledge between the three programmes on the post-test; potential moderating effects of pre-test scores, contextual and individual factors were controlled for.Findings: The knowledge of teachers participating in the expertise-based assessment programme was significantly higher than that of teachers participating in the self-assessment combined with collegial feedback programme. Furthermore, the findings indicate that for professional learning, not only the approach to formative assessment is an important variable, but also the extent to which (a) teachers are intrinsically motivated and (b) they experience a high degree of collegiality at their school.
MULTIFILE
Assessment in higher education (HE) is often focused on concluding modules with one or more tests that students need to pass. As a result, both students and teachers are primarily concerned with the summative function of assessment: information from tests is used to make pass/fail decisions about students. In recent years, increasing attention has been paid to the formative function of assessment and focus has shifted towards how assessment can stimulate learning. However, this also leads to a search for balance between both functions of assessment. Programmatic assessment (PA) is an assessment concept in which their intertwining is embraced to strike a new balance. A growing number of higher education programmes has implemented PA. Although there is consensus about the theoretical principles that form the basis for the design of PA, programmes make various specific design choices based on these principles, fitting with their own context. This paper provides insight into the design choices that programmes make when implementing PA and into the considerations that play a role in making these design choices. Such an overview is important for research purposes because it creates a framework for investigating the effects of different design choices within PA.
DOCUMENT
Assessment in higher education (HE) is often focused on concluding modules with one or more tests that students need to pass. As a result, both students and teachers are primarily concerned with the summative function of assessment: information from tests is used to make pass/fail decisions about students. In recent years, increasing attention has been paid to the formative function of assessment and focus has shifted towards how assessment can stimulate learning. However, this also leads to a search for balance between both functions of assessment. Programmatic assessment (PA) is an assessment concept in which their intertwining is embraced to strike a new balance. A growing number of higher education programmes has implemented PA. Although there is consensus about the theoretical principles that form the basis for the design of PA, programmes make various specific design choices based on these principles, fitting with their own context. This paper provides insight into the design choices that programmes make when implementing PA and into the considerations that play a role in making these design choices. Such an overview is important for research purposes because it creates a framework for investigating the effects of different design choices within PA.
DOCUMENT
To cope with changing demands from society, higher education institutes are developing adaptive curricula in which a suitable integration of workplace learning is an important factor. Automated feedback can be used as part of formative assessment strategies to enhance student learning in the workplace. However due to the complex and diverse nature of workplace learning processes, it is difficult to align automated feedback to the needs of the individual student. The main research question we aim to answer in this design-based study is: ‘How can we support higher education students’ reflective learning in the workplace by providing automated feedback while learning in the workplace?’. Iterative development yielded 1) a framework for automated feedback in workplace learning, 2) design principles and guidelines and 3) an application prototype implemented according to this framework and design knowledge. In the near future, we plan to evaluate and improve these tentative products in pilot studies. https://link.springer.com/chapter/10.1007/978-3-030-25264-9_6
DOCUMENT
In programmatic assessment (PA), an arrangement of different assessment methods is deliberately designed across the entire curriculum, combined and planned to support both robust decision-making and student learning. In health sciences education, evidence about the merits and pitfalls of PA is emerging. Although there is consensus about the theoretical principles of PA, programs make diverse design choices based on these principles to implement PA in practice, fitting their own contexts. We therefore need a better understanding of how the PA principles are implemented across contexts—within and beyond health sciences education. In this study, interviews were conducted with teachers/curriculum designers representing nine different programs in diverse professional domains. Research questions focused on: (1) design choices made, (2) whether these design choices adhere to PA principles, (3) student and teacher experiences in practice, and (4) context-specific differences between the programs. A wide range of design choices were reported, largely adhering to PA principles but differing across cases due to contextual alignment. Design choices reported by almost all programs include a backbone of learning outcomes, data-points connected to this backbone in a longitudinal design allowing uptake of feedback, intermediate reflective meetings, and decision-making based on a multitude of data-points made by a committee and involving multi-stage procedures. Contextual design choices were made aligning the design to the professional domain and practical feasibility. Further research is needed in particular with regard to intermediate-stakes decisions.
LINK
Background: The importance of clarifying goals and providing process feedback for student learning has been widely acknowledged. From a Self-Determination Theory perspective, it is suggested that motivational and learning gains will be obtained because in well-structured learning environments, when goals and process feedback are provided, students will feel more effective (need for competence), more in charge over their own learning (need for autonomy) and experience a more positive classroom atmosphere (need for relatedness). Yet, in spite of the growing theoretical interest in goal clarification and process feedback in the context of physical education (PE), little experimental research is available about this topic. Purpose: The present study quasi-experimentally investigated whether the presence of goal clarification and process feedback positively affects students’ need satisfaction and frustration. Method: Twenty classes from five schools with 492 seventh grade PE students participated in this quasi-experimental study. Within each school, four classes were randomly assigned to one of the four experimental conditions (n = 121, n = 117, n = 126 and n = 128) in a 2 × 2 factorial design, in which goal clarification (absence vs. presence) and process feedback (absence vs. presence) were experimentally manipulated. The experimental lesson consisted of a PE lesson on handstand (a relatively new skill for seventh grade students), taught by one and the same teacher who went to the school of the students to teach the lesson. Depending on the experimental condition, the teacher either started the lesson explaining the goals, or refrained from explaining the goals. Throughout the lesson the teacher either provided process feedback, or refrained from providing process feedback. All other instructions were similar across conditions, with videos of exercises of differential levels of difficulty provided to the students. All experimental lessons were observed by a research-assistant to discern whether manipulations were provided according to a condition-specific script. One week prior to participating in the experimental lesson, data on students’ need-based experiences (i.e. quantitatively) were gathered. Directly after students’ participation in the experimental lesson, data on students’ perceptions of goal clarification and process feedback, need-based experiences (i.e. quantitatively) and experiences in general (i.e. qualitatively) were gathered. Results and discussion: The questionnaire data and observations revealed that manipulations were provided according to the lesson-scripts. Rejecting our hypothesis, quantitative analyses indicated no differences in need satisfaction across conditions, as students were equally satisfied in their need for competence, autonomy and relatedness regardless of whether the teacher provided goal clarification and process feedback, only goal clarification, only process feedback or none. Similar results were found for need frustration. Qualitative analyses indicated that, in all four conditions, aspects of the experimental lesson made students feel more effective, more in charge over their own learning and experience a more positive classroom atmosphere. Our results suggest that under certain conditions, lessons can be perceived as highly need-satisfying by students, even if the teacher does not verbally and explicitly clarify the goals and/ or provides process feedback. Perhaps, students were able to self-generate goals and feedback based on the instructional videos.
DOCUMENT
