In response to dissatisfaction with testing cultures in higher education, programmatic assessment has been introduced as an alternative approach. Programmatic ssessment involves the longitudinal collection of data points about student learning, aimed at continuous monitoring and feedback. High-stakes decisions are based on a multitude of data points, involving aggregation, saturation and group-decision making. Evidence about the value of programmatic assessment is emerging in health sciences education. However, research also shows that students find it difficult to take an active role in the assessment process and seek feedback. Lower performing students are underrepresented in research on programmatic assessment, which until now mainly focuses on health sciences education. This study therefore explored low and high performing students’ experiences with learning and decision-making in programmatic assessment in relation to their feedback-seeking behaviour in a Communication Sciences program. In total, 55 students filled out a questionnaire about their perceptions of programmatic assessment, their feedback-seeking behaviour and learning performance. Low-performing and high-performing students were selected and interviewed. Several designable elements of programmatic assessment were distinguished that promote or hinder students’ feedback-seeking behaviour, learning and uptake of feedback.
LINK
Het welzijn van studenten in het hoger onderwijs staat onder druk. Binnen hogeschool Inholland wordt het welzijn van studenten gemeten met de jaarlijkse studentenwelzijnsmonitor. In de ronde van 2022 werd voor het eerst aan studenten die dat wilden een feedbackrapportage met persoonlijke scores, tips en hulpbronnen teruggekoppeld. Verschillen tussen studenten die wel of niet feedback wilden ontvangen zijn onderzocht en in een aanvullende studie is gekeken hoe studenten de feedbackrapportage evalueerden. Van de 1462 deelnemers van de studentenwelzijnsmonitor 2022, hebben 819 (56%) ervoor gekozen de persoonlijke feedback te ontvangen. Op het gebied van welzijn zijn geen verschillen gevonden tussen studenten die wel of geen feedback wilden ontvangen. Aan de aanvullende studie hebben 48 studenten deelgenomen. Zij die de feedbackrapportage wilden ontvangen (n= 30) waren nieuwsgierig naar de uitkomsten en persoonlijke verbeterpunten. Zij beoordeelden de feedback met een 7,2 gemiddeld. Deelnemende studenten die geen feedbackrapportage wilden ontvangen (n= 18) wisten de reden niet meer of gaven aan al te weten hoe het met het eigen welzijn gesteld is. Na het tonen van een voorbeeld van een dergelijke feedbackrapportage, gaf 62% aan volgende keer waarschijnlijk wel voor feedback te kiezen. De feedbackrapportages werden positief beoordeeld, maar er is volgens studenten ruimte voor verbetering in onder andere de vormgeving en uitleg over de scores. De feedback is meegenomen in de doorontwikkeling van de feedbackrapportages van de studentenwelzijnsmonitor 2023.
DOCUMENT
From the article: "AbstractFeedback plays a central role in learning. Crucial to this is the nature and timing ofthe feedback. This experimental study explores the efficacy of immediate computer-mediated feedback within a virtual reality environment designed to facilitate thedevelopment of pre-university students' presentation skills. Two conditions wereestablished to assess the efficacy: immediate computer-mediated feedback; a controlcondition of delayed expert-mediated feedback. Results showed improvement butno statistically relevant difference in performance gains between the two conditions,suggesting both can facilitate learning. Furthermore, students perceived the environ-ment to be an effective and motivating platform in which to practise presentationskills. For educators seeking viable alternatives to face-to-face presentation practiceand feedback, the finding that immediate computer-mediated feedback is potentiallyas effective in aiding presentation performance is crucial for two reasons: first, itexpands practice opportunities for students; second, it could result in less pressureon resources, including time and staffing."
LINK
Background: The importance of clarifying goals and providing process feedback for student learning has been widely acknowledged. From a Self-Determination Theory perspective, it is suggested that motivational and learning gains will be obtained because in well-structured learning environments, when goals and process feedback are provided, students will feel more effective (need for competence), more in charge over their own learning (need for autonomy) and experience a more positive classroom atmosphere (need for relatedness). Yet, in spite of the growing theoretical interest in goal clarification and process feedback in the context of physical education (PE), little experimental research is available about this topic. Purpose: The present study quasi-experimentally investigated whether the presence of goal clarification and process feedback positively affects students’ need satisfaction and frustration. Method: Twenty classes from five schools with 492 seventh grade PE students participated in this quasi-experimental study. Within each school, four classes were randomly assigned to one of the four experimental conditions (n = 121, n = 117, n = 126 and n = 128) in a 2 × 2 factorial design, in which goal clarification (absence vs. presence) and process feedback (absence vs. presence) were experimentally manipulated. The experimental lesson consisted of a PE lesson on handstand (a relatively new skill for seventh grade students), taught by one and the same teacher who went to the school of the students to teach the lesson. Depending on the experimental condition, the teacher either started the lesson explaining the goals, or refrained from explaining the goals. Throughout the lesson the teacher either provided process feedback, or refrained from providing process feedback. All other instructions were similar across conditions, with videos of exercises of differential levels of difficulty provided to the students. All experimental lessons were observed by a research-assistant to discern whether manipulations were provided according to a condition-specific script. One week prior to participating in the experimental lesson, data on students’ need-based experiences (i.e. quantitatively) were gathered. Directly after students’ participation in the experimental lesson, data on students’ perceptions of goal clarification and process feedback, need-based experiences (i.e. quantitatively) and experiences in general (i.e. qualitatively) were gathered. Results and discussion: The questionnaire data and observations revealed that manipulations were provided according to the lesson-scripts. Rejecting our hypothesis, quantitative analyses indicated no differences in need satisfaction across conditions, as students were equally satisfied in their need for competence, autonomy and relatedness regardless of whether the teacher provided goal clarification and process feedback, only goal clarification, only process feedback or none. Similar results were found for need frustration. Qualitative analyses indicated that, in all four conditions, aspects of the experimental lesson made students feel more effective, more in charge over their own learning and experience a more positive classroom atmosphere. Our results suggest that under certain conditions, lessons can be perceived as highly need-satisfying by students, even if the teacher does not verbally and explicitly clarify the goals and/ or provides process feedback. Perhaps, students were able to self-generate goals and feedback based on the instructional videos.
DOCUMENT
Uit onderzoek blijkt de kwaliteit van de leraar voor de klas de meest belangrijke factor is op het leerresultaat van leerlingen.Leraarschap is een professie en net als andere professionals moeten leraren hun vak bijhouden en constant hun eigen handelen evalueren en verbeteren. Soms gaat dat vanzelf, bijvoorbeeld bij beginnende leraren. Om te overleven, zijn zij gedwongen heel snel te leren en zich verder te ontwikkelen. Maar meer ervaren leraren hebben inmiddels allerlei routines opgebouwd en missen vaak wat Koffeman (2011) noemt de 'noodzaak tot leren'. Het proefschrift beschrijft mogelijkheden om de professionalisering van leraren te stimuleren door middel van reflectiegesprekken met collega's en het gebruik van videofeedback. Het proefschrift betreft een ontwerponderzoek met als doel: op onderzoek gebaseerde oplossingen te ontwikkelen voor complexe problemen uit de onderwijspraktijk en tevens bij te dragen aan wetenschappelijke theorievorming, door het bestuderen van de onderliggende ontwerpprincipes. Samen met een school voor voortgezet onderwijs is een concreet programma ontworpen dat meer informele vormen van leren op de werkplek tussen leraren stimuleert. Door het ontwerpproces en de uitkomsten stap voor stap te beschrijven, levert dit onderzoek niet alleen een kant-en-klaar professionaliseringsprogramma dat andere scholen kunnen gaan gebruiken, maar levert het vooral ook bouwstenen op in de vorm van ontwerpprincipes en kennis over hoe en onder welke voorwaarden deze in de school kunnen werken. Met deze bouwstenen worden ook andere scholen in staat gesteld om het programma aan te passen aan de context van de eigen school.
DOCUMENT
This study investigated to what degree lesson-to-lesson variability in teachers' goal clarification and process feedback explains variability in secondary students’ motivational correlates. Students (N=570, 24 classes) completed questionnaires at six occasions. Multilevel regression analyses showed that relations between perceived process feedback and experienced need satisfaction (i.e., competence, autonomy and relatedness) were conditional on perceived goal clarification. No such interaction effects between process feedback and goal clarification were found for need frustration (i.e., experiencing failure, feeling pushed to achieve goals, feeling rejected). In general, when students perceived more process feedback or goal clarification, students experienced more competence, autonomy and relatedness satisfaction. Yet, when perceiving very high levels of process feedback, additional benefits of goal clarification were no longer present (and vice versa). In lessons in which students perceived goals to be less clear, they experienced more need frustration. No associations were found between process feedback and need frustration.
DOCUMENT
Study about voluntary use of mobile apps to promote behaviour change presented at the Etmaal voor de Communicatiewetenschap
LINK
Our research aims to formulate design guidelines for stimulating teachers' professional development using video feedback in collaborative settings. The study investigates guidelines concerning video feedback in peer coaching settings and focuses on a setting with three roles (of trainee, coach and observer), (c) coach training, (d) ownership of learning goals and (e) focus on outcomes in classroom. A scheme was developed consisting of six coach training sessions and of peer reciprocal coaching in subgroups with video feedback of classroom performances. Within these subgroups three teachers took turns in different roles: as trainee, as coach and as observer of the coaching dialogue. The study explores the coach's roles that are beneficial for the learning process of their peers and seeks to understand how watching video records of own practice supports teachers to examine their own professional behaviour in new ways. Data for this study includes videotaped and transcribed subgroup dialogues and, for triangulation, data from learning reports, audio tapes and observational notes of the training sessions, questionnaires, and in-depth semi-structured interviews with all participants. Coaching in a setting with three well defined roles (trainee, coach, observant) proved valuable. The coach role was very important for the depth of the reflection process. Non-directive coaching skills created necessary safety and space for learning, but more directive coaching skills such as 'Continue to ask questions' were necessary to deepen the reflection process from more descriptive and perceptive reflections to more receptive, interactive and critical reflections. In the dialogues the participants reflect on practice, on context, on values, and on improvements. Working with (peer) observers of the coaching dialogs improved performance and forced the group to take their roles more seriously. Essential for the scheme to work is a high degree of equality between participants.
DOCUMENT
Meetings with other professionals are considered crucial for enhancing the quality of teachers' reflections. However, little is yet known about how any beneficial effects of such meetings are brought about. This study explores the peer coach's roles and their influences on the learning processes of their peers and seeks to understand how watching video records of own practice, supports teachers to examine their own professional behaviour in new ways. Within subgroups three teachers took turns in different roles: as trainee, as coach and as observer of the coaching dialogue. They used video recordings of the interactions in their classrooms as feedback. Data for this study included videotaped and transcribed group dialogues and, for triangulation, data from learning reports, questionnaires, and in-depth semi-structured interviews with all participants. Coaching promoted broadening the scope of their reflections. Teachers often started just describing work situations with technical reflections on 'how to'. Non-directive coaching skills created necessary safety and space for learning, but video feedback and more directive coaching skills such as 'Continue to ask questions' were necessary to deepen the reflection process and to relate reflections with analysis of feelings, perspectives of other actors, and with political notions concerning social, moral and political issues. Peer coaching with video feedback affords positive impact to those who coach in addition to those who receive the coaching. Understanding different forms of teacher learning provides insight for research on teacher cognition and may inform the design of video-based professional development.
DOCUMENT
In programmatic assessment (PA), an arrangement of different assessment methods is deliberately designed across the entire curriculum, combined and planned to support both robust decision-making and student learning. In health sciences education, evidence about the merits and pitfalls of PA is emerging. Although there is consensus about the theoretical principles of PA, programs make diverse design choices based on these principles to implement PA in practice, fitting their own contexts. We therefore need a better understanding of how the PA principles are implemented across contexts—within and beyond health sciences education. In this study, interviews were conducted with teachers/curriculum designers representing nine different programs in diverse professional domains. Research questions focused on: (1) design choices made, (2) whether these design choices adhere to PA principles, (3) student and teacher experiences in practice, and (4) context-specific differences between the programs. A wide range of design choices were reported, largely adhering to PA principles but differing across cases due to contextual alignment. Design choices reported by almost all programs include a backbone of learning outcomes, data-points connected to this backbone in a longitudinal design allowing uptake of feedback, intermediate reflective meetings, and decision-making based on a multitude of data-points made by a committee and involving multi-stage procedures. Contextual design choices were made aligning the design to the professional domain and practical feasibility. Further research is needed in particular with regard to intermediate-stakes decisions.
LINK
