Search results

Walking the line between assessment, improvement and learning

Objectives There is a broad call for change towards € new era' quality systems in healthcare, in which the focus lies on learning and improving. A promising way to establish this in general practice care is to combine audit and feedback with peer group discussion. However, it is not known what different stakeholders think of this type of quality improvement. The aim of this research was to explore the opinions of different stakeholders in general practice on peer discussion of audit and feedback and on its opportunities and risks. Second, their thoughts on transparency versus accountability, regarding this system, were studied. Design An exploratory qualitative study within a constructivist paradigm. Semistructured interviews and focus group discussions were held and coded using thematic analysis. Included stakeholders were general practitioners (GP), patients, professional organisations and insurance companies. Setting General practice in the Netherlands. Participants 22 participants were purposively sampled for eight interviews and two focus group discussions. Results Three main opportunities of peer discussion of audit and feedback were identified: deeper levels of reflection on data, adding context to numbers and more ownership; and three main risks: handling of unwilling colleagues, lacking a safe group and the necessity of patient involvement. An additional theme concerned disagreement on the amount of transparency to be offered: insurance companies and patients advocated for complete transparency on data and improvement of outcomes, while GPs and professional organisations urged to restrict transparency to giving insight into the process. Conclusions Peer discussion of audit and feedback could be part of a change movement, towards a quality system based on learning and trust, that is initiated by the profession. Creating a safe learning environment and involving patients is key herein. Caution is needed when complete transparency is asked, since it could jeopardise practitioners' reflection and learning in safety.

Designing a Data Feedback Program to Improve Teachers Science and Technology Teaching Skills in Elementary Education

Do goal clarification and process feedback positively affect students’ need-based experiences?

Background: The importance of clarifying goals and providing process feedback for student learning has been widely acknowledged. From a Self-Determination Theory perspective, it is suggested that motivational and learning gains will be obtained because in well-structured learning environments, when goals and process feedback are provided, students will feel more effective (need for competence), more in charge over their own learning (need for autonomy) and experience a more positive classroom atmosphere (need for relatedness). Yet, in spite of the growing theoretical interest in goal clarification and process feedback in the context of physical education (PE), little experimental research is available about this topic. Purpose: The present study quasi-experimentally investigated whether the presence of goal clarification and process feedback positively affects students’ need satisfaction and frustration. Method: Twenty classes from five schools with 492 seventh grade PE students participated in this quasi-experimental study. Within each school, four classes were randomly assigned to one of the four experimental conditions (n = 121, n = 117, n = 126 and n = 128) in a 2 × 2 factorial design, in which goal clarification (absence vs. presence) and process feedback (absence vs. presence) were experimentally manipulated. The experimental lesson consisted of a PE lesson on handstand (a relatively new skill for seventh grade students), taught by one and the same teacher who went to the school of the students to teach the lesson. Depending on the experimental condition, the teacher either started the lesson explaining the goals, or refrained from explaining the goals. Throughout the lesson the teacher either provided process feedback, or refrained from providing process feedback. All other instructions were similar across conditions, with videos of exercises of differential levels of difficulty provided to the students. All experimental lessons were observed by a research-assistant to discern whether manipulations were provided according to a condition-specific script. One week prior to participating in the experimental lesson, data on students’ need-based experiences (i.e. quantitatively) were gathered. Directly after students’ participation in the experimental lesson, data on students’ perceptions of goal clarification and process feedback, need-based experiences (i.e. quantitatively) and experiences in general (i.e. qualitatively) were gathered. Results and discussion: The questionnaire data and observations revealed that manipulations were provided according to the lesson-scripts. Rejecting our hypothesis, quantitative analyses indicated no differences in need satisfaction across conditions, as students were equally satisfied in their need for competence, autonomy and relatedness regardless of whether the teacher provided goal clarification and process feedback, only goal clarification, only process feedback or none. Similar results were found for need frustration. Qualitative analyses indicated that, in all four conditions, aspects of the experimental lesson made students feel more effective, more in charge over their own learning and experience a more positive classroom atmosphere. Our results suggest that under certain conditions, lessons can be perceived as highly need-satisfying by students, even if the teacher does not verbally and explicitly clarify the goals and/ or provides process feedback. Perhaps, students were able to self-generate goals and feedback based on the instructional videos.

Shifting Patterns in Co-regulation, Feedback Perception, and Motivation During Research Supervision Meetings

Supervision meetings give teachers and students opportunities to interact with each other and to co-regulate students’ learning processes. Co-regulation refers to the transitional process of a student who is becoming a self-regulated learner by interacting with a more capable other such as a teacher. During a task, teachers are expected to pull back their support and give opportunities to students to take responsibility. This study aims to explore the shifting patterns of co-regulation, feedback perception, and motivation during a 5-month research project. Participants were 20 students conducting research in pairs and six teachers who supervised these students. Two videotaped supervision meetings at the beginning and end of the research process and questionnaires on feedback perception and motivation were analysed. Results on co-regulation showed a constant and comparable level of regulation at the start and at the end of students’ research projects. Feedback perception did not change, but motivation decreased significantly.

Designing a data feedback program to improve teachers’ science and technology teaching skills in elementary education

In this study, a data feedback program to improve teachers’ science and technology (S&T) teaching skills was designed and tested. The aim was to understand whether and how the four design principles underlying this program stimulated the intended teacher support. We examined how teachers in different phases of their career applied and experienced the employed design principles’ key aspects. Eight in-service teachers and eight pre-service teachers attended the data feedback program and kept a logbook in the meantime. Group interviews were held afterwards. Findings show that applying the four employed design principles’ key aspects did support and stimulate in- and pre-service teachers in carrying out data feedback for improving their S&T teaching. However, some key aspects were not applied and/or experienced as intended by all attending teachers. The findings provide possible implications for the development and implementation of professional development programs to support in - and pre-service teachers’ S&T teaching using data feedback.

Impact of feedback request forms and verbal feedback on higher education students’ feedback perception, self-efficacy, and motivation

In higher education, students often misunderstand teachers’ written feedback. This is worrisome, since written feedback is the main form of feedback in higher education. Organising feedback conversations, in which feedback request forms and verbal feedback are used, is a promising intervention to prevent misunderstanding of written feedback. In this study a 2 × 2 factorial experiment (N = 128) was conducted to examine the effects of a feedback request form (with vs. without) and feedback mode (written vs. verbal feedback). Results showed that verbal feedback had a significantly higher impact on students’ feedback perception than written feedback; it did not improve students’ self-efficacy, or motivation. Feedback request forms did not improve students’ perceptions, self-efficacy, or motivation. Based on these results, we can conclude that students have positive feedback perceptions when teachers communicate their feedback verbally and more research is needed to investigate the use of feedback request forms.