SummaryA question that received considerable interest from language teachers and researchers alike is what corrective feedback (CF) should look like to be maximally beneficial to learners’ second language development. This chapter zooms in on two feedback types that have been distinguished in the CF literature: focused and unfocused CF. After a careful characterization of these two feedback options, theoretical, methodological, and pedagogical arguments are discussed for both of them. The chapter furthermore provides a synthesis of oral and written feedback studies into the (relative) value of focused and unfocused CF. It concludes with suggestions for further research and implications for L2 classrooms.
DOCUMENT
Feedback is one of the most powerful tools teachers can use to enhance student learning. In 2006, the Dutch Inspectorate of Education concluded from classroom observations that it is difficult for Dutch teachers to give their students good feedback in order to stimulate students' learning process and developmental progress. Similar problems were revealed in other school levels and countries, for example in secondary education and in Finland. Giving feedback during active learning may be even more troublesome for teachers. During active learning, students are working in small groups on different learning goals and undertake different learning activities at the same time. They need to achieve task-related goals as well as to develop the meta-cognitive knowledge and skills that are needed for active learning. Yet, teachers often seem unable to provide the feedback that is needed and they do not know how to support the development of meta-cognitive knowledge and skills.Therefore, this research project focused on ways to improve primary school teachers' feedback giving practices during active learning. The central research question is: How can primary school teachers learn to give optimal feedback to pupils during active learning? To answer this question, five studies have been conducted. In the first study, knowledge regarding teachers' feedback practices was gathered. A category system was developed based on the literature and empirical data. A total of 1465 teacher-student interactions of 32 teachers who practiced active learning in the domain of environmental studies in the sixth, seventh or eighth grade of 13 Dutch primary schools were videotaped and assessed using this system. Results showed that about half of the teacher-student interactions contained feedback. This feedback was usually focused on the tasks that were being performed by the students and on the ways in which these tasks were processed. Only 5% of the feedback was explicitly related to a learning goal. In their feedback, the teachers were directing (rather than facilitating) the learning processes. During active learning, however, feedback on meta-cognition and social learning is important. Feedback should be explicitly related to learning goals. In practice, these kinds of feedback appear to be scarce. In the second study, the problems these 32 primary school teachers perceive and the beliefs they hold regarding the provision of feedback were investigated. A writing task and an interview were conducted. It appeared that teachers believed that conditional teacher skills, especially time management, hindered them most from giving good feedback. The most widely held belief was that 'feedback should be positive'. Teachers also believed that it is important to adopt a facilitative way of giving feedback, but they found this difficult to implement. Only some teachers believed goal-directedness and a focus on student meta-cognition were important during active learning and teachers did not perceive problems regarding these aspects. In the third study, a professional development program (PDP) was developed, implemented and evaluated. The goals and content of the PDP were based on a review of the literature regarding feedback and active learning and on the results of the preceding studies. The design of the PDP was based on the extant literature regarding the features which are considered to be important for PDPs, including structural features, goal setting and characteristics of the professional development activities that are part of the program. Effects of this PDP on 16 primary schoolteachers' knowledge, beliefs, perceived problems and classroom behavior were examined via observations, a writing task and a questionnaire prior and twice after the program was implemented. Results showed that several aspects of feedback during active learning were improved, both in the short and in the long term. For example, teachers learned to believe that feedback must be goal-directed and that learning goals need to be communicated to students. In the classrooms, teachers related their feedback more often explicitly to the learning goals. In the fourth study, the extent to which teachers attributed the success of the PDP to each of the purposefully implemented features of the PDP was examined. The 16 teachers that participated in the PDP completed a questionnaire and four focus group interviews were conducted. Results indicated that teachers value most features quite highly; all features contributed to teachers' professional development according to the teachers themselves. The qualitative data was used to illustrate and specify the theoretical knowledge regarding the features that appeared to be effective in PDP's. Finally, in the fifth study, the learning process of two of the participating teachers was described in detail. Written reflections, as well as videotaped reflections during the video interaction training meetings were analyzed and related to the effects of the PDP on both teachers' knowledge, beliefs, perceived problems and classroom behavior during te course of the PDP. By relating the learning processes of these two teachers to the literature regarding professional development, we aimed for a rich understanding of the impact of the PDP on teachers' professional development.
DOCUMENT
The pervasiveness of wearable technology has opened the market for products that analyse running biomechanics and provide feedback to the user. To improve running technique feedback should target specific running biomechanical key points and promote an external focus. Aim for this study was to define and empirically test tailored feedback requirements for optimal motor learning in four consumer available running wearables. First, based on desk research and observations of coaches, a screening protocol was developed. Second, four wearables were tested according to the protocol. Third, results were reviewed, and four experts identified future requirements. Testing and reviewing the selected wearables with the protocol revealed that only two less relevant running biomechanical key points were measured. Provided feedback promotes an external focus of the user. Tailoring was absent in all wearables. These findings indicate that consumer available running wearables have a potential for optimal motor learning but need improvements as well.
DOCUMENT
Athlete development depends on many factors that need to be balanced by the coach. The amount of data collected grows with the development of sensor technology. To make data-informed decisions for training prescription of their athletes, coaches could be supported by feedback through a coach dashboard. The aim of this paper is to describe the design of a coach dashboard based on scientific knowledge, user requirements, and (sensor) data to support decision making of coaches for athlete development in cyclic sports. The design process involved collaboration with coaches, embedded scientists, researchers, and IT professionals. A classic design thinking process was used to structure the research activities in five phases: empathise, define, ideate, prototype, and test phases. To understand the user requirements of coaches, a survey (n = 38), interviews (n = 8) and focus-group sessions (n = 4) were held. Design principles were adopted into mock-ups, prototypes, and the final coach dashboard. Designing a coach dashboard using the co-operative research design helped to gain deep insights into the specific user requirements of coaches in their daily training practice. Integrating these requirements, scientific knowledge, and functionalities in the final coach dashboard allows the coach to make data-informed decisions on training prescription and optimise athlete development.
DOCUMENT
Injuries and lack of motivation are common reasons for discontinuation of running. Real-time feedback from wearables can reduce discontinuation by reducing injury risk and improving performance and motivation. There are however several limitations and challenges with current real-time feedback approaches. We discuss these limitations and challenges and provide a framework to optimise real-time feedback for reducing injury risk and improving performance and motivation. We first discuss the reasons why individuals run and propose that feedback targeted to these reasons can improve motivation and compliance. Secondly, we review the association of running technique and running workload with injuries and performance and we elaborate how real-time feedback on running technique and workload can be applied to reduce injury risk and improve performance and motivation. We also review different feedback modalities and motor learning feedback strategies and their application to real-time feedback. Briefly, the most effective feedback modality and frequency differ between variables and individuals, but a combination of modalities and mixture of real-time and delayed feedback is most effective. Moreover, feedback promoting perceived competence, autonomy and an external focus can improve motivation, learning and performance. Although the focus is on wearables, the challenges and practical applications are also relevant for laboratory-based gait retraining.
DOCUMENT
From the article: The ‘Axiomatic Design Methodology’ uses ‘Axioms’ that cannot be proven nor derived from physical phenomena. The axioms serve as guidelines for the design process of products and systems. The latest contribution was the addition of the ‘Complexity Axiom’ in 1999. However, the underlying theory of complexity did not get much traction by designers and their managers yet. It emphasises difficulties in the design, not primarily focussing on solutions. The ‘Theory of Complexity’ is converted to a ‘Theory of Maturity’ in this paper. It is supported with a graphical way to plot maturity as it develops. It visualises the results in a way that can be understood by all entities in a company, engineers, managers, and executives. Understanding the maturity of a system enables selection of the right measures to control it. Visualisation enables communication between the interacting parties. If successful development trajectories are understood, eventually from earlier experience, even better corrective actions can be applied. The method appears an affirmative way to graphically represent progression in design, thus presenting advances in a positive context. Though positively presented, it is not the case that the method hides problems; presumed and legitimate project progression can be quite different, which challenges the designer to understand the process. In this way, the method sends out a continuous warning to stay critical on design choices made.
DOCUMENT
This research investigates the potential and challenges of using artificial intelligence, specifically the ChatGPT-4 model developed by OpenAI, in grading and providing feedback in an educational setting. By comparing the grading of a human lecturer and ChatGPT-4 in an experiment with 105 students, our study found a strong positive correlation between the scores given by both, despite some mismatches. In addition, we observed that ChatGPT-4's feedback was effectively personalized and understandable for students, contributing to their learning experience. While our findings suggest that AI technologies like ChatGPT-4 can significantly speed up the grading process and enhance feedback provision, the implementation of these systems should be thoughtfully considered. With further research and development, AI can potentially become a valuable tool to support teaching and learning in education. https://saiconference.com/FICC
DOCUMENT
In programmatic assessment (PA), an arrangement of different assessment methods is deliberately designed across the entire curriculum, combined and planned to support both robust decision-making and student learning. In health sciences education, evidence about the merits and pitfalls of PA is emerging. Although there is consensus about the theoretical principles of PA, programs make diverse design choices based on these principles to implement PA in practice, fitting their own contexts. We therefore need a better understanding of how the PA principles are implemented across contexts—within and beyond health sciences education. In this study, interviews were conducted with teachers/curriculum designers representing nine different programs in diverse professional domains. Research questions focused on: (1) design choices made, (2) whether these design choices adhere to PA principles, (3) student and teacher experiences in practice, and (4) context-specific differences between the programs. A wide range of design choices were reported, largely adhering to PA principles but differing across cases due to contextual alignment. Design choices reported by almost all programs include a backbone of learning outcomes, data-points connected to this backbone in a longitudinal design allowing uptake of feedback, intermediate reflective meetings, and decision-making based on a multitude of data-points made by a committee and involving multi-stage procedures. Contextual design choices were made aligning the design to the professional domain and practical feasibility. Further research is needed in particular with regard to intermediate-stakes decisions.
LINK
Dynamic body feedback is used in dance movement therapy (DMT), with the aim to facilitate emotional expression and a change of emotional state through movement and dance for individuals with psychosocial or psychiatric complaints. It has been demonstrated that moving in a specific way can evoke and regulate related emotions. The current study aimed to investigate the effects of executing a unique set of kinetic movement elements on an individual mover’s experience of happiness. A specific sequence consisting of movement elements that recent studies have related to the feeling of happiness was created and used in a series of conditions. To achieve a more realistic reflection of DMT practice, the study incorporated the interpersonal dimension between the dance movement therapist (DMTh) and the client, and the impact of this interbodily feedback on the emotional state of the client. This quantitative study was conducted in a within-subject design. Five male and 20 female participants (mean age = 20.72) participated in three conditions: a solo executed movement sequence, a movement sequence executed with a DMTh who attuned and mirrored the movements, and a solo executed movement sequence not associated with feelings of happiness. Participants were only informed about the movements and not the feelings that may be provoked by these movements. The effects on individuals were measured using the Positive and Negative Affect Schedule and visual analog scales. Results showed that a specific movement sequence based on movement elements associated with happiness executed with a DMTh can significantly enhance the corresponding affective state. An additional finding of this study indicated that facilitating expressed emotion through movement elements that are not associated with happiness can enhance feelings such as empowerment, pride, and determination, which are experienced as part of positive affect. The results show the impact of specific fullbody movement elements on the emotional state and the support outcome of DMT on emotion regulation.
DOCUMENT
Abstract Background: With the growing shortage of nurses, labor-saving technology has become more important. In health care practice, however, the fit with innovations is not easy. The aim of this study is to analyze the development of a mobile input device for electronic medical records (MEMR), a potentially labor-saving application supported by nurses, that failed to meet the needs of nurses after development. Method: In a case study, we used an axiomatic design framework as an evaluation tool to visualize the mismatches between customer needs and the design parameters of the MEMR, and trace these mismatches back to (preliminary) decisions in the development process. We applied a mixed-method research design that consisted of analyzing of 118 external and internal files and working documents, 29 interviews and shorter inquiries, a user test, and an observation of use. By factoring and grouping the findings, we analyzed the relevant categories of mismatches. Results: The involvement of nurses during the development was extensive, but not all feedback was, or could not be, used effectively to improve the MEMR. The mismatches with the most impact were found to be: (1) suboptimal supportive technology, (2) limited functionality of the app and input device, and (3) disruption of nurses’ workflow. Most mismatches were known by the IT department when the MEMR was offered to the units as a product. Development of the MEMR came to a halt because of limited use. Conclusion: Choices for design parameters, made during the development of labor-saving technology for nurses, may conflict with the customer needs of nurses. Even though the causes of mismatches were mentioned by the IT department, the nurse managers acquired the MEMR based on the idea behind the app. The effects of the chosen design parameters should not only be compared to the customer needs, but also be assessed with nurses and nurse managers for the expected effect on the workflow.
LINK
