Active learning has become an increasingly popular method for screening large amounts of data in systematic reviews and meta-analyses. The active learning process continually improves its predictions on the remaining unlabeled records, with the goal of identifying all relevant records as early as possible. However, determining the optimal point at which to stop the active learning process is a challenge. The cost of additional labeling of records by the reviewer must be balanced against the cost of erroneous exclusions. This paper introduces the SAFE procedure, a practical and conservative set of stopping heuristics that offers a clear guideline for determining when to end the active learning process in screening software like ASReview. The eclectic mix of stopping heuristics helps to minimize the risk of missing relevant papers in the screening process. The proposed stopping heuristic balances the costs of continued screening with the risk of missing relevant records, providing a practical solution for reviewers to make informed decisions on when to stop screening. Although active learning can significantly enhance the quality and efficiency of screening, this method may be more applicable to certain types of datasets and problems. Ultimately, the decision to stop the active learning process depends on careful consideration of the trade-off between the costs of additional record labeling against the potential errors of the current model for the specific dataset and context.
LINK
Active learning has become an increasingly popular method for screening large amounts of data in systematic reviews and meta-analyses. The active learning process continually improves its predictions on the remaining unlabeled records, with the goal of identifying all relevant records as early as possible. However, determining the optimal point at which to stop the active learning process is a challenge. The cost of additional labeling of records by the reviewer must be balanced against the cost of erroneous exclusions. This paper introduces the SAFE procedure, a practical and conservative set of stopping heuristics that offers a clear guideline for determining when to end the active learning process in screening software like ASReview. The eclectic mix of stopping heuristics helps to minimize the risk of missing relevant papers in the screening process. The proposed stopping heuristic balances the costs of continued screening with the risk of missing relevant records, providing a practical solution for reviewers to make informed decisions on when to stop screening. Although active learning can significantly enhance the quality and efficiency of screening, this method may be more applicable to certain types of datasets and problems. Ultimately, the decision to stop the active learning process depends on careful consideration of the trade-off between the costs of additional record labeling against the potential errors of the current model for the specific dataset and context.
MULTIFILE
Feedback is one of the most powerful tools teachers can use to enhance student learning. In 2006, the Dutch Inspectorate of Education concluded from classroom observations that it is difficult for Dutch teachers to give their students good feedback in order to stimulate students' learning process and developmental progress. Similar problems were revealed in other school levels and countries, for example in secondary education and in Finland. Giving feedback during active learning may be even more troublesome for teachers. During active learning, students are working in small groups on different learning goals and undertake different learning activities at the same time. They need to achieve task-related goals as well as to develop the meta-cognitive knowledge and skills that are needed for active learning. Yet, teachers often seem unable to provide the feedback that is needed and they do not know how to support the development of meta-cognitive knowledge and skills.Therefore, this research project focused on ways to improve primary school teachers' feedback giving practices during active learning. The central research question is: How can primary school teachers learn to give optimal feedback to pupils during active learning? To answer this question, five studies have been conducted. In the first study, knowledge regarding teachers' feedback practices was gathered. A category system was developed based on the literature and empirical data. A total of 1465 teacher-student interactions of 32 teachers who practiced active learning in the domain of environmental studies in the sixth, seventh or eighth grade of 13 Dutch primary schools were videotaped and assessed using this system. Results showed that about half of the teacher-student interactions contained feedback. This feedback was usually focused on the tasks that were being performed by the students and on the ways in which these tasks were processed. Only 5% of the feedback was explicitly related to a learning goal. In their feedback, the teachers were directing (rather than facilitating) the learning processes. During active learning, however, feedback on meta-cognition and social learning is important. Feedback should be explicitly related to learning goals. In practice, these kinds of feedback appear to be scarce. In the second study, the problems these 32 primary school teachers perceive and the beliefs they hold regarding the provision of feedback were investigated. A writing task and an interview were conducted. It appeared that teachers believed that conditional teacher skills, especially time management, hindered them most from giving good feedback. The most widely held belief was that 'feedback should be positive'. Teachers also believed that it is important to adopt a facilitative way of giving feedback, but they found this difficult to implement. Only some teachers believed goal-directedness and a focus on student meta-cognition were important during active learning and teachers did not perceive problems regarding these aspects. In the third study, a professional development program (PDP) was developed, implemented and evaluated. The goals and content of the PDP were based on a review of the literature regarding feedback and active learning and on the results of the preceding studies. The design of the PDP was based on the extant literature regarding the features which are considered to be important for PDPs, including structural features, goal setting and characteristics of the professional development activities that are part of the program. Effects of this PDP on 16 primary schoolteachers' knowledge, beliefs, perceived problems and classroom behavior were examined via observations, a writing task and a questionnaire prior and twice after the program was implemented. Results showed that several aspects of feedback during active learning were improved, both in the short and in the long term. For example, teachers learned to believe that feedback must be goal-directed and that learning goals need to be communicated to students. In the classrooms, teachers related their feedback more often explicitly to the learning goals. In the fourth study, the extent to which teachers attributed the success of the PDP to each of the purposefully implemented features of the PDP was examined. The 16 teachers that participated in the PDP completed a questionnaire and four focus group interviews were conducted. Results indicated that teachers value most features quite highly; all features contributed to teachers' professional development according to the teachers themselves. The qualitative data was used to illustrate and specify the theoretical knowledge regarding the features that appeared to be effective in PDP's. Finally, in the fifth study, the learning process of two of the participating teachers was described in detail. Written reflections, as well as videotaped reflections during the video interaction training meetings were analyzed and related to the effects of the PDP on both teachers' knowledge, beliefs, perceived problems and classroom behavior during te course of the PDP. By relating the learning processes of these two teachers to the literature regarding professional development, we aimed for a rich understanding of the impact of the PDP on teachers' professional development.
DOCUMENT
Fysieke onderwijsruimtes worden niet alleen anders ingericht in het kader van de gewenste flexibiliteit in de onderwijsvormgeving, ook de beschikbare technologie wordt in die ruimtes belangrijker. Daarmee ontstaan nieuwe learning spaces in instituten voor hoger onderwijs die ook nieuwe mogelijkheden bieden voor het vormgeven van een grote variatie aan onderwijsleerpraktijken. Het verkennend onderzoek had als doel het in kaart brengen van de ontwikkelingen in Nederlandse hoger onderwijs met betrekking tot technologierijke learning spaces, en inzicht krijgen in het gebruik van deze technologierijke learning spaces in een aantal instituten die er gebruik van maken. Een van de inzichten uit het onderzoek is de indeling in vier verschillende typen op basis van het gebruik van de ruimte. In dit document zijn de uitkomsten van het onderzoek beknopt en visueel weergegeven.
DOCUMENT
Learning theories broadly characterised as constructivist, agree on the importance to learning of the environment, but differ on what exactly it is that constitutes this importance. Accordingly, they also differ on the educational consequences to be drawn from the theoretical perspective. Cognitive constructivism focuses on the active role of the learner, and on real-life learning. Social-learning theories, comprising the socio-historical, socio-cultural theories as well as the situated-learning and community-of-practice approaches, emphasise learning as being a process within and a product of the social context. Critical-learning theory stresses that this social context is a man-made construction, which should be approached critically and transformed in order to create a better world. We propose to view these different approaches as contributions to our understanding of the learning-environment relationship, and their educational impact as questions to be addressed to educational contexts.
DOCUMENT
A B S T R A C T Background: Approximately 4 years ago a new concept of learning in practice called the ‘Learning and Innovation Network (LIN)’ was introduced in The Netherlands. To develop a definition of the LIN, to identify working elements of the LIN in order to provide a preliminary framework for evaluation, a concept analysis was conducted. Method: For the concept analysis, we adopted the method of Walker and Avant. We searched for relevant publications in the EBSCO host portal, grey literature and snowball searches, as well as Google internet searches and dictionary consults. Results: Compared to other forms of workplace learning, the LIN is in the centre of the research, education and practice triangle. The most important attributes of the LIN are social learning, innovation, daily practice, reflection and co-production. Often described antecedents are societal developments, such as increasing complexity of work, and time and space to learn. Frequently identified consequences are an attractive workplace, advancements of expertise of care professionals, innovations that endorse daily practice, improvement of quality of care and the integration of education and practice. Conclusions: Based on the results of the concept analysis, we describe the LIN as ‘a group of care professionals, students and an education representatives who come together in clinical practice and are all part of a learning and innovation community in nursing. They work together on practice-based projects in which they combine best practices, research evidence and client perspectives in order to innovate and improve quality of care and in which an integration of education, research and practice takes place’. We transferred the outcomes of the concept analysis to an input-throughput-output model that can be used as a preliminary framework for future research.
DOCUMENT
From the article: "The educational domain is momentarily witnessing the emergence of learning analytics – a form of data analytics within educational institutes. Implementation of learning analytics tools, however, is not a trivial process. This research-in-progress focuses on the experimental implementation of a learning analytics tool in the virtual learning environment and educational processes of a case organization – a major Dutch university of applied sciences. The experiment is performed in two phases: the first phase led to insights in the dynamics associated with implementing such tool in a practical setting. The second – yet to be conducted – phase will provide insights in the use of pedagogical interventions based on learning analytics. In the first phase, several technical issues emerged, as well as the need to include more data (sources) in order to get a more complete picture of actual learning behavior. Moreover, self-selection bias is identified as a potential threat to future learning analytics endeavors when data collection and analysis requires learners to opt in."
DOCUMENT
Evaluation of the effect of Problem Based Learning course
DOCUMENT
To adequately deal with the challenges faced within residential care for older people, such as the increasing complexity of care and a call for more person-centred practices, it is important that health care providers learn from their work. This study investigates both the nature of learning, among staff and students working within care for older people, and how workplace learning can be promoted and researched. During a longitudinal study within a nursing home, participatory and democratic research methods were used to collaborate with stakeholders to improve the quality of care and to promote learning in the workplace. The rich descriptions of these processes show that workplace learning is a complex phenomenon. It arises continuously in reciprocal relationship with all those present through which both individuals and environment change and co-evolve enabling enlargement of the space for possible action. This complexity perspective on learning refines and expands conventional beliefs about workplace learning and has implications for advancing and researching learning. It explains that research on workplace learning is itself a form of learning that is aimed at promoting and accelerating learning. Such research requires dialogic and creative methods. This study illustrates that workplace learning has the potential to develop new shared values and ways of working, but that such processes and outcomes are difficult to control. It offers inspiration for educators, supervisors, managers and researchers as to promoting conditions that embrace complexity and provides insight into the role and position of self in such processes.
DOCUMENT
This is a tool that you can use when designing and delivering (online) active learning. The tool will help you find answers to questions such as: − Which learning activities can I offer students in order to achieve a specific learning objective? − Is there an optimum order for learning activities? − How do I ensure that students become actively involved in their own learning process?
DOCUMENT
