In recent decades, technology has influenced various aspects of assessment in mathematics education: (1) supporting the assessment of higher-order thinking skills in mathematics, (2) representing authentic problems from the world around us to use and apply mathematical knowledge and skills, and (3) making the delivery of tests and the analysis of results through psychometric analysis more sophisticated. We argue that these developments are not pushing mathematics education in the same direction, however, which creates tensions. Mathematics education—so essential for educating young people to be creative and problem solving agents in the twenty-first century—is at risk of focusing too much on assessment of lower order goals, such as the reproduction of procedural, calculation based, knowledge and skills. While there is an availability of an increasing amount of sophisticated technology, the related advances in measurement, creation and delivery of automated assessments of mathematics are however being based on sequences of atomised test items. In this article several aspects of the use of technology in the assessment of mathematics education are exemplified and discussed, including in relation to the aforementioned tension. A way forward is suggested by the introduction of a framework for the categorisation of mathematical problem situations with an increasing sophistication of representing the problem situation using various aspects of technology. The framework could be used to reflect on and discuss mathematical assessment tasks, especially in relation to twenty-first century skills.
DOCUMENT
Torpedo is a digital learning environment for developing mathematical problem-solving ability through self-study for pre-service teachers in primary teacher education. To achieve this, Torpedo supports and challenges pre-service teachers’ reflection during and after solving non-routine mathematics problems. To investigate the feasibility of the Torpedo approach, 271 pre-service teachers used Torpedo during one month in a pilot study. They used and evaluated Torpedo’s reflective elements differently. The results varied from pre-service teachers who experienced that reflection really contributed to the development of their problem-solving ability, to pre-service teachers who hardly reflected. The last group consisted of those who found the problems too difficult to reflect upon and those who used Torpedo to prepare for the National Mathematics Test and preferred to do so by drill and practice. As a conclusion, the study provides clues for improving Torpedo so that it invites more reflective self-study behaviour. For pre-service teachers who consider reflection valueless, however, self-study in a digital learning environment may be insufficient to change this attitude.
DOCUMENT
Formative assessment (FA) is an effective educational approach for optimising student learning and is considered as a promising avenue for assessment within physical education (PE). Nevertheless, implementing FA is a complex and demanding task for in-service PE teachers who often lack formal training on this topic. To better support PE teachers in implementing FA into their practice, we need better insight into teachers’ experiences while designing and implementing formative strategies. However, knowledge on this topic is limited, especially within PE. Therefore, this study examined the experiences of 15 PE teachers who participated in an 18-month professional development programme. Teachers designed and implemented various formative activities within their PE lessons, while experiences were investigated through logbook entries and focus groups. Findings indicated various positive experiences, such as increased transparency in learning outcomes and success criteria for students as well as increased student involvement, but also revealed complexities, such as shifting teacher roles and insufficient feedback literacy among students. Overall, the findings of this study underscore the importance of a sustained, collaborative, and supported approach to implementing FA.
DOCUMENT
This work draws on the Programme for the International Assessment of Adult Competencies (PIAAC) survey. Last year a first review was conducted on the PIAAC Numeracy Framework (Tout. et al., 2017). In 2018 and 2019 the framework for the second cycle of PIAAC will be developed. This second cycle of the PIAAC survey aims to update the data about the numeracy skills of adults in different countries around the World (Hoogland, Díez-Palomar, Maguire, 2019). The objective of this paper is to highlight some relevant findings from literature on the concept numeracy in order to discuss a potential enrichment of the PIAAC Numeracy Assessment Framework (NAF).
LINK
The purpose of this study was to provide insight into the interplay between student perceptions of competence-based assessment and student self-efficacy, and how this influences student learning outcomes. Results reveal that student perceptions of the form authenticity aspect and the quality feedback aspect of assessment do predict student self-efficacy, confirming the role of mastery experiences and social persuasions in enhancing student self-efficacy as stated by social cognitive theory. Findings do not confirm mastery experiences as being a stronger source of self-efficacy information than social persuasions. Study results confirm the predictive role of students’ self-efficacy on their competence outcomes. Mediation analysis results indicate that student’s perceptions of assessment have an indirect effect on student’s competence evaluation outcomes through student’s self-efficacy. Study findings highlight which assessment characteristics, positively influencing students’ learning, contribute to the effectiveness of competence-based education. Limitations of the study and directions for future research are indicated.
DOCUMENT
Self-efficacy is een belangrijk begrip uit de sociaal cognitieve theory van Bandura (1997) en duidt op het geloof dat mensen hebben in hun kunnen om een bepaalde taak in een toekomstige situatie succesvol uit te voeren. Self-efficacy van leraren duidt op het geloof van leraren in hun kunnen om het leren van studenten positief te beïnvloeden. Leraren met een hoge mate van self-efficacy hebben een sterkere positieve invloed op de prestaties, de motivatie en schoolattitude van leerlingen, dan leraren met een lage mate van self-efficacy. Daarom is het van belang dat lerarenopleidingen aandacht besteden aan het ontwikkelen van self-efficacy bij hun studenten. Omdat binnen het competentiegerichte opleiden van leraren assessments een belangrijke plaats innemen, wordt in deze dissertatie onderzocht hoe assessment de self-efficacy van studenten beïnvloedt en hoe vervolgens de lerarencompetenties worden beïnvloed. Allereerst is onderzocht van welke factoren binnen het hoger onderwijs is gebleken dat deze de self-efficacy van studenten positief beïnvloeden. Hieruit bleek dat de self-efficacy van studenten wordt verhoogd als zij succeservaringen opdoen en als zij verbaal worden ondersteund door hun omgeving. Van deze bevindingen zijn 2 factoren afgeleid die van kenmerkend zijn voor een competentie assessment en die in deze dissertatie nader worden onderzocht. De eerste factor is de authenticiteit van een assessment, dit duidt op de mate waarin tijdens een assessment zaken worden getoetst die belang zijn voor het beroep van leraar. De tweede factor is de feedback die aan studenten wordt verstrekt tijdens het assessment. Om de invloed van deze factoren op de self-efficacy van studenten te kunnen meten, is er een self-efficacy vragenlijst ontwikkeld, specifiek gericht op 1e jaarstudenten van een lerarenopleiding. Omdat studenten in het 1e jaar werken aan de ontwikkeling van 6 competenties, is het instrument bedoeld om de self-efficacy van studenten met betrekking tot de zes lerarencompetenties (interpersoonlijk, pedagogisch, vakinhoudelijk en didactisch, organisatorisch, samenwerking met collega’s en reflectie en ontwikkeling) te diagnosticeren. Uit studie twee bleek dat de vragenlijst voldoende betrouwbaar en valide is om het diagnostisch instrument te gebruiken tijdens de begeleiding van studenten. Tevens kwam uit deze studie enig bewijs voor de stelling dat studenten aan een lerarenopleiding beginnen met een globale ongedifferentieerde self-efficacy, en dat als zij ervaringen opdoen met lesgeven er een verdere differentiatie van hun self-efficacy plaatsvindt. In de derde studie werd de kernvraag van deze dissertatie onderzocht. Hieruit bleek dat naarmate de studenten, de prestatie die zij bij het assessment moeten leveren als authentieker ervaren, des te sterker dit hun self-efficacy van de 6 competenties beïnvloedt. Verder bleek dat naarmate studenten de kwaliteit van de verstrekte feedback als hoger ervaren, des te sterker dit hun self-efficacy op 4 van deze 6 competenties beïnvloedt. Tenslotte bleek uit deze studie dat de genoemde assessment-factoren de leerresultaten van studenten op de lerarencompetenties indirect beïnvloeden, dit houdt in dat de assessmentfactoren de self-efficacy van studenten beïnvloeden en dat de self-efficacy van studenten vervolgens van invloed is op leerresultaten van studenten op de lerarencompetenties. In de vierde studie zijn enkele resultaten uit de derde studie diepgaand onder de loep genomen. Door een aantal studenten te interviewen is onderzocht hoe de ervaringen die studenten opdoen tijdens een assessment bijdragen aan hun self-efficacy. Hieruit bleek dat de genoemde assessmentfactoren tijdens zowel de voorbereidingsfase, de interviewfase als de feedbackfase van het portfolio competentie assessment, de self-efficacy van studenten positief beïnvloeden. Voortkomend uit de onderzoeksresultaten, worden op het einde van de dissertatie enkele adviezen voor lerarenopleidingen beschreven.
DOCUMENT
This study aims to map VE teachers’ perceived importance of assessment competence. The study was conducted in the Netherlands among teachers of professional studies in Universities of Applied Sciences. A large-scale study was conducted to represent a broad population of teachers, including various vocational fields, roles, and situations, allowing for the exploration of differences across these contextual variables.
LINK
Graphs are ubiquitous. Many graphs, including histograms, bar charts, and stacked dotplots, have proven tricky to interpret. Students’ gaze data can indicate students’ interpretation strategies on these graphs. We therefore explore the question: In what way can machine learning quantify differences in students’ gaze data when interpreting two near-identical histograms with graph tasks in between? Our work provides evidence that using machine learning in conjunction with gaze data can provide insight into how students analyze and interpret graphs. This approach also sheds light on the ways in which students may better understand a graph after first being presented with other graph types, including dotplots. We conclude with a model that can accurately differentiate between the first and second time a student solved near-identical histogram tasks.
DOCUMENT
Earlier research argues that educational programmes based on social cognitive theory are successful in improving students’ self-efficacy. Focusing on some formative assessment characteristics, this qualitative research intends to study in-depth how student teachers’ assessment experiences contribute to their self-efficacy. We interviewed 15 second year student teachers enrolled in a competence based teacher educational programme. Thematic content analysis results reveal that the assessment characteristics ‘authenticity’ and ‘feedback’ exert a positive influence on student teachers self-efficacy during all phases of the portfolio competence assessment. The results provide a fine-grained view of several types of self-efficacy information connected with these assessment phases.
DOCUMENT
Within recent years, Financial Credit Risk Assessment (FCRA) has become an increasingly important issue within the financial industry. Therefore, the search for features that can predict the credit risk of an organization has increased. Using multiple statistical techniques, a variance of features has been proposed. Applying a structured literature review, 258 papers have been selected. From the selected papers, 835 features have been identified. The features have been analyzed with respect to the type of feature, the information sources needed and the type of organization that applies the features. Based on the results of the analysis, the features have been plotted in the FCRA Model. The results show that most features focus on hard information from a transactional source, based on official information with a high latency. In this paper, we readdress and -present our earlier work [1]. We extended the previous research with more detailed descriptions of the related literature, findings, and results, which provides a grounded basis from which further research on FCRA can be conducted.
DOCUMENT
