Recommender systems are widely used in today’s society, but many of them do not meet users’ needs and therefore fail to reach their full potential. Without careful consideration, such systems can interfere with the natural decision-making process, resulting in the disregard for recommendations provided. Therefore, it is vital to take into account multiple factors, including expertise, time and risk associated with decisions, as well as the system’s context to identify suitable affordances. Furthermore, it is important to consider the algorithmic and digital literacy of the users. This analysis could reveal innovative design opportunities, like combining a recommender system with a digital agent. As a result, it may meet interpersonal needs and facilitate a more natural interaction with the system. Implementing this combination in a digital marketplace could be a promising way to empower users towards an independent life.
LINK
Algorithmic affordances are defined as user interaction mechanisms that allow users tangible control over AI algorithms, such as recommender systems. Designing such algorithmic affordances, including assessing their impact, is not straightforward and practitioners state that they lack resources to design adequately for interfaces of AI systems. This could be amended by creating a comprehensive pattern library of algorithmic affordances. This library should provide easy access to patterns, supported by live examples and research on their experiential impact and limitations of use. The Algorithmic Affordances in Recommender Interfaces workshop aimed to address key challenges related to building such a pattern library, including pattern identification features, a framework for systematic impact evaluation, and understanding the interaction between algorithmic affordances and their context of use, especially in education or with users with a low algorithmic literacy. Preliminary solutions were proposed for these challenges.
LINK
In flexible education, recommender systems that support course selection, are considered a viable means to help students in making informed course selections, especially where curricula offer greater flexibility. However, these recommender systems present both potential benefits and looming risks, such as overdependence on technology, biased recommendations, and privacy issues. User control mechanisms in recommender interfaces (or algorithmic affordances) might offer options to address those risks, but they have not been systematically studied yet. This paper presents the outcomes of a design session conducted during the INTERACT23 workshop on Algorithmic Affordances in Recommender Interfaces. This design session yielded insights in how the design of an interface, and specifically the algorithmic affordances in these interfaces, may address the ethical risks and dilemmas of using a recommender in such an impactful context by potentially vulnerable users. Through design and reflection, we discovered a host of design ideas for the interface of a flexible education interface, that can serve as conversation starters for practitioners implementing flexible education. More research is needed to explore these design directions and to gain insights on how they can help to approximate more ethically operating recommender systems.
LINK
This exploratory study investigates the rationale behind categorizing algorithmic controls, or algorithmic affordances, in the graphical user interfaces (GUIs) of recommender systems. Seven professionals from industry and academia took part in an open card sorting activity to analyze 45 cards with examples of algorithmic affordances in recommender systems’ GUIs. Their objective was to identify potential design patterns including features on which to base these patterns. Analyzing the group discussions revealed distinct thought processes and defining factors for design patterns that were shared by academic and industry partners. While the discussions were promising, they also demonstrated a varying degree of alignment between industry and academia when it came to labelling the identified categories. Since this workshop is part of the preparation for creating a design pattern library of algorithmic affordances, and since the library aims to be useful for both industry and research partners, further research into design patterns of algorithmic affordances, particularly in terms of labelling and description, is required in order to establish categories that resonate with all relevant parties
LINK
More people voted in 2024 than any other year in human history, while often relying on the internet for political information. This combination resulted in critical challenges for democracy. To address these concerns, we designed an exhibition that applied interactive experiences to help visitors understand the impact of digitization on democracy. This late-breaking work addresses the research questions: 1) What do participants, exposed to playful interventions, think about these topics? and 2) How do people estimate their skills and knowledge about countering misinformation? We collected data in 5 countries through showcases held within weeks of relevant 2024 elections. During visits, participants completed a survey detailing their experiences and emotional responses. Participants expressed high levels of self-confidence regarding the detection of misinformation and spotting AI-generated content. This paper contributes to addressing digital literacy needs by fostering engaging interactions with AI and politically relevant issues surrounding campaigning and misinformation.
MULTIFILE
The user’s experience with a recommender system is significantly shaped by the dynamics of user-algorithm interactions. These interactions are often evaluated using interaction qualities, such as controllability, trust, and autonomy, to gauge their impact. As part of our effort to systematically categorize these evaluations, we explored the suitability of the interaction qualities framework as proposed by Lenz, Dieffenbach and Hassenzahl. During this examination, we uncovered four challenges within the framework itself, and an additional external challenge. In studies examining the interaction between user control options and interaction qualities, interdependencies between concepts, inconsistent terminology, and the entity perspective (is it a user’s trust or a system’s trustworthiness) often hinder a systematic inventory of the findings. Additionally, our discussion underscored the crucial role of the decision context in evaluating the relation of algorithmic affordances and interaction qualities. We propose dimensions of decision contexts (such as ‘reversibility of the decision’, or ‘time pressure’). They could aid in establishing a systematic three-way relationship between context attributes, attributes of user control mechanisms, and experiential goals, and as such they warrant further research. In sum, while the interaction qualities framework serves as a foundational structure for organizing research on evaluating the impact of algorithmic affordances, challenges related to interdependencies and context-specific influences remain. These challenges necessitate further investigation and subsequent refinement and expansion of the framework.
LINK
This study investigates what pupils aged 10-12 can learn from working with robots, assuming that understanding robotics is a sign of technological literacy. We conducted cognitive and conceptual analysis to develop a frame of reference for determining pupils' understanding of robotics. Four perspectives were distinguished with increasing sophistication; psychological, technological, function, and controlled system. Using Lego Mindstorms NXT robots, as an example of a Direct Manipulation Environment, we developed and conducted a lesson plan to investigate pupils' reasoning patterns. There is ample evidence that pupils have little difficulty in understanding that robots are man-made technological and functional artifacts. Pupils' understanding of the controlled system concept, more specifically the complex sense-reason-act loop that is characteristic of robotics, can be fostered by means of problem solving tasks. The results are discussed with respect to pupils' developing technological literacy and the possibilities for teaching and learning in primary education.
LINK
In Intellectual Output 1 of the SMILES project, researchers from Belgium (Flanders), Netherlands and Spain conducted desk research to describe the current developments for each country around disinformation, particularly those related to the Covid-19 pandemic. In part 2 of the research, they identified training initiatives, courses and media literacy training tools for each country that are specifically focused on the combat against or promotion of resistance to existing disinformation. Each identified activity or tool was characterised by a fixed set of characteristics (appendix 1). In the second stage of this research, some experts for each country were interviewed. Among other things, they were asked for recommendations and tips for interventions that will be developed in Intellectual Output 2 of the SMILES project. All research results were reported in separate country reports. This joint report lists the highlights of the separate country reports. It will end with recommendations for the interventions to be developed in Intellectual Output 2.
MULTIFILE
In the wake of neo-liberal informed global trends to set performance standards and intensify accountability, the Dutch government aimed for ‘raising standards for basic skills’. While the implementation of literacy standards was hardly noticed, the introduction of numeracy standards caused a major backlash in secondary schools, which ended in a failed introduction of a high stakes test. How can these major differences be explained? Inspired by Foucault’s governmentality concept a theoretical framework is developed to allow for detailed empirical research on steering processes in complex systems in which many actors are involved in educational decision-making. A mixed-methods multiple embedded case-study was conducted comprising nine school boards and fifteen secondary schools. Analyses unveil processes of responsibilisation, normalisation and emerging dividing practices. Literacy standards reinforced responsibilities of Dutch language teachers; for numeracy, school leadership created entirely new roles and responsibilities for teachers. Literacy standards were incorporated in an already used instrument which made implementation both subtle and inevitable. For numeracy, schools distinguished students by risk of not passing the new test affirming the disciplinary nature of schools in the process. While little changed to address teachers main concerns about students’ literacy skills, the failed introduction of the numeracy test usurped most resources.
DOCUMENT
Between 1 March 2021 and 30 April 2023, a consortium (consisting of in the Netherlands: the National Library of the Netherlands (Koninklijke Bibliotheek -KB), The Hague University of Applied Sciences, the Netherlands Institute for Sound and Vision in Hilversum; in Belgium: Media & Learning Association in Leuven and Public Libraries 2030 in Brussels; and in Spain: Fundación Platoniq in Barcelona) carried out an Erasmus+-funded research project on news media literacy among young people. It involved Dutch, Belgian and Spanish young people aged 12-15. The acronym SMILES, which stands for 'innovative methodS for Media & Information Literacy Education involving schools and librarieS', was chosen for the project title. The main goals of the SMILES project are: • Forming pairs between librarians and secondary school teachers in the three European countries, who were empowered through train-the-trainer workshops to teach secondary school students about news media literacy in relation to disinformation; • Helping students use digital technologies more safely and responsibly with a focus on recognising reliable and authentic information versus becoming more resilient to disinformation; • Developing five building blocks serving as teaching materials for Dutch, Belgian and Spanish pupils aged 12-15 with the aim of making them recognise disinformation and making them more resilient against it; • A scientific evaluation of the effectiveness of the implemented lessons through impact measurement using 'pre-knowledge tests' and 'post-knowledge tests'; • A strengthening of existing collaborations and creation of new collaborations between schools and libraries in the three partner countries. The SMILES project was implemented through three work packages. In the first work package, five so-called 'Baseline studies', or literature reviews, were conducted. The focus was on what the different educational approaches in Spain, Belgium and the Netherlands are with regard to disinformation and how these approaches can be linked. Based on these studies, the five building blocks were developed in the second work package. In addition, the teaching pairs were offered the training programme developed by SMILES through a 'train-the-trainer methodology' to safely and responsibly deploy the use of digital media tools during lessons with students. Also, based on the disinformation literature, the knowledge tests were designed to conduct an impact measurement of the train-the-trainer workshops and lessons among the trainers (teaching pairs) and students, respectively. These knowledge tests contained statements on disinformation that were answered correctly or incorrectly by respondents. The number of correctly answered statements prior to the lessons was compared with the number of correctly answered statements after the lessons. In this way, an attempt was made to prove a positive learning effect of the deployed lessons. In the third work package, the results from the pre-knowledge tests and the post-knowledge tests were analysed. In addition to these quantitative analyses, qualitative results were also used to analyse and look at the extent to which the training provided to trainers (teaching pairs) and the lessons with the five building blocks for students proved effective in teaching, recognising and becoming more resilient to disinformation, respectively. In doing so, we also reflect on whether the methodology tested has been effective in the three countries: what are the best practices and where do we see areas for improvement?
DOCUMENT
