The platform for open and practice-oriented research

product

Developing a Human Centred AI Masters

The increasing use of AI in industry and society not only expects but demands that we build human-centred competencies into our AI education programmes. The computing education community needs to adapt, and while the adoption of standalone ethics modules into AI programmes or the inclusion of ethical content into traditional applied AI modules is progressing, it is not enough. To foster student competencies to create AI innovations that respect and support the protection of individual rights and society, a novel ground-up approach is needed. This panel presents on one such approach, the development of a Human-Centred AI Masters (HCAIM) as well as the insights and lessons learned from the process. In particular, we discuss the design decisions that have led to the multi-institutional master’s programme. Moreover, this panel allows for discussion on pedagogical and methodological approaches, content knowledge areas and the delivery of such a novel programme, along with challenges faced, to inform and learn from other educators that are considering developing such programmes.

DOCUMENT

product

Considering Human Interaction and Variability in Automatic Text Simplification

Research into automatic text simplification aims to promote access to information for all members of society. To facilitate generalizability, simplification research often abstracts away from specific use cases, and targets a prototypical reader and an underspecified content creator. In this paper, we consider a real-world use case – simplification technology for use in Dutch municipalities – and identify the needs of the content creators and the target audiences in this scenario. The stakeholders envision a system that (a) assists the human writer without taking over the task; (b) provides diverse outputs, tailored for specific target audiences; and (c) explains the suggestions that it outputs. These requirements call for technology that is characterized by modularity, explainability, and variability. We argue that these are important research directions that require further exploration

MULTIFILE

Considering Human Interaction and Variability in Automatic Text Simplification

product

Inclusive Dialogues: WokeBot Engaging Diversity Dilemmas

In today's world, understanding different viewpoints is key for societal cohesion and progress. Robots have the potential to provide aid in discussing tough topics like ethnicity and gender. However, comparably to humans, the appearance of a robot can trigger inherent prejudices. This study delves into the interplay between robot appearance and decision-making in ethical dilemmas. Employing a Furhat robot that can change faces in an instant, we looked at how robot appearance affects decision-making and the perception of the robot itself. Pairs of participants were invited to discuss a dilemma presented by a robot, covering sensitive topics of ethnicity or gender. The robot either adopted a first-person or third-person perspective and altered its appearance accordingly. Following the explanation, participants were encouraged to discuss their choice of action in the dilemma situation. We did not find significant influences of robot appearance or dilemma topic on perceived anthropomorphism, animacy, likeability, or intelligence of the robot, partly in line with previous research. However, several participants hearing the dilemma from a first-person perspective changed their opinion because of the robot's appearance. Future work can expand with different measures such as engagement, in order to shed light on the intricate dynamics of human-robot interaction, emphasizing the need for thoughtful consideration in designing robot appearances to promote unbiased engagement in discussions of societal significance

DOCUMENT

Inclusive Dialogues: WokeBot Engaging Diversity Dilemmas

product

The Annual Conference on the Human Factor in Cybercrime

The Annual Conference on the Human Factor in Cybercrime is a small and specialised scientific event that aims to bring together scholars from around the world to present their research advances to a select audience. Its dynamic and linear format favours group discussions since all contributions are heard by all the attendants. This, together with its tailored social scheme, promotes interaction between members, which—in turn—leads to new collaborations. However, it has not yet been analysed whether the design of the conference actually encourages varied participation and fosters collaborative networks among its participants. The purpose of this chapter is to assess participation in the 2018 and 2019 editions to determine whether this is the case. Using descriptive analyses, here we show how participation in the conference has varied and examine the composition of the collaboration networks among the participants. The results show an increased and more diverse participation in the 2019 meeting along with a greater presence of stakeholders. Furthermore, the findings reveal that members of previously established organisations play an important role in cohering the network. Yet few connections exist between academia and practice. A further analysis of the strengths and weaknesses identified in the two editions of the conference serves to elaborate a series of recommendations for future editions.

DOCUMENT

product

Human-centered evaluation of explainable AI applications

Explainable Artificial Intelligence (XAI) aims to provide insights into the inner workings and the outputs of AI systems. Recently, there’s been growing recognition that explainability is inherently human-centric, tied to how people perceive explanations. Despite this, there is no consensus in the research community on whether user evaluation is crucial in XAI, and if so, what exactly needs to be evaluated and how. This systematic literature review addresses this gap by providing a detailed overview of the current state of affairs in human-centered XAI evaluation. We reviewed 73 papers across various domains where XAI was evaluated with users. These studies assessed what makes an explanation “good” from a user’s perspective, i.e., what makes an explanation meaningful to a user of an AI system. We identified 30 components of meaningful explanations that were evaluated in the reviewed papers and categorized them into a taxonomy of human-centered XAI evaluation, based on: (a) the contextualized quality of the explanation, (b) the contribution of the explanation to human-AI interaction, and (c) the contribution of the explanation to human- AI performance. Our analysis also revealed a lack of standardization in the methodologies applied in XAI user studies, with only 19 of the 73 papers applying an evaluation framework used by at least one other study in the sample. These inconsistencies hinder cross-study comparisons and broader insights. Our findings contribute to understanding what makes explanations meaningful to users and how to measure this, guiding the XAI community toward a more unified approach in human-centered explainability.

MULTIFILE

Human-centered evaluation of explainable AI applications

product

An "ultimate partnership"

Aim: There is often a gap between the ideal of involving older persons iteratively throughout the design process of digital technology, and actual practice. Until now, the lens of ageism has not been applied to address this gap. The goals of this study were: to voice the perspectives and experiences of older persons who participated in co-designing regarding the design process; their perceived role in co-designing and intergenerational interaction with the designers; and apparent manifestations of ageism that potentially influence the design of digital technology. Methods: Twenty-one older persons participated in three focus groups. Five themes were identified using thematic analysis which combined a critical ageism ‘lens’ deductive approach and an inductive approach. Results: Ageism was experienced by participants in their daily lives and interactions with the designers during the design process. Negative images of ageing were pointed out as a potential influencing factor on design decisions. Nevertheless, positive experiences of inclusive design pointed out the importance of “partnership” in the design process. Participants defined the “ultimate partnership” in co-designing as processes in which they were involved from the beginning, iteratively, in a participatory approach. Such processes were perceived as leading to successful design outcomes, which they would like to use, and reduced intergenerational tension. Conclusions: This study highlights the potential role of ageism as a detrimental factor in how digital technologies are designed. Viewing older persons as partners in co-designing and aspiring to more inclusive design processes may promote designing technologies that are needed, wanted and used.

DOCUMENT

product

Radio Dabanga

Deze casestudie geeft inzicht in verschillende soorten kennis die kenmerkend zijn voor applied design research. Er wordt onderscheid gemaakt tussen kennis over de huidige situatie, over wenselijke alternatieven en over effectieve oplossingen om daar te komen. Ofwel, kennis hoe het is, kennis over hoe het kan zijn en kennis over hoe het zal zijn als we effectieve oplossingen toepassen. Elk van deze soorten kennis heeft andere kwaliteitscriteria.

DOCUMENT

product

Assessing the Utility of an Interaction Qualities Framework in Systematizing the Evaluation of User Control

The user’s experience with a recommender system is significantly shaped by the dynamics of user-algorithm interactions. These interactions are often evaluated using interaction qualities, such as controllability, trust, and autonomy, to gauge their impact. As part of our effort to systematically categorize these evaluations, we explored the suitability of the interaction qualities framework as proposed by Lenz, Dieffenbach and Hassenzahl. During this examination, we uncovered four challenges within the framework itself, and an additional external challenge. In studies examining the interaction between user control options and interaction qualities, interdependencies between concepts, inconsistent terminology, and the entity perspective (is it a user’s trust or a system’s trustworthiness) often hinder a systematic inventory of the findings. Additionally, our discussion underscored the crucial role of the decision context in evaluating the relation of algorithmic affordances and interaction qualities. We propose dimensions of decision contexts (such as ‘reversibility of the decision’, or ‘time pressure’). They could aid in establishing a systematic three-way relationship between context attributes, attributes of user control mechanisms, and experiential goals, and as such they warrant further research. In sum, while the interaction qualities framework serves as a foundational structure for organizing research on evaluating the impact of algorithmic affordances, challenges related to interdependencies and context-specific influences remain. These challenges necessitate further investigation and subsequent refinement and expansion of the framework.

LINK

product

Interaction fields: intuitive sketch-based steering behaviors for crowd simulation.

The real-time simulation of human crowds has many applications. In a typical crowd simulation, each person ('agent') in the crowd moves towards a goal while adhering to local constraints. Many algorithms exist for specific local ‘steering’ tasks such as collision avoidance or group behavior. However, these do not easily extend to completely new types of behavior, such as circling around another agent or hiding behind an obstacle. They also tend to focus purely on an agent's velocity without explicitly controlling its orientation. This paper presents a novel sketch-based method for modelling and simulating many steering behaviors for agents in a crowd. Central to this is the concept of an interaction field (IF): a vector field that describes the velocities or orientations that agents should use around a given ‘source’ agent or obstacle. An IF can also change dynamically according to parameters, such as the walking speed of the source agent. IFs can be easily combined with other aspects of crowd simulation, such as collision avoidance. Using an implementation of IFs in a real-time crowd simulation framework, we demonstrate the capabilities of IFs in various scenarios. This includes game-like scenarios where the crowd responds to a user-controlled avatar. We also present an interactive tool that computes an IF based on input sketches. This IF editor lets users intuitively and quickly design new types of behavior, without the need for programming extra behavioral rules. We thoroughly evaluate the efficacy of the IF editor through a user study, which demonstrates that our method enables non-expert users to easily enrich any agent-based crowd simulation with new agent interactions.

MULTIFILE

Search results

Products 740

Developing a Human Centred AI Masters

Considering Human Interaction and Variability in Automatic Text Simplification

Inclusive Dialogues: WokeBot Engaging Diversity Dilemmas

The Annual Conference on the Human Factor in Cybercrime

Human-centered evaluation of explainable AI applications

An "ultimate partnership"

Radio Dabanga

Assessing the Utility of an Interaction Qualities Framework in Systematizing the Evaluation of User Control

Interaction fields: intuitive sketch-based steering behaviors for crowd simulation.

Projects 1

Robots in het onderwijs: de moreel verantwoorde inzet van robots assistenten

Navigate to

Categories

Filters

Products 740

Developing a Human Centred AI Masters

Considering Human Interaction and Variability in Automatic Text Simplification

Inclusive Dialogues: WokeBot Engaging Diversity Dilemmas

The Annual Conference on the Human Factor in Cybercrime

Human-centered evaluation of explainable AI applications

An "ultimate partnership"

Radio Dabanga

Assessing the Utility of an Interaction Qualities Framework in Systematizing the Evaluation of User Control

Interaction fields: intuitive sketch-based steering behaviors for crowd simulation.

Projects 1

Robots in het onderwijs: de moreel verantwoorde inzet van robots assistenten