Explainable Artificial Intelligence (XAI) aims to provide insights into the inner workings and the outputs of AI systems. Recently, there’s been growing recognition that explainability is inherently human-centric, tied to how people perceive explanations. Despite this, there is no consensus in the research community on whether user evaluation is crucial in XAI, and if so, what exactly needs to be evaluated and how. This systematic literature review addresses this gap by providing a detailed overview of the current state of affairs in human-centered XAI evaluation. We reviewed 73 papers across various domains where XAI was evaluated with users. These studies assessed what makes an explanation “good” from a user’s perspective, i.e., what makes an explanation meaningful to a user of an AI system. We identified 30 components of meaningful explanations that were evaluated in the reviewed papers and categorized them into a taxonomy of human-centered XAI evaluation, based on: (a) the contextualized quality of the explanation, (b) the contribution of the explanation to human-AI interaction, and (c) the contribution of the explanation to human- AI performance. Our analysis also revealed a lack of standardization in the methodologies applied in XAI user studies, with only 19 of the 73 papers applying an evaluation framework used by at least one other study in the sample. These inconsistencies hinder cross-study comparisons and broader insights. Our findings contribute to understanding what makes explanations meaningful to users and how to measure this, guiding the XAI community toward a more unified approach in human-centered explainability.
MULTIFILE
For people with early-dementia (PwD), it can be challenging to remember to eat and drink regularly and maintain a healthy independent living. Existing intelligent home technologies primarily focus on activity recognition but lack adaptive support. This research addresses this gap by developing an AI system inspired by the Just-in-Time Adaptive Intervention (JITAI) concept. It adapts to individual behaviors and provides personalized interventions within the home environment, reminding and encouraging PwD to manage their eating and drinking routines. Considering the cognitive impairment of PwD, we design a human-centered AI system based on healthcare theories and caregivers’ insights. It employs reinforcement learning (RL) techniques to deliver personalized interventions. To avoid overwhelming interaction with PwD, we develop an RL-based simulation protocol. This allows us to evaluate different RL algorithms in various simulation scenarios, not only finding the most effective and efficient approach but also validating the robustness of our system before implementation in real-world human experiments. The simulation experimental results demonstrate the promising potential of the adaptive RL for building a human-centered AI system with perceived expressions of empathy to improve dementia care. To further evaluate the system, we plan to conduct real-world user studies.
DOCUMENT
Laurence Alpay, Harmen Bijwaard en Rob Doms hebben bijdrage geleverd aan dit boek. zie hoofdstuk 7. Blz. 159 In dit hoofdstuk bekijken we de betekenis van ‘de mens centraal’ bij de ontwikkeling van technologie voor gezondheidszorg en welzijnsbevordering. In de zorg- en welzijnssector zijn door de vergrijzing straks meer professionals nodig, maar deze zijn waarschijnlijk in onvoldoende mate beschikbaar vanwege budgettaire beperkingen en te weinig menskracht. Technologie kan hier een oplossing bieden door taken over te nemen of te vergemakkelijken.
DOCUMENT
With artificial intelligence (AI) systems entering our working and leisure environments with increasing adaptation and learning capabilities, new opportunities arise for developing hybrid (human-AI) intelligence (HI) systems, comprising new ways of collaboration. However, there is not yet a structured way of specifying design solutions of collaboration for hybrid intelligence (HI) systems and there is a lack of best practices shared across application domains. We address this gap by investigating the generalization of specific design solutions into design patterns that can be shared and applied in different contexts. We present a human-centered bottom-up approach for the specification of design solutions and their abstraction into team design patterns. We apply the proposed approach for 4 concrete HI use cases and show the successful extraction of team design patterns that are generalizable, providing re-usable design components across various domains. This work advances previous research on team design patterns and designing applications of HI systems.
MULTIFILE
Technology in general, and assistive technology in particular, is considered to be a promising opportunity to address the challenges of an aging population. Nevertheless, in health care, technology is not as widely used as could be expected. In this chapter, an overview is given of theories and models that help to understand this phenomenon. First, the design of (assistive) technologies will be addressed and the importance of human-centered design in the development of new assistive devices will be discussed. Also theories and models are addressed about technology acceptance in general. Specific attention will be given to technology acceptance in healthcare professionals, and the implementation of technology within healthcare organizations. The chapter will be based on the state of the art of scientific literature and will be illustrated with examples from our research in daily practice considering the different perspectives of involved stakeholders.
LINK
Home care patients often use many medications and are prone to drug-related problems (DRPs). For the management of problems related to drug use, home care could add to the multidisciplinary expertise of general practitioners (GPs) and pharmacists. The home care observation of medication-related problems by home care employees (HOME)-instrument is paper-based and assists home care workers in reporting potential DRPs. To facilitate the multiprofessional consultation, a digital report of DRPs from the HOME-instrument and digital monitoring and consulting of DRPs between home care and general practices and pharmacies is desired. The objective of this study was to develop an electronic HOME system (eHOME), a mobile version of the HOME-instrument that includes a monitoring and a consulting system for primary care.
DOCUMENT
Background: Phantom limb pain is a frequent and persistent problem following amputation. Achieving sustainable favorable effects on phantom limb pain requires therapeutic interventions such as mirror therapy that target maladaptive neuroplastic changes in the central nervous system. Unfortunately, patients’ adherence to unsupervised exercises is generally poor and there is a need for effective strategies such as telerehabilitation to support long-term self-management of patients with phantom limb pain. Objective: The main aim of this study was to describe the user-centered approach that guided the design and development of a telerehabilitation platform for patients with phantom limb pain. We addressed 3 research questions: (1) Which requirements are defined by patients and therapists for the content and functions of a telerehabilitation platform and how can these requirements be prioritized to develop a first prototype of the platform? (2) How can the user interface of the telerehabilitation platform be designed so as to match the predefined critical user requirements and how can this interface be translated into a medium-fidelity prototype of the platform? (3) How do patients with phantom limb pain and their treating therapists judge the usability of the medium-fidelity prototype of the telerehabilitation platform in routine care and how can the platform be redesigned based on their feedback to achieve a high-fidelity prototype?
DOCUMENT
This investigation explores relations between 1) a theory of human cognition, called Embodied Cognition, 2) the design of interactive systems and 3) the practice of ‘creative group meetings’ (of which the so-called ‘brainstorm’ is perhaps the best-known example). The investigation is one of Research-through-Design (Overbeeke et al., 2006). This means that, together with students and external stakeholders, I designed two interactive prototypes. Both systems contain a ‘mix’ of both physical and digital forms. Both are designed to be tools in creative meeting sessions, or brainstorms. The tools are meant to form a natural, element in the physical meeting space. The function of these devices is to support the formation of shared insight: that is, the tools should support the process by which participants together, during the activity, get a better grip on the design challenge that they are faced with. Over a series of iterations I reflected on the design process and outcome, and investigated how users interacted with the prototypes.
DOCUMENT
Office well-being aims to explore and support a healthy, balanced and active work style in office environments. Recent work on tangible user interfaces has started to explore the role of physical, tangible interfaces as active interventions to explore how to tackle problems such as inactive work and lifestyles, and increasingly sedentary behaviours. We identify a fragmented research landscape on tangible Office well-being interventions, missing the relationship between interventions, data, design strategies, and outcomes, and behaviour change techniques. Based on the analysis of 40 papers, we identify 7 classifications in tangible Office well-being interventions and analyse the intervention based on their role and foundation in behaviour change. Based on the analysis, we present design considerations for the development of future tangible Office well-being design interventions and present an overview of the current field and future research into tangible Office well-being interventions to design for a healthier and active office environment.
DOCUMENT
Societal one-way directed approaches of sustainable primary school building design cause persistent physical building problems. It affects the performances of the societal challenge of designing real sustainable school buildings, as well as the educational and social processes, and its end-user performances. Conventional building construction approaches build traditionally their designs on a syntheses of dialogues and consensus during decision-making processes, due to a variety of different interests. Principals define their ambitions and requirements into a team of mainly technical domain related disciplines. There are no design methods available that connect human systems and ecosystems integrated and balance the dynamic multi-level scaled mechanisms of human needs and sustainability development factors. The presented analytic framework recognizes similarity patterns between these multi-level scaled social systems, ecosystems and sustainable development entities, qualitatively as well as quantitatively. It delivers a new polarity based dynamic system that contributes to the client briefs and physical building morphological factors from a more sustainable development base. This theoretical approach establishes Sustainability-Centered Guidelines for primary schools (SCGs) design and building.
DOCUMENT
