Explainable Artificial Intelligence (XAI) aims to provide insights into the inner workings and the outputs of AI systems. Recently, there’s been growing recognition that explainability is inherently human-centric, tied to how people perceive explanations. Despite this, there is no consensus in the research community on whether user evaluation is crucial in XAI, and if so, what exactly needs to be evaluated and how. This systematic literature review addresses this gap by providing a detailed overview of the current state of affairs in human-centered XAI evaluation. We reviewed 73 papers across various domains where XAI was evaluated with users. These studies assessed what makes an explanation “good” from a user’s perspective, i.e., what makes an explanation meaningful to a user of an AI system. We identified 30 components of meaningful explanations that were evaluated in the reviewed papers and categorized them into a taxonomy of human-centered XAI evaluation, based on: (a) the contextualized quality of the explanation, (b) the contribution of the explanation to human-AI interaction, and (c) the contribution of the explanation to human- AI performance. Our analysis also revealed a lack of standardization in the methodologies applied in XAI user studies, with only 19 of the 73 papers applying an evaluation framework used by at least one other study in the sample. These inconsistencies hinder cross-study comparisons and broader insights. Our findings contribute to understanding what makes explanations meaningful to users and how to measure this, guiding the XAI community toward a more unified approach in human-centered explainability.
MULTIFILE
Pedagogical approaches often assume fixed ontological positions, such as teacher-centered, curriculum-centered, child-centered, or world-centered perspectives, which tend to overlook the complexity of educational practice. These approaches limit educators’ ability to adaptively shift between diverse aims, including cognitive development, individual flourishing, social learning, and critical emancipation. This scoping review explores the potential of Object-Oriented Ontology (OOO) to introduce ontological flexibility into pedagogical discourse and practice, by addressing the research question: what is known on the integration of OOO into the field of pedagogy? A search was conducted across five databases: ERIC, Education Research Complete, Academic Search Complete, Psychology and Behavioral Sciences Collection, and Teacher Reference Center. Analysis of eleven included studies, published between 2011 and 2022, reveals that pedagogical practice is undesirably reduced when the ontological position is predetermined. Instead, educational practice consists of multiple irreducible objects, such as students, teachers, curricula, technologies, educational processes, methods, facts. The findings support the development of an adaptive pedagogical approach in which educational purpose emerges through the systematic comparison of objects, rather than predefined by approaches. OOO provides a framework for practitioners to imagine practices in which learning and self-realization unfold through shared participation in meaningful objects.
LINK
For people with early-dementia (PwD), it can be challenging to remember to eat and drink regularly and maintain a healthy independent living. Existing intelligent home technologies primarily focus on activity recognition but lack adaptive support. This research addresses this gap by developing an AI system inspired by the Just-in-Time Adaptive Intervention (JITAI) concept. It adapts to individual behaviors and provides personalized interventions within the home environment, reminding and encouraging PwD to manage their eating and drinking routines. Considering the cognitive impairment of PwD, we design a human-centered AI system based on healthcare theories and caregivers’ insights. It employs reinforcement learning (RL) techniques to deliver personalized interventions. To avoid overwhelming interaction with PwD, we develop an RL-based simulation protocol. This allows us to evaluate different RL algorithms in various simulation scenarios, not only finding the most effective and efficient approach but also validating the robustness of our system before implementation in real-world human experiments. The simulation experimental results demonstrate the promising potential of the adaptive RL for building a human-centered AI system with perceived expressions of empathy to improve dementia care. To further evaluate the system, we plan to conduct real-world user studies.
DOCUMENT
Abstract Background: To address the lack of social interaction and meaningful activities for persons with dementia (PWD) in nursing homes an artistic Photo-Activity was designed. The present study aims to develop a digital version of the Photo-Activity and to investigate its implementation and impact on nursing home residents with advanced dementia, and their (in)formal carers. Methods: First, within a user-participatory design, a digital-app version of the Photo-Activity will be developed and pilot-tested, in co-creation with (in)formal carers and PWD. Next, the feasibility and effectiveness of the Photo-Activity versus a control activity will be explored in a randomized controlled trial with nursing home residents (N=90), and their (in)formal carers. Residents will be offered the Photo- Activity or the control activity by (in)formal carers during one month. Measurements will be conducted by independent assessors at baseline (T0), after one month (T1) and at follow up, two weeks after T1 (T2). Qualitative and quantitative methods will be used to investigate the effects of the intervention on mood, social interaction and quality of life of the PWD, sense of competence of informal carers, empathy and personal attitude of the formal carers, and quality of the relationship between the PWD, and their (in)formal carers. In addition, a process evaluation will be carried out by means of semi-structured interviews with the participating residents and (in)formal carers. Finally, an implementation package based on the process evaluation will be developed, allowing the scaling up of the intervention to other care institutions. Discussion: Results of the trial will be available for dissemination by Spring 2023. The digital Photo-Activity is expected to promote meaningful connections between the resident with dementia, and their (in)formal carers through the facilitation of person-centered conversations. Trial registration: Netherlands Trial Register: NL9219; registered (21 January 2021); NTR (trialregister.nl)
DOCUMENT
Person-centeredness refers to an individually-tailored, holistic approach to meeting a person's needs and recognizing the client as an expert and active participant in the rehabilitation process. This article focuses on a study conducted in Estonia to analyze the perceptions of persons with disabilities about person-centeredness by exploring their experiences about received disability services and participation in an initial rehabilitation needs assessment process. Twelve in-depth interviews were conducted in different regions of Estonia with persons with disability. Data were analyzed using qualitative thematic analysis. The aim of the research project (2010–2015) was to design a person-centered initial rehabilitation needs assessment instrument. Results revealed that in describing their experiences, study participants identified important components of person-centeredness: (1) understanding service users and meeting their individual needs, (2) connecting and partnering with service users, (3) providing appropriate information, and (4) addressing issues of power and empowerment. If these components are included, service users are more likely to become motivated to consider their situation and take more control of their lives. These findings may be of relevance for countries considering needs-based referrals to rehabilitation services and refocusing disability services using a person-centered approach
DOCUMENT
Background: Adequate self-management skills are of great importance for patients with chronic obstructive pulmonary disease (COPD) to reduce the impact of COPD exacerbations. Using mobile health (mHealth) to support exacerbation-related self-management could be promising in engaging patients in their own health and changing health behaviors. However, there is limited knowledge on how to design mHealth interventions that are effective, meet the needs of end users, and are perceived as useful. By following an iterative user-centered design (UCD) process, an evidence-driven and usable mHealth intervention was developed to enhance exacerbation-related self-management in patients with COPD. Objective: This study aimed to describe in detail the full UCD and development process of an evidence-driven and usable mHealth intervention to enhance exacerbation-related self-management in patients with COPD. Methods: The UCD process consisted of four iterative phases: (1) background analysis and design conceptualization, (2) alpha usability testing, (3) iterative software development, and (4) field usability testing. Patients with COPD, health care providers, COPD experts, designers, software developers, and a behavioral scientist were involved throughout the design and development process. The intervention was developed using the behavior change wheel (BCW), a theoretically based approach for designing behavior change interventions, and logic modeling was used to map out the potential working mechanism of the intervention. Furthermore, the principles of design thinking were used for the creative design of the intervention. Qualitative and quantitative research methods were used throughout the design and development process. Results: The background analysis and design conceptualization phase resulted in final guiding principles for the intervention, a logic model to underpin the working mechanism of the intervention, and design requirements. Usability requirements were obtained from the usability testing phases. The iterative software development resulted in an evidence-driven and usable mHealth intervention—Copilot, a mobile app consisting of a symptom-monitoring module, and a personalized COPD action plan. Conclusions: By following a UCD process, an mHealth intervention was developed that meets the needs and preferences of patients with COPD, is likely to be used by patients with COPD, and has a high potential to be effective in reducing exacerbation impact. This extensive report of the intervention development process contributes to more transparency in the development of complex interventions in health care and can be used by researchers and designers as guidance for the development of future mHealth interventions.
DOCUMENT
Den Haag is een internationale stad waar buitenlandse werknemers zich graag vestigen. Den Haag is op het gebied van vrede, recht en veiligheid in de loop der tijd uitgegroeid tot een stad van mondiale betekenis (Eyffinger, 1999) (Wladimiroff, 2009). Deze ontwikkeling ging niet zonder slag of stoot. Aan de hand van literatuuronderzoek en circa twintig interviews met vertegenwoordigers van overheidsbeleid en internationale instellingen is hier een analyse gemaakt van de voorgeschiedenis van Den Haag als internationale stad en de effectiviteit van het beleid met betrekking tot internationale instellingen. Eén van de uitkomsten is dat internationale organisaties gebaat zijn bij een goede samenwerking tussen de gemeente en het ministerie van Buitenlandse Zaken. Het proces van aantrekken en faciliteren van internationale (kennis) instellingen en (non-)gouvernementele organisaties kan beter gestroomlijnd worden. Voorts zouden mogelijk enkele nieuwe tribunalen in Den Haag kunnen worden gevestigd. ABSTRACT The Hague is more and more the legal capital of the world. The Hague municipality and the Ministry of Foreign Affairs successfully promoted the city as such and made it a real global center of justice, peace and security (Eyffinger, 1999) (Wladimiroff, 2009). The process of attracting and managing international organizations, centers of knowledge, governmental and non-governmental organizations, was not always easy. Internal and external factors determine the way the city still develops its status as 'legal capital of the world'. Based on literature and about twenty interviews with representatives of the local and national governments and employees of international organizations, this article concludes that progress can be made through more cooperation between the municipality and the Ministry of Foreign Affairs. Attracting new international organizations can be streamlined in a better way. Some new tribunals might be established in The Hague.
DOCUMENT
Background: The worldwide increase in the rates of childhood overweight and physical inactivity requires successful prevention and intervention programs for children. The aim of the Active Living project is to increase physical activity and decrease sedentary behavior of Dutch primary school children by developing and implementing tailored, multicomponent interventions at and around schools. Methods/design: In this project, school-centered interventions have been developed at 10 schools in the south of the Netherlands, using a combined top-down and bottom-up approach in which a research unit and a practice unit continuously interact. The interventions consist of a combination of physical and social interventions tailored to local needs of intervention schools. The process and short- and long-term effectiveness of the interventions will be evaluated using a quasi-experimental study design in which 10 intervention schools are matched with 10 control schools. Baseline and follow-up measurements (after 12 and 24 months) have been conducted in grades 6 and 7 and included accelerometry, GPS, and questionnaires. Primary outcome of the Active Living study is the change in physical activity levels, i.e. sedentary behavior (SB), light physical activity (LPA), moderate-to-vigorous physical activity (MVPA), and counts-per-minute (CPM). Multilevel regression analyses will be used to assess the effectiveness of isolated and combined physical and social interventions on children’s PA levels. Discussion: The current intervention study is unique in its combined approach of physical and social environmental PA interventions both at school(yard)s as well as in the local neighborhood around the schools. The strength of the study lies in the quasi-experimental design including objective measurement techniques, i.e. accelerometry and GPS, combined with more subjective techniques, i.e. questionnaires, implementation logbooks, and neighborhood observations. LinkedIn: https://www.linkedin.com/in/sanned/
DOCUMENT
Technology in general, and assistive technology in particular, is considered to be a promising opportunity to address the challenges of an aging population. Nevertheless, in health care, technology is not as widely used as could be expected. In this chapter, an overview is given of theories and models that help to understand this phenomenon. First, the design of (assistive) technologies will be addressed and the importance of human-centered design in the development of new assistive devices will be discussed. Also theories and models are addressed about technology acceptance in general. Specific attention will be given to technology acceptance in healthcare professionals, and the implementation of technology within healthcare organizations. The chapter will be based on the state of the art of scientific literature and will be illustrated with examples from our research in daily practice considering the different perspectives of involved stakeholders.
LINK