Explainable Artificial Intelligence (XAI) aims to provide insights into the inner workings and the outputs of AI systems. Recently, there’s been growing recognition that explainability is inherently human-centric, tied to how people perceive explanations. Despite this, there is no consensus in the research community on whether user evaluation is crucial in XAI, and if so, what exactly needs to be evaluated and how. This systematic literature review addresses this gap by providing a detailed overview of the current state of affairs in human-centered XAI evaluation. We reviewed 73 papers across various domains where XAI was evaluated with users. These studies assessed what makes an explanation “good” from a user’s perspective, i.e., what makes an explanation meaningful to a user of an AI system. We identified 30 components of meaningful explanations that were evaluated in the reviewed papers and categorized them into a taxonomy of human-centered XAI evaluation, based on: (a) the contextualized quality of the explanation, (b) the contribution of the explanation to human-AI interaction, and (c) the contribution of the explanation to human- AI performance. Our analysis also revealed a lack of standardization in the methodologies applied in XAI user studies, with only 19 of the 73 papers applying an evaluation framework used by at least one other study in the sample. These inconsistencies hinder cross-study comparisons and broader insights. Our findings contribute to understanding what makes explanations meaningful to users and how to measure this, guiding the XAI community toward a more unified approach in human-centered explainability.
MULTIFILE
The main question in this PhD thesis is: How can Business Rules Management be configured and valued in organizations? A BRM problem space framework is proposed, existing of service systems, as a solution to the BRM problems. In total 94 vendor documents and approximately 32 hours of semi-structured interviews were analyzed. This analysis revealed nine individual service systems, in casu elicitation, design, verification, validation, deployment, execution, monitor, audit, and version. In the second part of this dissertation, BRM is positioned in relation to BPM (Business Process Management) by means of a literature study. An extension study was conducted: a qualitative study on a list of business rules formulated by a consulting organization based on the Committee of Sponsoring Organizations of the Treadway Commission risk framework. (from the summary of the Thesis p. 165)
A substantial amount of studies have addressed the influence of sound on human performance. In many of these, however, the large acoustic differences between experimental conditions prevent a direct translation of the results to realistic effects of room acoustic interventions. This review identifies those studies which can be, in principle, translated to (changes in) room acoustic parameters and adds to the knowledge about the influence of the indoor sound environment on people. The review procedure is based on the effect room acoustics can have on the relevant quantifiers of the sound environment in a room or space. 272 papers containing empirical findings on the influence of sound or noise on some measure of human performance were found. Of these, only 12 papers complied with this review's criteria. A conceptual framework is suggested based on the analysis of results, positioning the role of room acoustics in the influence of sound on task performance. Furthermore, valuable insights are pre- sented that can be used in future studies on this topic. Whi le the influence of the sound environment on performance is clearly an issue in many situations, evidence regarding the effectiveness of strategies to control the sound environment by room acoustic design is lacking and should be a focus area in future studies.
