Sustainability is one of the most important challenges of our time. How can we develop prosperity without compromising the lives of future generations? Information technology (IT) and information systems (IS) provide organizations with the ability to change and improve business processes to better support sustainable practices. IT/IS evaluation methods should therefore reflect this ability and include criteria for the assessment of sustainability aspects of IT/IS projects. However, IT/IS evaluation methods are still dominated by the economical perspective that resulted from the infamous IT productivity paradox. This chapter aims to broaden the perspective on IT/IS evaluation by exploring the integration of indicators that reflect the concepts of sustainability into IT/IS evaluation methods. The analysis will conclude that integrating sustainability considerations in IT/IS evaluation requires far more than a set of additional criteria to be considered.
LINK
Introduction: Depression can be a serious problem in young adult students. There is a need to implement and monitor prevention interventions for these students. Emotion-regulating improvisational music therapy (EIMT) was developed to prevent depression. The purpose of this study was to evaluate the feasibility of EIMT for use in practice for young adult students with depressive symptoms in a university context. Method: A process evaluation was conducted embedded in a larger research project. Eleven students, three music therapists and five referrers were interviewed. The music therapists also completed evaluation forms. Data were collected concerning client attendance, treatment integrity, musical components used to synchronise, and experiences with EIMT and referral. Results: Client attendance (90%) and treatment integrity were evaluated to be sufficient (therapist adherence 83%; competence 84%). The music therapists used mostly rhythm to synchronise (38 of 99 times). The students and music therapists reported that EIMT and its elements evoked changes in all emotion regulation components. The students reported that synchronisation elicited meaningful experiences of expressing joy, feeling heard, feeling joy and bodily responses of relaxation. The music therapists found the manual useful for applying EIMT. The student counsellors experienced EIMT as an appropriate way to support students due to its preventive character. Discussion: EIMT appears to be a feasible means of evoking changes in emotion regulation components in young adult students with depressive symptoms in a university context. More studies are needed to create a more nuanced and evidence-based understanding of the feasibility of EIMT, processes of change and treatment integrity.
Explainable Artificial Intelligence (XAI) aims to provide insights into the inner workings and the outputs of AI systems. Recently, there’s been growing recognition that explainability is inherently human-centric, tied to how people perceive explanations. Despite this, there is no consensus in the research community on whether user evaluation is crucial in XAI, and if so, what exactly needs to be evaluated and how. This systematic literature review addresses this gap by providing a detailed overview of the current state of affairs in human-centered XAI evaluation. We reviewed 73 papers across various domains where XAI was evaluated with users. These studies assessed what makes an explanation “good” from a user’s perspective, i.e., what makes an explanation meaningful to a user of an AI system. We identified 30 components of meaningful explanations that were evaluated in the reviewed papers and categorized them into a taxonomy of human-centered XAI evaluation, based on: (a) the contextualized quality of the explanation, (b) the contribution of the explanation to human-AI interaction, and (c) the contribution of the explanation to human- AI performance. Our analysis also revealed a lack of standardization in the methodologies applied in XAI user studies, with only 19 of the 73 papers applying an evaluation framework used by at least one other study in the sample. These inconsistencies hinder cross-study comparisons and broader insights. Our findings contribute to understanding what makes explanations meaningful to users and how to measure this, guiding the XAI community toward a more unified approach in human-centered explainability.
MULTIFILE
Smart city technologies, including artificial intelligence and computer vision, promise to bring a higher quality of life and more efficiently managed cities. However, developers, designers, and professionals working in urban management have started to realize that implementing these technologies poses numerous ethical challenges. Policy papers now call for human and public values in tech development, ethics guidelines for trustworthy A.I., and cities for digital rights. In a democratic society, these technologies should be understandable for citizens (transparency) and open for scrutiny and critique (accountability). When implementing such public values in smart city technologies, professionals face numerous knowledge gaps. Public administrators find it difficult to translate abstract values like transparency into concrete specifications to design new services. In the private sector, developers and designers still lack a ‘design vocabulary’ and exemplary projects that can inspire them to respond to transparency and accountability demands. Finally, both the public and private sectors see a need to include the public in the development of smart city technologies but haven’t found the right methods. This proposal aims to help these professionals to develop an integrated, value-based and multi-stakeholder design approach for the ethical implementation of smart city technologies. It does so by setting up a research-through-design trajectory to develop a prototype for an ethical ‘scan car’, as a concrete and urgent example for the deployment of computer vision and algorithmic governance in public space. Three (practical) knowledge gaps will be addressed. With civil servants at municipalities, we will create methods enabling them to translate public values such as transparency into concrete specifications and evaluation criteria. With designers, we will explore methods and patterns to answer these value-based requirements. Finally, we will further develop methods to engage civil society in this processes.
