This poster sketches the outlines of a theoretical research framework to assess whether and on what grounds certain behavioral effects may be attributed to particular game mechanics and game play aspects. It is founded on the Elaboration Likelihood Model of Persuasion (ELM), which is quite appropriate to guide the evaluation structure for interventions that either aim at short term or long term attitude and behavior change.
DOCUMENT
The concept of immersion has been widely used for the design and evaluation of user experiences. Augmented, virtual and mixed-reality environments have further sparked the discussion of immersive user experiences and underlying requirements. However, a clear definition and agreement on design criteria of immersive experiences remains debated, creating challenges to advancing our understanding of immersive experiences and how these can be designed. Based on a multidisciplinary Delphi approach, this study provides a uniform definition of immersive experiences and identifies key criteria for the design and staging thereof. Thematic analysis revealed five key themes – transition into/out of the environment, in-experience user control, environment design, user context relatedness, and user openness and motivation, that emphasise the coherency in the user-environment interaction in the immersive experience. The study proposes an immersive experience framework as a guideline for industry practitioners, outlining key design criteria for four distinct facilitators of immersive experiences–systems, spatial, empathic/social, and narrative/sequential immersion. Further research is proposed using the immersive experience framework to investigate the hierarchy of user senses to optimise experiences that blend physical and digital environments and to study triggered, desired and undesired effects on user attitude and behaviour.
MULTIFILE
The user’s experience with a recommender system is significantly shaped by the dynamics of user-algorithm interactions. These interactions are often evaluated using interaction qualities, such as controllability, trust, and autonomy, to gauge their impact. As part of our effort to systematically categorize these evaluations, we explored the suitability of the interaction qualities framework as proposed by Lenz, Dieffenbach and Hassenzahl. During this examination, we uncovered four challenges within the framework itself, and an additional external challenge. In studies examining the interaction between user control options and interaction qualities, interdependencies between concepts, inconsistent terminology, and the entity perspective (is it a user’s trust or a system’s trustworthiness) often hinder a systematic inventory of the findings. Additionally, our discussion underscored the crucial role of the decision context in evaluating the relation of algorithmic affordances and interaction qualities. We propose dimensions of decision contexts (such as ‘reversibility of the decision’, or ‘time pressure’). They could aid in establishing a systematic three-way relationship between context attributes, attributes of user control mechanisms, and experiential goals, and as such they warrant further research. In sum, while the interaction qualities framework serves as a foundational structure for organizing research on evaluating the impact of algorithmic affordances, challenges related to interdependencies and context-specific influences remain. These challenges necessitate further investigation and subsequent refinement and expansion of the framework.
LINK
Introduction: Sensor-feedback systems can be used to support people after stroke during independent practice of gait. The main aim of the study was to describe the user-centred approach to (re)design the user interface of the sensor feedback system “Stappy” for people after stroke, and share the deliverables and key observations from this process. Methods: The user-centred approach was structured around four phases (the discovery, definition, development and delivery phase) which were fundamental to the design process. Fifteen participants with cognitive and/or physical limitations participated (10 women, 2/3 older than 65). Prototypes were evaluated in multiple test rounds, consisting of 2–7 individual test sessions. Results: Seven deliverables were created: a list of design requirements, a personae, a user flow, a low-, medium- and high-fidelity prototype and the character “Stappy”. The first six deliverables were necessary tools to design the user interface, whereas the character was a solution resulting from this design process. Key observations related to “readability and contrast of visual information”, “understanding and remembering information”, “physical limitations” were confirmed by and “empathy” was additionally derived from the design process. Conclusions: The study offers a structured methodology resulting in deliverables and key observations, which can be used to (re)design meaningful user interfaces for people after stroke. Additionally, the study provides a technique that may promote “empathy” through the creation of the character Stappy. The description may provide guidance for health care professionals, researchers or designers in future user interface design projects in which existing products are redesigned for people after stroke.
DOCUMENT
User experience (UX) research on pervasive technologies faces considerable challenges regarding today's mobile context-sensitive applications: evaluative field studies lack control, whereas lab studies miss the interaction with a dynamic context. This dilemma has inspired researchers to use virtual environments (VEs) to acquire control while offering the user a rich contextual experience. Although promising, these studies are mainly concerned with usability and the technical realization of their setup. Furthermore, previous setups leave room for improvement regarding the user's immersive experience. This paper contributes to this line of research by presenting a UX case study on mobile advertising with a novel CAVE-smartphone interface. We conducted two experiments in which we evaluated the intrusiveness of a mobile locationbased advertising app in a virtual supermarket. The results confirm our hypothesis that context-congruent ads lessen the experienced intrusiveness thereby demonstrating that our setup is capable of generating preliminary meaningful results with regards to UX. Furthermore, we share insights in conducting these studies.
LINK
Abstract Background Visuospatial neglect (VSN) is a cognitive disorder after stroke in which patients fail to consciously process and interact with contralesional stimuli. Visual Scanning Training (VST) is the recommended treatment in clinical guidelines. At the moment, several mixed reality versions of Visual Scanning Training (VST) are being developed. The aim of this study was to explore the opinions of end-users (i.e., therapists) on the use of Virtual Reality (VR) and Augmented Reality (AR) in VSN treatment. Methods Therapists played one VR and two AR Serious Games, and subsequently flled out a questionnaire on User Experience, Usability, and Implementation. Results Sixteen therapists (psychologists, occupational, speech, and physiotherapists) played the games, thirteen of them evaluated the games. Therapists saw great potential in all three games, yet there was room for improvement on the level of usability, especially for tailoring the games to the patient’s needs. Therapists’ opinions were comparable between VR and AR Serious Games. For implementation, therapists stressed the urgency of clear guidelines and instructions. Discussion Even though VR/AR technology is promising for VSN treatment, there is no one-size-fts-all applicability. It may thus be crucial to move towards a plethora of training environments rather than a single standardized mixed reality neglect treatment. Conclusion As therapists see the potential value of mixed reality, it remains important to investigate the efcacy of AR and VR training tools.
DOCUMENT
Stakeholders must purposely reflect on the suitability of process models for designing tourism experience systems. Specific characteristics of these models relate to developing tourism experience systems as integral parts of wider socio-technical systems. Choices made in crafting such models need to address three reflexivity mechanisms: problem, stakeholder and method definition. We systematically evaluate application of these mechanisms in a living lab experiment, by developing evaluation episodes using the framework for evaluation in design science research. We outline (i) the development of these evaluation episodes and (ii) how executing them influenced the process and outcomes of co-crafting the process model. We highlight both the benefits of and an approach to incorporate reflexivity in developing process models for designing tourism experience systems.
MULTIFILE
In discussions on smart grids, it is often stated that residential end-users will play a more active role in the management of the electric power system. Experience in practice on how to empower end-users for such a role is however limited. This paper presents a field study in the first phase of the PowerMatching City project in which twenty-two households were equipped with demand-response-enabled heating systems and white goods. Although end-users were satisfied with the degree of living comfort afforded by the smart energy system, the user interface did not provide sufficient control and energy feedback to support an active contribution to the balancing of supply and demand. The full potential of demand response was thus not realized. The second phase of the project builds on these findings by design, implementation and evaluation of an improved user interface in combination with two demand response propositions. © 2013 IEEE.
DOCUMENT
Explainable Artificial Intelligence (XAI) aims to provide insights into the inner workings and the outputs of AI systems. Recently, there’s been growing recognition that explainability is inherently human-centric, tied to how people perceive explanations. Despite this, there is no consensus in the research community on whether user evaluation is crucial in XAI, and if so, what exactly needs to be evaluated and how. This systematic literature review addresses this gap by providing a detailed overview of the current state of affairs in human-centered XAI evaluation. We reviewed 73 papers across various domains where XAI was evaluated with users. These studies assessed what makes an explanation “good” from a user’s perspective, i.e., what makes an explanation meaningful to a user of an AI system. We identified 30 components of meaningful explanations that were evaluated in the reviewed papers and categorized them into a taxonomy of human-centered XAI evaluation, based on: (a) the contextualized quality of the explanation, (b) the contribution of the explanation to human-AI interaction, and (c) the contribution of the explanation to human- AI performance. Our analysis also revealed a lack of standardization in the methodologies applied in XAI user studies, with only 19 of the 73 papers applying an evaluation framework used by at least one other study in the sample. These inconsistencies hinder cross-study comparisons and broader insights. Our findings contribute to understanding what makes explanations meaningful to users and how to measure this, guiding the XAI community toward a more unified approach in human-centered explainability.
MULTIFILE
De Experience Tool: Mapping facts and practice to develop (spatial) experiences (Moes, Schrandt, Manuputty, Admiraal & van der Mark, 2019), is in eerste instantie ontwikkeld door docent-onderzoekers en een oud-student van het Amsterdam Fashion Institute (AMFI) om studenten beter onderbouwde afwegingen te laten maken over inrichting van bijvoorbeeld metrostations, winkels maar ook tentoonstellingen. De toolkit is dus niet ontwikkeld in het kader van Designing Experiencescapes of De Tentoonstellingsmaker van de 21ste Eeuw, maar deze onderzoeken hebben wel een belangrijke inhoudelijke basis gegeven voor de toolkit en zijn dus zeer relevant voor de (toekomstige) tentoonstellingsmaker. Het doel van deze tool is om spelers te inspireren bij en informeren over het creëren van belevingen in (hoofdzakelijk) fysieke ruimtes. De tool is voor iedereen die geïnteresseerd is in het creëren van belevingen en met name interessant voor studenten die een beleving willen neerzetten, in welke vorm dan ook en professionals uit de museale en de retailsector die invloed hebben op het inrichten van fysieke ruimtes.
MULTIFILE
