Introduction: Sensor-feedback systems can be used to support people after stroke during independent practice of gait. The main aim of the study was to describe the user-centred approach to (re)design the user interface of the sensor feedback system “Stappy” for people after stroke, and share the deliverables and key observations from this process. Methods: The user-centred approach was structured around four phases (the discovery, definition, development and delivery phase) which were fundamental to the design process. Fifteen participants with cognitive and/or physical limitations participated (10 women, 2/3 older than 65). Prototypes were evaluated in multiple test rounds, consisting of 2–7 individual test sessions. Results: Seven deliverables were created: a list of design requirements, a personae, a user flow, a low-, medium- and high-fidelity prototype and the character “Stappy”. The first six deliverables were necessary tools to design the user interface, whereas the character was a solution resulting from this design process. Key observations related to “readability and contrast of visual information”, “understanding and remembering information”, “physical limitations” were confirmed by and “empathy” was additionally derived from the design process. Conclusions: The study offers a structured methodology resulting in deliverables and key observations, which can be used to (re)design meaningful user interfaces for people after stroke. Additionally, the study provides a technique that may promote “empathy” through the creation of the character Stappy. The description may provide guidance for health care professionals, researchers or designers in future user interface design projects in which existing products are redesigned for people after stroke.
DOCUMENT
Background: Recent transitions in long-term care in the Netherlands have major consequences for community- dwelling older adults. A new paradigm expects them to manage and arrange their own care and support as much as possible. Technology can support this shift. A study has been conducted to explore the needs of community- dwelling frail older adults with regard to an online platform. An existing platform was subsequently modified, based upon these needs, resulting in an online community care platform (OCC-platform) comprising of care, health, and communication functions. The purpose of this platform was to support frail older adults in their independence and functioning, by stimulating self-care and providing reliable information, products and services. Methods: The study used a User-Centred Design. The development processes involved the following steps: Step 1) Identification of the User Requirements. To assess the user requirements, direct observations (N = 3) and interviews (N = 14) were performed. Step 2) Modification of an Existing Online Platform. Based upon Step 1, available online platforms were explored to determine whether an existing useful product was available. Two companies collaborated in modifying such a platform; Step 3) Testing the Modified Platform. A total of 73 older adults were invited to test a prototype of the OCC-platform during 6 months, which comprised of two phases: (1) a training phase; and (2) a testing phase. Results: An iterative process of modifications resulted in an interactive software concept on a Standard PC, containing 11 Functions. The Functions of ‘contacts’, ‘services’ and ‘messaging’, were by far, the most frequently used. The use was at its highest during the first 2 weeks of the testing and then its use steadily declined. The vast majority of the subjects (94%) were positive about the usability of the platform. Only a minority of the subjects (27%) indicated that the platform had added value for them. Conclusion: The overall prospect was that an OCC-platform can contribute to the social participation and the self-management competencies of frail older adults, together with their social cohesion in the community. In order to validate these prospects, further research is needed on the characteristics and the impact of online platforms.
MULTIFILE
In this post I give an overview of the theory, tools, frameworks and best practices I have found until now around the testing (and debugging) of machine learning applications. I will start by giving an overview of the specificities of testing machine learning applications.
LINK
Purpose: The aims of this study were to investigate how a variety of research methods is commonly employed to study technology and practitioner cognition. User-interface issues with infusion pumps were selected as a case because of its relevance to patient safety. Methods: Starting from a Cognitive Systems Engineering perspective, we developed an Impact Flow Diagram showing the relationship of computer technology, cognition, practitioner behavior, and system failure in the area of medical infusion devices. We subsequently conducted a systematic literature review on user-interface issues with infusion pumps, categorized the studies in terms of methods employed, and noted the usability problems found with particular methods. Next, we assigned usability problems and related methods to the levels in the Impact Flow Diagram. Results: Most study methods used to find user interface issues with infusion pumps focused on observable behavior rather than on how artifacts shape cognition and collaboration. A concerted and theorydriven application of these methods when testing infusion pumps is lacking in the literature. Detailed analysis of one case study provided an illustration of how to apply the Impact Flow Diagram, as well as how the scope of analysis may be broadened to include organizational and regulatory factors. Conclusion: Research methods to uncover use problems with technology may be used in many ways, with many different foci. We advocate the adoption of an Impact Flow Diagram perspective rather than merely focusing on usability issues in isolation. Truly advancing patient safety requires the systematic adoption of a systems perspective viewing people and technology as an ensemble, also in the design of medical device technology.
DOCUMENT
Purpose – purpose of this article is to report about the progress of the development of a method that makes sense of knowledge productivity, in order to be able to give direction to knowledge management initiatives. Methodology/approach – the development and testing of the method is based on the paradigm of the Design Sciences. In order to increase the objectivity of the research findings, and in order to test the transferability of the method, this article suggests a methodology for beta testing. Findings – based on the experiences within this research, the concept of beta testing seems to fit Design Science Research very well. Moreover, applying this concept within this research resulted in valuable findings for further development of the method. Research implications – this is the first article that explicitly applies the concept of beta testing to the process of developing solution concepts. Originality/value – this article contributes to the further operationalization of the relatively new concept of knowledge productivity. From a methodological point of view, this article aims to contribute to the paradigm of the Design Sciences in general, and the concept of beta testing in particular.
DOCUMENT
The user’s experience with a recommender system is significantly shaped by the dynamics of user-algorithm interactions. These interactions are often evaluated using interaction qualities, such as controllability, trust, and autonomy, to gauge their impact. As part of our effort to systematically categorize these evaluations, we explored the suitability of the interaction qualities framework as proposed by Lenz, Dieffenbach and Hassenzahl. During this examination, we uncovered four challenges within the framework itself, and an additional external challenge. In studies examining the interaction between user control options and interaction qualities, interdependencies between concepts, inconsistent terminology, and the entity perspective (is it a user’s trust or a system’s trustworthiness) often hinder a systematic inventory of the findings. Additionally, our discussion underscored the crucial role of the decision context in evaluating the relation of algorithmic affordances and interaction qualities. We propose dimensions of decision contexts (such as ‘reversibility of the decision’, or ‘time pressure’). They could aid in establishing a systematic three-way relationship between context attributes, attributes of user control mechanisms, and experiential goals, and as such they warrant further research. In sum, while the interaction qualities framework serves as a foundational structure for organizing research on evaluating the impact of algorithmic affordances, challenges related to interdependencies and context-specific influences remain. These challenges necessitate further investigation and subsequent refinement and expansion of the framework.
LINK
Background: During the process of decision-making for long-term care, clients are often dependent on informal support and available information about quality ratings of care services. However, clients do not take ratings into account when considering preferred care, and need assistance to understand their preferences. A tool to elicit preferences for long-term care could be beneficial. Therefore, the aim of this qualitative descriptive study is to understand the user requirements and develop a web-based preference elicitation tool for clients in need of longterm care. Methods: We applied a user-centred design in which end-users influence the development of the tool. The included end-users were clients, relatives, and healthcare professionals. Data collection took place between November 2017 and March 2018 by means of meetings with the development team consisting of four users, walkthrough interviews with 21 individual users, video-audio recordings, field notes, and observations during the use of the tool. Data were collected during three phases of iteration: Look and feel, Navigation, and Content. A deductive and inductive content analysis approach was used for data analysis. Results: The layout was considered accessible and easy during the Look and feel phase, and users asked for neutral images. Users found navigation easy, and expressed the need for concise and shorter text blocks. Users reached consensus about the categories of preferences, wished to adjust the content with propositions about well-being, and discussed linguistic difficulties. Conclusion: By incorporating the requirements of end-users, the user-centred design proved to be useful in progressing from the prototype to the finalized tool ‘What matters to me’. This tool may assist the elicitation of client’s preferences in their search for long-term care.
DOCUMENT
In this paper we compare the effects of using three game user research methodologies to assist in shaping levels for a 2-D platformer game, and illustrate how the use of such methodologies can help level designers to make more informed decisions in an otherwise qualitative oriented design process. Game user interviews, game metrics and psychophysiology (biometrics) were combined in pairs to gauge usefulness in small-scale commercial game development scenarios such as the casual game industry. Based on the recommendations made by the methods, three sample levels of a Super Mario clone were improved and the opinions of a second sample of users indicated the success of these changes. We conclude that user interviews provide the clearest indications for improvement among the considered methodologies while metrics and biometrics add different types of information that cannot be obtained otherwise.
DOCUMENT
This exploratory study investigates the rationale behind categorizing algorithmic controls, or algorithmic affordances, in the graphical user interfaces (GUIs) of recommender systems. Seven professionals from industry and academia took part in an open card sorting activity to analyze 45 cards with examples of algorithmic affordances in recommender systems’ GUIs. Their objective was to identify potential design patterns including features on which to base these patterns. Analyzing the group discussions revealed distinct thought processes and defining factors for design patterns that were shared by academic and industry partners. While the discussions were promising, they also demonstrated a varying degree of alignment between industry and academia when it came to labelling the identified categories. Since this workshop is part of the preparation for creating a design pattern library of algorithmic affordances, and since the library aims to be useful for both industry and research partners, further research into design patterns of algorithmic affordances, particularly in terms of labelling and description, is required in order to establish categories that resonate with all relevant parties
LINK
Background: Adequate self-management skills are of great importance for patients with chronic obstructive pulmonary disease (COPD) to reduce the impact of COPD exacerbations. Using mobile health (mHealth) to support exacerbation-related self-management could be promising in engaging patients in their own health and changing health behaviors. However, there is limited knowledge on how to design mHealth interventions that are effective, meet the needs of end users, and are perceived as useful. By following an iterative user-centered design (UCD) process, an evidence-driven and usable mHealth intervention was developed to enhance exacerbation-related self-management in patients with COPD. Objective: This study aimed to describe in detail the full UCD and development process of an evidence-driven and usable mHealth intervention to enhance exacerbation-related self-management in patients with COPD. Methods: The UCD process consisted of four iterative phases: (1) background analysis and design conceptualization, (2) alpha usability testing, (3) iterative software development, and (4) field usability testing. Patients with COPD, health care providers, COPD experts, designers, software developers, and a behavioral scientist were involved throughout the design and development process. The intervention was developed using the behavior change wheel (BCW), a theoretically based approach for designing behavior change interventions, and logic modeling was used to map out the potential working mechanism of the intervention. Furthermore, the principles of design thinking were used for the creative design of the intervention. Qualitative and quantitative research methods were used throughout the design and development process. Results: The background analysis and design conceptualization phase resulted in final guiding principles for the intervention, a logic model to underpin the working mechanism of the intervention, and design requirements. Usability requirements were obtained from the usability testing phases. The iterative software development resulted in an evidence-driven and usable mHealth intervention—Copilot, a mobile app consisting of a symptom-monitoring module, and a personalized COPD action plan. Conclusions: By following a UCD process, an mHealth intervention was developed that meets the needs and preferences of patients with COPD, is likely to be used by patients with COPD, and has a high potential to be effective in reducing exacerbation impact. This extensive report of the intervention development process contributes to more transparency in the development of complex interventions in health care and can be used by researchers and designers as guidance for the development of future mHealth interventions.
DOCUMENT
