Background: There is an emergence of mobile health (mHealth) interventions to support self-management in patients with chronic obstructive pulmonary disease (COPD). Recently, an evidence-driven mHealth intervention has been developed to support patients with COPD in exacerbation-related self-management: the Copilot app. Health care providers (HCPs) are important stakeholders as they are the ones who have to provide the app to patients, personalize the app, and review the app. It is, therefore, important to investigate at an early stage whether the app is feasible in the daily practice of the HCPs. Objective: The aim of this study is to evaluate the perceived feasibility of the Copilot app in the daily practice of HCPs. Methods: A multimethods design was used to investigate how HCPs experience working with the app and how they perceive the feasibility of the app in their daily practice. The feasibility areas described by Bowen et al were used for guidance. HCPs were observed while performing tasks in the app and asked to think aloud. The System Usability Scale was used to investigate the usability of the app, and semistructured interviews were conducted to explore the feasibility of the app. The study was conducted in primary, secondary, and tertiary care settings in the Netherlands from February 2019 to September 2019. Results: In total, 14 HCPs participated in this study—8 nurses, 5 physicians, and 1 physician assistant. The HCPs found the app acceptable to use. The expected key benefits of the app were an increased insight into patient symptoms, more structured patient conversations, and more tailored self-management support. The app especially fits within the available time and workflow of nurses. The use of the app will be influenced by the autonomy of the professional, the focus of the organization on eHealth, costs associated with the app, and compatibility with the current systems used. Most HCPs expressed that there are conditions that must be met to be able to use the app. The app can be integrated into the existing care paths of primary, secondary, and tertiary health care settings. Individual organizational factors must be taken into account when integrating the app into daily practice. Conclusions: This early-stage feasibility study shows that the Copilot app is feasible to use in the daily practice of HCPs and can be integrated into primary, secondary, and tertiary health care settings in the Netherlands. The app was considered to best fit the role of the nurses. The app will be less feasible for those organizations in which many conditions need to be met to use the app. This study provides a new approach to evaluate the perceived feasibility of mHealth interventions at an early stage and provides valuable insights for further feasibility testing.
Background: In the past years, a mobile health (mHealth) app called the Dutch Talking Touch Screen Questionnaire (DTTSQ) was developed in The Netherlands. The aim of development was to enable Dutch physical therapy patients to autonomously complete a health-related questionnaire regardless of their level of literacy and digital skills. Objective: The aim of this study was to evaluate the usability (defined as the effectiveness, efficiency, and satisfaction) of the prototype of the DTTSQ for Dutch physical therapy patients with diverse levels of experience in using mobile technology. Methods: The qualitative Three-Step Test-Interview method, including both think-aloud and retrospective probing techniques, was used to gain insight into the usability of the DTTSQ. A total of 24 physical therapy patients were included. The interview data were analyzed using a thematic content analysis approach aimed at analyzing the accuracy and completeness with which participants completed the questionnaire (effectiveness), the time it took the participants to complete the questionnaire (efficiency), and the extent to which the participants were satisfied with the ease of use of the questionnaire (satisfaction). The problems encountered by the participants in this study were given a severity rating that was used to provide a rough estimate of the need for additional usability efforts. Results: All participants within this study were very satisfied with the ease of use of the DTTSQ. Overall, 9 participants stated that the usability of the app exceeded their expectations. The group of 4 average-/high-experienced participants encountered only 1 problem in total, whereas the 11 little-experienced participants encountered an average of 2 problems per person and the 9 inexperienced participants an average of 3 problems per person. A total of 13 different kind of problems were found during this study. Of these problems, 4 need to be addressed before the DTTSQ will be released because they have the potential to negatively influence future usage of the tool. The other 9 problems were less likely to influence future usage of the tool substantially. Conclusions: The usability of the DTTSQ needs to be improved before it can be released. No problems were found with satisfaction or efficiency during the usability test. The effectiveness needs to be improved by (1) making it easier to navigate through screens without the possibility of accidentally skipping one, (2) enabling the possibility to insert an answer by tapping on the text underneath a photograph instead of just touching the photograph itself, and (3) making it easier to correct wrong answers. This study shows the importance of including less skilled participants in a usability study when striving for inclusive design and the importance of measuring not just satisfaction but also efficiency and effectiveness during such studies.
LINK
Background: Adequate self-management skills are of great importance for patients with chronic obstructive pulmonary disease (COPD) to reduce the impact of COPD exacerbations. Using mobile health (mHealth) to support exacerbation-related self-management could be promising in engaging patients in their own health and changing health behaviors. However, there is limited knowledge on how to design mHealth interventions that are effective, meet the needs of end users, and are perceived as useful. By following an iterative user-centered design (UCD) process, an evidence-driven and usable mHealth intervention was developed to enhance exacerbation-related self-management in patients with COPD. Objective: This study aimed to describe in detail the full UCD and development process of an evidence-driven and usable mHealth intervention to enhance exacerbation-related self-management in patients with COPD. Methods: The UCD process consisted of four iterative phases: (1) background analysis and design conceptualization, (2) alpha usability testing, (3) iterative software development, and (4) field usability testing. Patients with COPD, health care providers, COPD experts, designers, software developers, and a behavioral scientist were involved throughout the design and development process. The intervention was developed using the behavior change wheel (BCW), a theoretically based approach for designing behavior change interventions, and logic modeling was used to map out the potential working mechanism of the intervention. Furthermore, the principles of design thinking were used for the creative design of the intervention. Qualitative and quantitative research methods were used throughout the design and development process. Results: The background analysis and design conceptualization phase resulted in final guiding principles for the intervention, a logic model to underpin the working mechanism of the intervention, and design requirements. Usability requirements were obtained from the usability testing phases. The iterative software development resulted in an evidence-driven and usable mHealth intervention—Copilot, a mobile app consisting of a symptom-monitoring module, and a personalized COPD action plan. Conclusions: By following a UCD process, an mHealth intervention was developed that meets the needs and preferences of patients with COPD, is likely to be used by patients with COPD, and has a high potential to be effective in reducing exacerbation impact. This extensive report of the intervention development process contributes to more transparency in the development of complex interventions in health care and can be used by researchers and designers as guidance for the development of future mHealth interventions.
