Abstract: Embodied embedded cognition (EEC) has gained support in cognitive science as well as in human–computer interaction (HCI). EEC can be characterized both by its action-centeredness as well as its roots in phenomenology. The phenomenological aspects of EEC could be seen as support for trends in design emphasizing the user experience. Meanwhile, usability issues often are still approached using traditional methods based on cognitivist assumptions. In this paper, I argue for a renewed focus on improving usability from an EEC perspective. I draw mainly on a behavior-oriented interpretation of the theory, the key aspects of which are reviewed. A tentative sketch for an embodied embedded usability is proposed, doing justice to the embodied embedded nature of interaction while retaining the goal of developing technology that is easy to use in everyday practice.
LINK
Background: Major surgery is associated with negative postoperative outcomes such as complications and delayed or poor recovery. Multimodal prehabilitation can help to reduce the negative effects of major surgery. Offering prehabilitation by means of mobile health (mHealth) could be an effective new approach. Objective: The objectives of this pilot study were to (1) evaluate the usability of the Be Prepared mHealth app prototype for people undergoing major surgery, (2) explore whether the app was capable of bringing about a change in risk behaviors, and (3) estimate a preliminary effect of the app on functional recovery after major surgery. Methods: A mixed-methods pilot randomized controlled trial was conducted in two Dutch academic hospitals. In total, 86 people undergoing major surgery participated. Participants in the intervention group received access to the Be Prepared app, a smartphone app using behavior change techniques to address risk behavior prior to surgery. Both groups received care as usual. Usability (System Usability Scale), change in risk behaviors 3 days prior to surgery, and functional recovery 30 days after discharge from hospital (Patient-Reported Outcomes Measurement Information System physical functioning 8-item short form) were assessed using online questionnaires. Quantitative data were analyzed using descriptive statistics, chi-square tests, and multivariable linear regression. Semistructured interviews about the usability of the app were conducted with 12 participants in the intervention group. Thematic analysis was used to analyze qualitative data. Results: Seventy-nine people-40 in the intervention group and 39 in the control group-were available for further analysis. Participants had a median age of 61 (interquartile range 51.0-68.0) years. The System Usability Scale showed that patients considered the Be Prepared app to have acceptable usability (mean 68.2 [SD 18.4]). Interviews supported the usability of the app. The major point of improvement identified was further personalization of the app. Compared with the control group, the intervention group showed an increase in self-reported physical activity and muscle strengthening activities prior to surgery. Also, 2 of 2 frequent alcohol users in the intervention group versus 1 of 9 in the control group drank less alcohol in the run-up to surgery. No difference was found in change of smoking cessation. Between-group analysis showed no meaningful differences in functional recovery after correction for baseline values (β=-2.4 [95% CI -5.9 to 1.1]). Conclusions: The Be Prepared app prototype shows potential in terms of usability and changing risk behavior prior to major surgery. No preliminary effect of the app on functional recovery was found. Points of improvement have been identified with which the app and future research can be optimized. Trial Registration: Netherlands Trial Registry NL8623; https://www.trialregister.nl/trial/8623.
DOCUMENT
Background: Major surgery is associated with negative postoperative outcomes such as complications and delayed or poor recovery. Multimodal prehabilitation can help to reduce the negative effects of major surgery. Offering prehabilitation by means of mobile health (mHealth) could be an effective new approach. Objective: The objectives of this pilot study were to (1) evaluate the usability of the Be Prepared mHealth app prototype for people undergoing major surgery, (2) explore whether the app was capable of bringing about a change in risk behaviors, and (3) estimate a preliminary effect of the app on functional recovery after major surgery. Methods: A mixed-methods pilot randomized controlled trial was conducted in two Dutch academic hospitals. In total, 86 people undergoing major surgery participated. Participants in the intervention group received access to the Be Prepared app, a smartphone app using behavior change techniques to address risk behavior prior to surgery. Both groups received care as usual. Usability (System Usability Scale), change in risk behaviors 3 days prior to surgery, and functional recovery 30 days after discharge from hospital (Patient-Reported Outcomes Measurement Information System physical functioning 8-item short form) were assessed using online questionnaires. Quantitative data were analyzed using descriptive statistics, chi-square tests, and multivariable linear regression. Semistructured interviews about the usability of the app were conducted with 12 participants in the intervention group. Thematic analysis was used to analyze qualitative data. Results: Seventy-nine people—40 in the intervention group and 39 in the control group—were available for further analysis. Participants had a median age of 61 (interquartile range 51.0-68.0) years. The System Usability Scale showed that patients considered the Be Prepared app to have acceptable usability (mean 68.2 [SD 18.4]). Interviews supported the usability of the app. The major point of improvement identified was further personalization of the app. Compared with the control group, the intervention group showed an increase in self-reported physical activity and muscle strengthening activities prior to surgery. Also, 2 of 2 frequent alcohol users in the intervention group versus 1 of 9 in the control group drank less alcohol in the run-up to surgery. No difference was found in change of smoking cessation. Between-group analysis showed no meaningful differences in functional recovery after correction for baseline values (β=–2.4 [95% CI –5.9 to 1.1]). Conclusions: The Be Prepared app prototype shows potential in terms of usability and changing risk behavior prior to major surgery. No preliminary effect of the app on functional recovery was found. Points of improvement have been identified with which the app and future research can be optimized.
LINK
Background: Functional decline is common in nursing home residents. Nursing staff can help prevent this decline, by encouraging residents to be more active in functional activities. Questionnaires measuring the extent to which nursing staff encourage functional activity among residents are lacking. In addition, there are no measurement instruments to gain insight into nursing staff perceived barriers and facilitators to this behavior. The aim of this study was to develop, and study the usability, of the MAastrIcht Nurses Activities INventory (MAINtAIN), an inventory assessing a) the extent to which nursing staff perceive to perform behaviors that optimize and maintain functional activity among nursing home residents and b) the perceived barriers and facilitators related to this behavior. Methods: Using a mixed-methods approach the MAINtAIN was developed and its usability was studied. Development was based on literature, expert opinions, focus group (N = 3) and individual interviews (N = 14) with residents and staff from nine nursing homes in the Netherlands. Usability was studied in a cross-sectional study with 37 nurses and certified nurse assistants; data were analyzed using descriptive statistics. Results: Development of the MAINtAIN resulted in two distinctive parts: MAINtAIN-behaviors and MAINtAIN-barriers. MAINtAIN-behaviors, targeting nursing staff behavior to optimize and maintain functional activity, includes 19 items covering activities of daily living, household activities, and miscellaneous activities. MAINtAIN-barriers addresses the perceived barriers and facilitators related to this behavior and comprises 33 items covering barriers and facilitators related to the residents, the professionals, the social context, and the organizational and economic context. The usability study showed that the inventory was not difficult to complete, that items and response options were clear,and that the number of missing values was low. Few items showed a floor or ceiling effect. Conclusions: The newly developed inventory MAINtAIN provides a usable method for researchers and nursing homes to obtain insight into nursing staff perceived behavior in optimizing functional activity among residents and their perceived barriers and facilitators related to this behavior. Outcomes of the MAINtAIN may contribute to change in nursing staff behavior and may improve nursing care. Further research with regard to the psychometric properties of the MAINtAIN is recommended.
MULTIFILE
BACKGROUND: For older adults, physical activity is vital for maintaining their health and ability to live independently. Home-based programs can help them achieve the recommended exercise frequency. An application for a tablet computer was developed to support older adults in following a personal training program. It featured goal setting, tailoring, progress tracking, and remote feedback.OBJECTIVE: In line with the Medical Research Council Framework, which prescribes thorough testing before evaluating the efficacy with a randomized controlled trial, the aim of this study was to assess the usability of a tablet-based app that was designed to support older adults in doing exercises at home.METHODS: A total of 15 older adults, age ranging from 69 to 99 years old, participated in a usability study that utilized a mixed-methods approach. In a laboratory setting, novice users were asked to complete a series of tasks while verbalizing their ongoing thoughts. The tasks ranged from looking up information about exercises and executing them to tailoring a weekly exercise schedule. Performance errors and time-on-task were calculated as proxies of effective and efficient usage. Overall satisfaction was assessed with a posttest interview. All responses were analyzed independently by 2 researchers.RESULTS: The participants spent 13-85 seconds time-on-task. Moreover, 79% (11/14)-100% (14/14) participants completed the basic tasks with either no help or after having received 1 hint. For expert tasks, they needed a few more hints. During the posttest interview, the participants made 3 times more positive remarks about the app than negative remarks.CONCLUSIONS: The app that was developed to support older adults in doing exercises at home is usable by the target audience. First-time users were able to perform basic tasks in an effective and efficient manner. In general, they were satisfied with the app. Tasks that were associated with behavior execution and evaluation were performed with ease. Complex tasks such as tailoring a personal training schedule needed more effort. Learning effects, usefulness, and long-term satisfaction will be investigated through longitudinal follow-up studies.
DOCUMENT
Background: In the past years, a mobile health (mHealth) app called the Dutch Talking Touch Screen Questionnaire (DTTSQ) was developed in The Netherlands. The aim of development was to enable Dutch physical therapy patients to autonomously complete a health-related questionnaire regardless of their level of literacy and digital skills. Objective: The aim of this study was to evaluate the usability (defined as the effectiveness, efficiency, and satisfaction) of the prototype of the DTTSQ for Dutch physical therapy patients with diverse levels of experience in using mobile technology. Methods: The qualitative Three-Step Test-Interview method, including both think-aloud and retrospective probing techniques, was used to gain insight into the usability of the DTTSQ. A total of 24 physical therapy patients were included. The interview data were analyzed using a thematic content analysis approach aimed at analyzing the accuracy and completeness with which participants completed the questionnaire (effectiveness), the time it took the participants to complete the questionnaire (efficiency), and the extent to which the participants were satisfied with the ease of use of the questionnaire (satisfaction). The problems encountered by the participants in this study were given a severity rating that was used to provide a rough estimate of the need for additional usability efforts. Results: All participants within this study were very satisfied with the ease of use of the DTTSQ. Overall, 9 participants stated that the usability of the app exceeded their expectations. The group of 4 average-/high-experienced participants encountered only 1 problem in total, whereas the 11 little-experienced participants encountered an average of 2 problems per person and the 9 inexperienced participants an average of 3 problems per person. A total of 13 different kind of problems were found during this study. Of these problems, 4 need to be addressed before the DTTSQ will be released because they have the potential to negatively influence future usage of the tool. The other 9 problems were less likely to influence future usage of the tool substantially. Conclusions: The usability of the DTTSQ needs to be improved before it can be released. No problems were found with satisfaction or efficiency during the usability test. The effectiveness needs to be improved by (1) making it easier to navigate through screens without the possibility of accidentally skipping one, (2) enabling the possibility to insert an answer by tapping on the text underneath a photograph instead of just touching the photograph itself, and (3) making it easier to correct wrong answers. This study shows the importance of including less skilled participants in a usability study when striving for inclusive design and the importance of measuring not just satisfaction but also efficiency and effectiveness during such studies.
LINK
The WHEELS app was developed using the intervention mapping framework. Intervention goals were determined based on a needs assessment, after which behavior change strategies were selected to achieve these goals. These were applied in an app that was pretested on ease of use and satisfaction, followed by minor adjustments. Subsequently, a 12-week pre-post pilot study was performed to explore usability, feasibility, and effectiveness of the app. Participants received either a remote-guided or stand-alone intervention. Responses to semistructured interviews were analyzed using content analysis, and questionnaires (System Usability Score [SUS], and Usefulness, Satisfaction, and Ease) were administered to investigate usability and feasibility. Effectiveness was determined by measuring outcomes on physical activity, nutrition, sleep quality (Pittsburgh Sleep Quality Index), body composition, and other secondary outcomes pre and post intervention, and by calculating effect sizes (Hedges g).
LINK
BACKGROUND: Maintaining a healthy lifestyle is important for wheelchair users' well-being, as it can have a major impact on their daily functioning. Mobile health (mHealth) apps can support a healthy lifestyle; however, these apps are not necessarily suitable for wheelchair users with spinal cord injury or lower limb amputation. Therefore, a new mHealth app (WHEELS) was developed to promote a healthy lifestyle for this population.OBJECTIVE: The objectives of this study were to develop the WHEELS mHealth app, and explore its usability, feasibility, and effectiveness.METHODS: The WHEELS app was developed using the intervention mapping framework. Intervention goals were determined based on a needs assessment, after which behavior change strategies were selected to achieve these goals. These were applied in an app that was pretested on ease of use and satisfaction, followed by minor adjustments. Subsequently, a 12-week pre-post pilot study was performed to explore usability, feasibility, and effectiveness of the app. Participants received either a remote-guided or stand-alone intervention. Responses to semistructured interviews were analyzed using content analysis, and questionnaires (System Usability Score [SUS], and Usefulness, Satisfaction, and Ease) were administered to investigate usability and feasibility. Effectiveness was determined by measuring outcomes on physical activity, nutrition, sleep quality (Pittsburgh Sleep Quality Index), body composition, and other secondary outcomes pre and post intervention, and by calculating effect sizes (Hedges g).RESULTS: Sixteen behavior change strategies were built into an app to change the physical activity, dietary, sleep, and relaxation behaviors of wheelchair users. Of the 21 participants included in the pilot study, 14 participants completed the study. The interviews and questionnaires showed a varied user experience. Participants scored a mean of 58.6 (SD 25.2) on the SUS questionnaire, 5.4 (SD 3.1) on ease of use, 5.2 (SD 3.1) on satisfaction, and 5.9 (3.7) on ease of learning. Positive developments in body composition were found on waist circumference (P=.02, g=0.76), fat mass percentage (P=.004, g=0.97), and fat-free mass percentage (P=.004, g=0.97). Positive trends were found in body mass (P=.09, g=0.49), BMI (P=.07, g=0.53), daily grams of fat consumed (P=.07, g=0.56), and sleep quality score (P=.06, g=0.57).CONCLUSIONS: The WHEELS mHealth app was successfully developed. The interview outcomes and usability scores are reasonable. Although there is room for improvement, the current app showed promising results and seems feasible to deploy on a larger scale.
DOCUMENT
De Digitale Universiteit (DU) performed a quickscan to determine the usability of the IMS Question and Test Interoperability (QTI) specification as a format to store questions and tests developed for and by the consortium. The original report is available in Dutch from the website of De Digitale Universiteit. This is an unofficial translation in English of that report.
DOCUMENT
In this chapter, I look back at the implementation of W12-16, a major reform of mathematics education in the lower grades of general secondary education and pre-vocational secondary education in the Netherlands including all students aged 12–16. The nationwide implementation of W12-16 started in 1990 and envisioned a major change in what and how mathematics was taught and learned. The content was broadened from algebra and geometry to algebra, geometry and measurement, numeracy, and data processing and statistics. The learning trajectories and the instruction theory were based on the ideas of Realistic Mathematics Education (RME): the primary processes used in the classroom were to be guided re-invention and problem solving. ‘Ensuring usability’ in the title of this chapter refers to the aim of the content being useful and understandable for all students, but also to the involvement of all relevant stakeholders in the implementation project, including teachers, students, parents, editors, curriculum and assessment developers, teacher educators, publishers, media and policy makers. Finally, I reflect on the current state of affairs more than 20 years after the nationwide introduction. The main questions to be asked are: Have the goals been reached? Was the implementation successful?
LINK
