Challenges that surveys are facing are increasing data collection costs and declining budgets. During the past years, many surveys at Statistics Netherlands were redesigned to reduce costs and to increase or maintain response rates. From 2018 onwards, adaptive survey design has been applied in several social surveys to produce more accurate statistics within the same budget. In previous years, research has been done into the effect on quality and costs of reducing the use of interviewers in mixed-mode surveys starting with internet observation, followed by telephone or face-to-face observation of internet nonrespondents. Reducing follow-ups can be done in different ways. By using stratified selection of people eligible for follow-up, nonresponse bias may be reduced. The main decisions to be made are how to divide the population into strata and how to compute the allocation probabilities for face-to-face and telephone observation in the different strata. Currently, adaptive survey design is an option in redesigns of social surveys at Statistics Netherlands. In 2018 it has been implemented in the Health Survey and the Public Opinion Survey, in 2019 in the Life Style Monitor and the Leisure Omnibus, in 2021 in the Labour Force Survey, and in 2022 it is planned for the Social Coherence Survey. This paper elaborates on the development of the adaptive survey design for the Labour Force Survey. Attention is paid to the survey design, in particular the sampling design, the data collection constraints, the choice of the strata for the adaptive design, the calculation of follow-up fractions by mode of observation and stratum, the practical implementation of the adaptive design, and the six-month parallel design with corresponding response results.
DOCUMENT
This study examines completion rate for a self-assessment survey designed to assess employees' digital skills levels in the workplace. The aim is to improve data quality by investigating completion of the survey. The study reviews the theoretical background related to self-assessment surveys and completion rate, and explores the influence of survey length and format in survey design on completion rate. The research design and data analysis are described in detail, with a focus on identifying factors that may influence completion rate. Results suggest that survey designers should consider using Likert scales to optimize completion rate and completion time. However, this study did not find a significant increase in completion rate as a result of motivation, which was claimed from the literature. The study concludes with implications for the design and implementation of self-assessment surveys in the workplace, including the importance of reducing length and complexity of survey items and questions.
DOCUMENT
Abstract Introduction: In 2017, the role of coordinating practitioner was introduced in the Netherlands in order to improve quality of care for patients who receive treatment in specialized mental health care. Psychiatric-mental health nurse practitioners (PMHNPs) can fulfil this role. Aim/Question: The aim was to obtain insight into how PMHNPs fulfil the coordinating practitioner role and what is needed to improve fulfilment of this role. Method: A survey among PMHNPs in the Netherlands was conducted between July-September 2018. In total, 381 PMHNP filled out the questionnaire; the response rate was 47.6%. Descriptive analyses were performed using SPSS 22® (IBM). Results: 92% Of the PMHNPs fulfilled the coordinating practitioner role and were generally satisfied with their role performance. The following conditions were formulated to improve this role: 1) recognition and trust in the expertise of PMHNPs, 2) a clear description of their role as coordinating practitioner, 3) strengthening multidisciplinary collaboration, and 4) sufficient training budget and opportunities. Discussion: In Dutch mental health care, PMHNPs have strengthened their position as coordinating practitioner in a short period of time. Follow-up research should be conducted to obtain further insights into elements that contribute to an optimal role as coordinating practitioner. Implications for Practice: Having PMHNPs act as coordinating practitioners can contribute to solving the challenges in mental health care regarding coordination of care and effective multidisciplinary collaboration.
DOCUMENT
BACKGROUND: The number of mobile apps that support smoking cessation is growing, indicating the potential of the mobile phone as a means to support cessation. Knowledge about the potential end users for cessation apps results in suggestions to target potential user groups in a dissemination strategy, leading to a possible increase in the satisfaction and adherence of cessation apps.OBJECTIVE: This study aimed to characterize potential end users for a specific mobile health (mHealth) smoking cessation app.METHODS: A quantitative study was conducted among 955 Dutch smokers and ex-smokers. The respondents were primarily recruited from addiction care facilities and hospitals through Web-based media via websites and forums. The respondents were surveyed on their demographics, smoking behavior, and personal innovativeness. The intention to use and the attitude toward a cessation app were determined on a 5-point Likert scale. To study the association between the characteristics and intention to use and attitude, univariate and multivariate ordinal logistic regression analyses were performed.RESULTS: The multivariate ordinal logistic regression showed that the number of previous quit attempts (odds ratio [OR] 4.1, 95% CI 2.4-7.0, and OR 3.5, 95% CI 2.0-5.9) and the score on the Fagerstrom Test of Nicotine Dependence (OR 0.8, 95% CI 0.8-0.9, and OR 0.8, 95% CI 0.8-0.9) positively correlates with the intention to use a cessation app and the attitude toward cessation apps, respectively. Personal innovativeness also positively correlates with the intention to use (OR 0.3, 95% CI 0.2-0.4) and the attitude towards (OR 0.2, 95% CI 0.1-0.4) a cessation app. No associations between demographics and the intention to use or the attitude toward using a cessation app were observed.CONCLUSIONS: This study is among the first to show that demographic characteristics such as age and level of education are not associated with the intention to use and the attitude toward using a cessation app when characteristics related specifically to the app, such as nicotine dependency and the number of quit attempts, are present in a multivariate regression model. This study shows that the use of mHealth apps depends on characteristics related to the content of the app rather than general user characteristics.
DOCUMENT
Background: The Turkish translation of the Dutch Talking Touch Screen Questionnaire (TTSQ) has been developed to help physical therapy patients with a Turkish background in the Netherlands to autonomously elucidate their health problems and impairments and set treatment goals, regardless of their level of health literacy. Objective: The aim of this study was to evaluate the usability of the Turkish TTSQ for physical therapy patients with a Turkish background with diverse levels of health literacy and experience in using mobile technology. Methods: The qualitative Three-Step Test-Interview method was carried out to gain insight into the usability of the Turkish TTSQ. A total of 10 physical therapy patients participated. The interview data were analyzed using a thematic content analysis approach aimed at determining the accuracy and completeness with which participants completed the questionnaire (effectiveness), the time it took participants to complete the questionnaire (efficiency), and the extent to which the participants were satisfied with the ease of use of the questionnaire (satisfaction). The problems encountered by the participants in this study were given a severity rating, which was used to provide a rough estimate of the need for additional usability improvements. Results: No participant in this study was able to complete the questionnaire without encountering at least one usability problem. A total of 17 different kinds of problems were found. On the basis of their severity score, 3 problems that should be addressed during future development of the tool were “Not using the navigation function of the photo gallery in Question 4 causing the participant to not see all presented response items;” “Touching the text underneath a photo in Question 4 to select an activity instead of touching the photo itself, causing the activity not to be selected;” and “Pushing too hard or tapping too softly on the touch screen causing the touch screen to not respond.” The data on efficiency within this study were not valid and are, therefore, not reported in this study. No participant was completely satisfied or dissatisfied with the overall ease of use of the Turkish TTSQ. Two participants with no prior experience of using tablet computers felt that, regardless of what kinds of improvement might be made, it would just be too difficult for them to learn to work with the device. Conclusions: As with the Dutch TTSQ, the Turkish TTSQ needs improvement before it can be released. The results of this study confirm the conclusion of the Dutch TTSQ study that participants with low levels of education and little experience in using mobile technology are less able to operate the TTSQ effectively. Using a Dutch speaking interviewer and Turkish interpreter has had a negative effect on data collection in this study.
LINK
Background: In the past years, a mobile health (mHealth) app called the Dutch Talking Touch Screen Questionnaire (DTTSQ) was developed in The Netherlands. The aim of development was to enable Dutch physical therapy patients to autonomously complete a health-related questionnaire regardless of their level of literacy and digital skills. Objective: The aim of this study was to evaluate the usability (defined as the effectiveness, efficiency, and satisfaction) of the prototype of the DTTSQ for Dutch physical therapy patients with diverse levels of experience in using mobile technology. Methods: The qualitative Three-Step Test-Interview method, including both think-aloud and retrospective probing techniques, was used to gain insight into the usability of the DTTSQ. A total of 24 physical therapy patients were included. The interview data were analyzed using a thematic content analysis approach aimed at analyzing the accuracy and completeness with which participants completed the questionnaire (effectiveness), the time it took the participants to complete the questionnaire (efficiency), and the extent to which the participants were satisfied with the ease of use of the questionnaire (satisfaction). The problems encountered by the participants in this study were given a severity rating that was used to provide a rough estimate of the need for additional usability efforts. Results: All participants within this study were very satisfied with the ease of use of the DTTSQ. Overall, 9 participants stated that the usability of the app exceeded their expectations. The group of 4 average-/high-experienced participants encountered only 1 problem in total, whereas the 11 little-experienced participants encountered an average of 2 problems per person and the 9 inexperienced participants an average of 3 problems per person. A total of 13 different kind of problems were found during this study. Of these problems, 4 need to be addressed before the DTTSQ will be released because they have the potential to negatively influence future usage of the tool. The other 9 problems were less likely to influence future usage of the tool substantially. Conclusions: The usability of the DTTSQ needs to be improved before it can be released. No problems were found with satisfaction or efficiency during the usability test. The effectiveness needs to be improved by (1) making it easier to navigate through screens without the possibility of accidentally skipping one, (2) enabling the possibility to insert an answer by tapping on the text underneath a photograph instead of just touching the photograph itself, and (3) making it easier to correct wrong answers. This study shows the importance of including less skilled participants in a usability study when striving for inclusive design and the importance of measuring not just satisfaction but also efficiency and effectiveness during such studies.
LINK
Background: Implementation of an eRehabilitation intervention named Fit After Stroke @Home (Fast@home) – including cognitive/physical exercise applications, activity-tracking, psycho-education – after stroke resulted in health-related improvements. This study investigated what worked and why in the implementation. Methods: Implementation activities (information provision, integration of Fast@home, instruction and motivation) were performed for 14 months and evaluated, using the Medical Research Council framework for process evaluations which consists of three evaluation domains (implementation, mechanisms of impact and contextual factors). Implementation activities were evaluated by field notes/surveys/user data, it’s mechanisms of impact by surveys and contextual factors by field notes/interviews among 11 professionals. Surveys were conducted among 51 professionals and 73 patients. User data (n=165 patients) were extracted from the eRehabilitation applications. Results: Implementation activities were executed as planned. Of the professionals trained to deliver the intervention (33 of 51), 25 (75.8%) delivered it. Of the 165 patients, 82 (49.7%) were registered for Fast@home, with 54 patient (65.8%) using it. Mechanisms of impact showed that professionals and patients were equally satisfied with implementation activities (median score 7.0 [IQR 6.0–7.75] versus 7.0 [6.0–7.5]), but patients were more satisfied with the intervention (8.0 [IQR 7.0–8.0] versus 5.5 [4.0–7.0]). Guidance by professionals was seen as most impactful for implementation by patients and support of clinical champions and time given for training by professionals. Professionals rated the integration of Fast@home as insufficient. Contextual factors (financial cutbacks and technical setbacks) hampered the implementation. Conclusion: Main improvements of the implementation of eRehabilitation are related to professionals’ perceptions of the intervention, integration of eRehabilitation and contextual factors.
DOCUMENT
Background: Patient decision aids (PDAs) can support the treatment decision making process and empower patients to take a proactive role in their treatment pathway while using a shared decision-making (SDM) approach making participatory medicine possible. The aim of this study was to develop a PDA for prostate cancer that is accurate and user-friendly. Methods: We followed a user-centered design process consisting of five rounds of semi-structured interviews and usability surveys with topics such as informational/decisional needs of users and requirements for PDAs. Our userbase consisted of 8 urologists, 4 radiation oncologists, 2 oncology nurses, 8 general practitioners, 19 former prostate cancer patients, 4 usability experts and 11 healthy volunteers. Results: Informational needs for patients centered on three key factors: treatment experience, post-treatment quality of life, and the impact of side effects. Patients and clinicians valued a PDA that presents balanced information on these factors through simple understandable language and visual aids. Usability questionnaires revealed that patients were more satisfied overall with the PDA than clinicians; however, both groups had concerns that the PDA might lengthen consultation times (42 and 41%, respectively). The PDA is accessible on http://beslissamen.nl/. Conclusions: User-centered design provided valuable insights into PDA requirements but challenges in integrating diverse perspectives as clinicians focus on clinical outcomes while patients also consider quality of life. Nevertheless, it is crucial to involve a broad base of clinical users in order to better understand the decision-making process and to develop a PDA that is accurate, usable, and acceptable.
DOCUMENT
Background: Low-educated patients are disadvantaged in using questionnaires within the health care setting because most health-related questionnaires do not take the educational background of patients into account. The Dutch Talking Touch Screen Questionnaire (DTTSQ) was developed in an attempt to meet the needs of low-educated patients by using plain language and adding communication technology to an existing paper-based questionnaire. For physical therapists to use the DTTSQ as part of their intake procedure, it needs to generate accurate information from all of their patients, independent of educational level. Objective: The aim of this study was to get a first impression of the information that is generated by the DTTSQ. To achieve this goal, response processes of physical therapy patients with diverse levels of education were analyzed. Methods: The qualitative Three-Step Test-Interview method was used to collect observational data on actual response behavior of 24 physical therapy patients with diverse levels of education. The interviews included both think-aloud and retrospective probing techniques. Results: Of the 24 respondents, 20 encountered one or more problems during their response process. The use of plain language and information and communication technology (ICT) appeared to have a positive effect on the comprehensibility of the DTTSQ. However, it also had some negative effects on the interpretation, retrieval, judgment, and response selection within the response processes of the participants in this study. No educational group in this research population stood out from the rest in the kind or number of problems that arose. All respondents recognized themselves in the outcomes of the questionnaire. Conclusions: The use of plain language and ICT within the DTTSQ had both positive and negative effects on the response processes of its target population. The results of this study emphasize the importance of earlier recommendations to accompany any adaption of any questionnaire to a new mode of delivery by demonstrating the difference and equivalence between the two different modes and to scientifically evaluate the applicability of the newly developed mode of the questionnaire in its intended setting. This is especially important in a digital era in which the use of plain language within health care is increasingly being advocated.
LINK
Background: The importance of medical education research in Saudi Arabia has been acknowledged increasingly and a lot of concepts used have been derived from the Western world. The question arises, however, whether Western concepts and questionnaires are transferable to societies with different cultures. The aim of this study was to investigate the instrument structure and the reliability of the Arabic version of the Zuckerman–Kuhlman Personality Questionnaire-medium (ZKPQ-m).Methods: Three statistical methods with decreased amount of strictness were used to analyse our data: Confirmatory Factor Analysis, Procrustes rotation and Principal Component Analysis.Results: Our outcomes did not confirm the original instrument structure. Instead, we found four interpretable components: Emotional Instability, Impulse-seeking, Activeness and Self-Control. However, the amount of explained variance was not very high and the internal consistencies ranged from unsatisfactory to only moderate. The data showed a high percentage of respondents agreeing with more than three items of the Infrequency scale, which may be attributable to the collectivistic culture in Saudi Arabia.Conclusion: We did not succeed in replicating the ZKPQ structure in the Arabic context. Social desirability, a common characteristic in collectivistic cultures, may have reduced the replicability of the internal structure of the ZKPQ-m. Different methods to measure concepts in collectivistic cultures may help to get round social desirability.
DOCUMENT
