From the publisher's website: Large groups in society, in particular people with low literacy, lack the necessary proactivity and problem-solving skills to be self-reliant. One omnipresent problem area where these skills are relevant regards filling in forms and questionnaires. These problems could be potentially alleviated by taking advantage of the possibilities of information and communication technology (ICT), for example by offering alternatives to text, interactive self-explaining scales and easily accessible background information on the questionnaires’ rationale. The goal of this paper was to present explorative design guidelines for developing interactive questionnaires for low-literate persons. The guidelines have been derived during a user-centered design process of the Dutch Talking Touch Screen Questionnaire (DTTSQ), an interactive health assessment questionnaire used in physical therapy. The DTTSQ was developed to support patients with low health literacy, meaning they have problems with seeking, understanding and using health information. A decent number of guidelines have been derived and presented according to an existing, comprehensive model. Also, lessons learned were derived from including low-literate persons in the user-centered design process. The guidelines should be made available to ICT developers and, when applied properly, will contribute to the advancement of (health) literacy and empower citizens to fully participate in society
LINK
Background: Low-educated patients are disadvantaged in using questionnaires within the health care setting because most health-related questionnaires do not take the educational background of patients into account. The Dutch Talking Touch Screen Questionnaire (DTTSQ) was developed in an attempt to meet the needs of low-educated patients by using plain language and adding communication technology to an existing paper-based questionnaire. For physical therapists to use the DTTSQ as part of their intake procedure, it needs to generate accurate information from all of their patients, independent of educational level. Objective: The aim of this study was to get a first impression of the information that is generated by the DTTSQ. To achieve this goal, response processes of physical therapy patients with diverse levels of education were analyzed. Methods: The qualitative Three-Step Test-Interview method was used to collect observational data on actual response behavior of 24 physical therapy patients with diverse levels of education. The interviews included both think-aloud and retrospective probing techniques. Results: Of the 24 respondents, 20 encountered one or more problems during their response process. The use of plain language and information and communication technology (ICT) appeared to have a positive effect on the comprehensibility of the DTTSQ. However, it also had some negative effects on the interpretation, retrieval, judgment, and response selection within the response processes of the participants in this study. No educational group in this research population stood out from the rest in the kind or number of problems that arose. All respondents recognized themselves in the outcomes of the questionnaire. Conclusions: The use of plain language and ICT within the DTTSQ had both positive and negative effects on the response processes of its target population. The results of this study emphasize the importance of earlier recommendations to accompany any adaption of any questionnaire to a new mode of delivery by demonstrating the difference and equivalence between the two different modes and to scientifically evaluate the applicability of the newly developed mode of the questionnaire in its intended setting. This is especially important in a digital era in which the use of plain language within health care is increasingly being advocated.
LINK
Challenges that surveys are facing are increasing data collection costs and declining budgets. During the past years, many surveys at Statistics Netherlands were redesigned to reduce costs and to increase or maintain response rates. From 2018 onwards, adaptive survey design has been applied in several social surveys to produce more accurate statistics within the same budget. In previous years, research has been done into the effect on quality and costs of reducing the use of interviewers in mixed-mode surveys starting with internet observation, followed by telephone or face-to-face observation of internet nonrespondents. Reducing follow-ups can be done in different ways. By using stratified selection of people eligible for follow-up, nonresponse bias may be reduced. The main decisions to be made are how to divide the population into strata and how to compute the allocation probabilities for face-to-face and telephone observation in the different strata. Currently, adaptive survey design is an option in redesigns of social surveys at Statistics Netherlands. In 2018 it has been implemented in the Health Survey and the Public Opinion Survey, in 2019 in the Life Style Monitor and the Leisure Omnibus, in 2021 in the Labour Force Survey, and in 2022 it is planned for the Social Coherence Survey. This paper elaborates on the development of the adaptive survey design for the Labour Force Survey. Attention is paid to the survey design, in particular the sampling design, the data collection constraints, the choice of the strata for the adaptive design, the calculation of follow-up fractions by mode of observation and stratum, the practical implementation of the adaptive design, and the six-month parallel design with corresponding response results.
DOCUMENT
An on-going investigation in the learning effects of IPD projects. In three subsequent semesters the students were asked how they rated their competencies at the start of the project as well as at the end of it. Also questionnaires were filled out and students were interviewed. A lot of students tended to give themselves lower ratings in the end than in the begin. It appeared that if they met any difficulties in for instance communication or co-operation during the project, that they interpreted this as a decrease in competencies. Finally the students were explicitly asked to mention an eventual increase in competencies and also a possible contribution for this effect. Only a few factors that actually contribute to the learning effects have been defined.
DOCUMENT
During the 2024 Open Science Retreat, the Measuring Open Science team collected, reviewed, and analyzed existing research into open science practices. As a team, we developed an interactive overview of open science surveys, which may be used e.g. to reuse questionnaire items on different open science practices.
MULTIFILE
BACKGROUND: Mobility is a key determinant and outcome of healthy ageing but its definition, conceptual framework and underlying constructs within the physical domain may need clarification for data comparison and sharing in ageing research. This study aimed to (1) review definitions and conceptual frameworks of mobility, (2) explore agreement on the definition of mobility, conceptual frameworks, constructs and measures of mobility, and (3) define, classify and identify constructs.METHODS: A three-step approach was adopted: a literature review and two rounds of expert questionnaires (n = 64, n = 31, respectively). Agreement on statements was assessed using a five-point Likert scale; the answer options 'strongly agree' or 'agree' were combined. The percentage of respondents was subsequently used to classify agreements for each statement as: strong (≥ 80%), moderate (≥ 70% and < 80%) and low (< 70%).RESULTS: A variety of definitions of mobility, conceptual frameworks and constructs were found in the literature and among respondents. Strong agreement was found on defining mobility as the ability to move, including the use of assistive devices. Multiple constructs and measures were identified, but low agreements and variability were found on definitions, classifications and identification of constructs. Strong agreements were found on defining physical capacity (what a person is maximally capable of, 'can do') and performance (what a person actually does in their daily life, 'do') as key constructs of mobility.CONCLUSION: Agreements on definitions of mobility, physical capacity and performance were found, but constructs of mobility need to be further identified, defined and classified appropriately. Clear terminology and definitions are essential to facilitate communication and interpretation in operationalising the physical domain of mobility as a prerequisite for standardisation of mobility measures.
DOCUMENT
This study examines completion rate for a self-assessment survey designed to assess employees' digital skills levels in the workplace. The aim is to improve data quality by investigating completion of the survey. The study reviews the theoretical background related to self-assessment surveys and completion rate, and explores the influence of survey length and format in survey design on completion rate. The research design and data analysis are described in detail, with a focus on identifying factors that may influence completion rate. Results suggest that survey designers should consider using Likert scales to optimize completion rate and completion time. However, this study did not find a significant increase in completion rate as a result of motivation, which was claimed from the literature. The study concludes with implications for the design and implementation of self-assessment surveys in the workplace, including the importance of reducing length and complexity of survey items and questions.
DOCUMENT
Abstract Introduction: In 2017, the role of coordinating practitioner was introduced in the Netherlands in order to improve quality of care for patients who receive treatment in specialized mental health care. Psychiatric-mental health nurse practitioners (PMHNPs) can fulfil this role. Aim/Question: The aim was to obtain insight into how PMHNPs fulfil the coordinating practitioner role and what is needed to improve fulfilment of this role. Method: A survey among PMHNPs in the Netherlands was conducted between July-September 2018. In total, 381 PMHNP filled out the questionnaire; the response rate was 47.6%. Descriptive analyses were performed using SPSS 22® (IBM). Results: 92% Of the PMHNPs fulfilled the coordinating practitioner role and were generally satisfied with their role performance. The following conditions were formulated to improve this role: 1) recognition and trust in the expertise of PMHNPs, 2) a clear description of their role as coordinating practitioner, 3) strengthening multidisciplinary collaboration, and 4) sufficient training budget and opportunities. Discussion: In Dutch mental health care, PMHNPs have strengthened their position as coordinating practitioner in a short period of time. Follow-up research should be conducted to obtain further insights into elements that contribute to an optimal role as coordinating practitioner. Implications for Practice: Having PMHNPs act as coordinating practitioners can contribute to solving the challenges in mental health care regarding coordination of care and effective multidisciplinary collaboration.
DOCUMENT
Background: The Turkish translation of the Dutch Talking Touch Screen Questionnaire (TTSQ) has been developed to help physical therapy patients with a Turkish background in the Netherlands to autonomously elucidate their health problems and impairments and set treatment goals, regardless of their level of health literacy. Objective: The aim of this study was to evaluate the usability of the Turkish TTSQ for physical therapy patients with a Turkish background with diverse levels of health literacy and experience in using mobile technology. Methods: The qualitative Three-Step Test-Interview method was carried out to gain insight into the usability of the Turkish TTSQ. A total of 10 physical therapy patients participated. The interview data were analyzed using a thematic content analysis approach aimed at determining the accuracy and completeness with which participants completed the questionnaire (effectiveness), the time it took participants to complete the questionnaire (efficiency), and the extent to which the participants were satisfied with the ease of use of the questionnaire (satisfaction). The problems encountered by the participants in this study were given a severity rating, which was used to provide a rough estimate of the need for additional usability improvements. Results: No participant in this study was able to complete the questionnaire without encountering at least one usability problem. A total of 17 different kinds of problems were found. On the basis of their severity score, 3 problems that should be addressed during future development of the tool were “Not using the navigation function of the photo gallery in Question 4 causing the participant to not see all presented response items;” “Touching the text underneath a photo in Question 4 to select an activity instead of touching the photo itself, causing the activity not to be selected;” and “Pushing too hard or tapping too softly on the touch screen causing the touch screen to not respond.” The data on efficiency within this study were not valid and are, therefore, not reported in this study. No participant was completely satisfied or dissatisfied with the overall ease of use of the Turkish TTSQ. Two participants with no prior experience of using tablet computers felt that, regardless of what kinds of improvement might be made, it would just be too difficult for them to learn to work with the device. Conclusions: As with the Dutch TTSQ, the Turkish TTSQ needs improvement before it can be released. The results of this study confirm the conclusion of the Dutch TTSQ study that participants with low levels of education and little experience in using mobile technology are less able to operate the TTSQ effectively. Using a Dutch speaking interviewer and Turkish interpreter has had a negative effect on data collection in this study.
LINK
Calls have been made for improving transparency in conducting and reporting research, improving work climates, and preventing detrimental research practices. To assess attitudes and practices regarding these topics, we sent a survey to authors, reviewers, and editors. We received 3,659 (4.9%) responses out of 74,749 delivered emails. We found no significant differences between authors’, reviewers’, and editors’ attitudes towards transparency in conducting and reporting research, or towards their perceptions of work climates. Undeserved authorship was perceived by all groups as the most prevalent detrimental research practice, while fabrication, falsification, plagiarism, and not citing prior relevant research, were seen as more prevalent by editors than authors or reviewers. Overall, 20% of respondents admitted sacrificing the quality of their publications for quantity, and 14% reported that funders interfered in their study design or reporting. While survey respondents came from 126 different countries, due to the survey’s overall low response rate our results might not necessarily be generalizable. Nevertheless, results indicate that greater involvement of all stakeholders is needed to align actual practices with current recommendations.
MULTIFILE
