During the 2024 Open Science Retreat, the Measuring Open Science team collected, reviewed, and analyzed existing research into open science practices. As a team, we developed an interactive overview of open science surveys, which may be used e.g. to reuse questionnaire items on different open science practices.
MULTIFILE
Challenges that surveys are facing are increasing data collection costs and declining budgets. During the past years, many surveys at Statistics Netherlands were redesigned to reduce costs and to increase or maintain response rates. From 2018 onwards, adaptive survey design has been applied in several social surveys to produce more accurate statistics within the same budget. In previous years, research has been done into the effect on quality and costs of reducing the use of interviewers in mixed-mode surveys starting with internet observation, followed by telephone or face-to-face observation of internet nonrespondents. Reducing follow-ups can be done in different ways. By using stratified selection of people eligible for follow-up, nonresponse bias may be reduced. The main decisions to be made are how to divide the population into strata and how to compute the allocation probabilities for face-to-face and telephone observation in the different strata. Currently, adaptive survey design is an option in redesigns of social surveys at Statistics Netherlands. In 2018 it has been implemented in the Health Survey and the Public Opinion Survey, in 2019 in the Life Style Monitor and the Leisure Omnibus, in 2021 in the Labour Force Survey, and in 2022 it is planned for the Social Coherence Survey. This paper elaborates on the development of the adaptive survey design for the Labour Force Survey. Attention is paid to the survey design, in particular the sampling design, the data collection constraints, the choice of the strata for the adaptive design, the calculation of follow-up fractions by mode of observation and stratum, the practical implementation of the adaptive design, and the six-month parallel design with corresponding response results.
DOCUMENT
This study examines completion rate for a self-assessment survey designed to assess employees' digital skills levels in the workplace. The aim is to improve data quality by investigating completion of the survey. The study reviews the theoretical background related to self-assessment surveys and completion rate, and explores the influence of survey length and format in survey design on completion rate. The research design and data analysis are described in detail, with a focus on identifying factors that may influence completion rate. Results suggest that survey designers should consider using Likert scales to optimize completion rate and completion time. However, this study did not find a significant increase in completion rate as a result of motivation, which was claimed from the literature. The study concludes with implications for the design and implementation of self-assessment surveys in the workplace, including the importance of reducing length and complexity of survey items and questions.
DOCUMENT
A systematic review and meta-analysis of survey research was conducted to estimate honorary authorship prevalence in health sciences. We searched PubMed, Lens.org, and Dimensions.ai. until January 5 2023. Methodological quality was assessed and quantitative syntheses were conducted. Nineteen surveys were included and rated as having low methodological quality. We found a pooled prevalence of 26% [95% CI 21–31] (6 surveys, 2758 respondents) of researchers that perceived co-author(s) as honorary on the publication at issue (when they were not referred to any authorship criteria). That prevalence was 18% [95% CI 15–21] (11 surveys, 4272 respondents) when researchers were referred to Committee of Medical Journal Editors (ICMJE) authorship criteria, and 51% [95% CI 47–56] (15 surveys, 5111 respondents) when researchers were asked to declare their co-author(s) contributions on the publication at issue (and these were then compared to ICMJE criteria). 10% of researchers [95% CI 9–12] (11 surveys, 3,663 respondents) reported being approached by others to include honorary author(s) on the publication at issue and 16% [95% CI 13–18] (2 surveys, 823 respondents) admitted adding (an) honorary author(s). Survey research consistently indicates that honorary authorship in the health sciences is highly prevalent, however the quality of the surveys’ methods and reporting needs improvement.
MULTIFILE
Because of its dependency on air transport, mitigating tourism greenhouse gas (GHG) emissions might become the most important challenge for the sustainability of the sector. Moreover climate change mitigation will be more and more in conflict with other sustainability objectives such as poverty alleviation and biodiversity conservation through tourism. Indeed, tourism increasingly contributes to global GHG emissions. Transport, and in particular air transport, have the largest share in those emissions, with respectively 75 per cent and 40 per cent of the tourism 5 per cent share of global carbon dioxide (CO2) emissions estimated for 2005 (UNWTO et al. 2008). In terms of the actual contribution to climate change, measured in radiative forcing, the share of air transport is between 54 per cent and 83 per cent of tourism, depending on assumptions made on non-CO2 effects of aviation (Scott et al. 2010). Projections show a strong growth, with more than a doubling by 2035 (UNWTO et al. 2008). In a context where climate policies try to maintain global warming within the limit of +2 °C, this current tourism growth is apparently at odds with global emission reduction targets (Bows, Anderson and Peeters, 2007; Gössling et al. 2010).
DOCUMENT
This research report contains the findings of an international study consisting of three online ‘living’ surveys. The surveys focused on how the COVID-19 pandemic has impacted sign language interpreters’ working practices, how this was experienced by them, and how digital disruption caused by the pandemic is impacting and innovating the sign language interpreting profession. The study was carried out between April 2020 and July 2020; the largest contingent of respondents over all three surveys were from the U.S., followed by the UK, the Netherlands, Germany, Finland and Belgium. Respondents commented that the crisis will probably accelerate the need for remote interpreting training in interpreter training programs. Another resurfacing issue was the perceived need for sign language interpreting students to have face-to-face practice and live mentoring. Respondents commented on what benefits they thought remote interpreting might bring to the table, both for themselves and for deaf people. In general, the most significant benefits that were mentioned were flexibility and the possibility to improve efficiency and availability of sign language interpreting services. Notwithstanding these benefits, a significant number of respondents claimed that remote interpreting is more stressful than face-to-face interpreting and requires a heavier cognitive load.
DOCUMENT
Adaptive survey design has attracted great interest in recent years, but the number of case studies describing actual implementation is still thin. Reasons for this may be the gap between survey methodology and data collection, practical complications in differentiating effort across sample units and lack of flexibility of survey case management systems. Currently, adaptive survey design is a standard option in redesigns of person and household surveys at Statistics Netherlands and it has been implemented for the Dutch Health survey in 2018. In this article, the implementation of static adaptive survey designs is described and motivated with a focus on practical feasibility.
DOCUMENT