This technical report describes "validation of the 'Target system definition"
DOCUMENT
This report describes the validation of a "framework that delivers insight into the tangible and intangible effects of a mobile (IT) system, before it is being implemented".
DOCUMENT
Due to a lack of transparency in both algorithm and validation methodology, it is diffcult for researchers and clinicians to select the appropriate tracker for their application. The aim of this work is to transparently present an adjustable physical activity classification algorithm that discriminates between dynamic, standing, and sedentary behavior. By means of easily adjustable parameters, the algorithm performance can be optimized for applications using different target populations and locations for tracker wear. Concerning an elderly target population with a tracker worn on the upper leg, the algorithm is optimized and validated under simulated free-living conditions. The fixed activity protocol (FAP) is performed by 20 participants; the simulated free-living protocol (SFP) involves another 20. Data segmentation window size and amount of physical activity threshold are optimized. The sensor orientation threshold does not vary. The validation of the algorithm is performed on 10 participants who perform the FAP and on 10 participants who perform the SFP. Percentage error (PE) and absolute percentage error (APE) are used to assess the algorithm performance. Standing and sedentary behavior are classified within acceptable limits (+/- 10% error) both under fixed and simulated free-living conditions. Dynamic behavior is within acceptable limits under fixed conditions but has some limitations under simulated free-living conditions. We propose that this approach should be adopted by developers of activity trackers to facilitate the activity tracker selection process for researchers and clinicians. Furthermore, we are convinced that the adjustable algorithm potentially could contribute to the fast realization of new applications.
DOCUMENT
This article describes the results of a study into the psychometric properties of a questionnaire about student nurses' perceptions of mental health care. The questionnaire was constructed in 2008, but has not yet been tested in terms of construct validity and reliability. A validated questionnaire is essential as a standardized method of analyzing student nurses' perceptions of mental health care.
LINK
Abstract: Clinicians find it challenging to engage with patients who engage in self-harm. Improving the self-efficacy of professionals who treat self-harm patients may be an important step toward accomplishing better treatment of self-harm. However, there is no instrument available that assesses the self-efficacy of clinicians dealing with self-harm. The aim of this study is to describe the development and validation of the Self-Efficacy in Dealing with Self-Harm Questionnaire (SEDSHQ). This study tests the questionnaire’s feasibility, test-retest reliability, internal consistency, content validity, construct validity (factor analysis and convergent validity) and sensitivity to change. The Self-Efficacy in Dealing with Self-Harm Questionnaire is a 27-item instrument which has a 3-factor structure, as found in confirmatory factor analysis. Testing revealed high content validity, significant correlation with a subscale of the Attitude Towards Deliberate Self-Harm Questionnaire (ADSHQ), satisfactory test-retest correlation and a Cronbach’s alpha of 0.95. Additionally, the questionnaire was able to measure significant changes after an intervention took place, indicating sensitivity to change. We conclude that the present study indicates that the Self-Efficacy in Dealing with Self-Harm Questionnaire is a valid and reliable instrument for assessing the level of self-efficacy in response to self-harm.
DOCUMENT
The aim of this study was to develop a valid instrument to measure student nurses’ perceptions of community care (SCOPE). DeVellis’ staged model for instrument development and validation was used. Scale construction of SCOPE was based on existing literature. Evaluation of its psychometric properties included exploratory factor analysis and reliability analysis. After pilot-testing, 1062 bachelor nursing students from six institutions in the Netherlands (response rate 81%) took part in the study. SCOPE is a 35-item scale containing: background variables, 11 measuring the affective component, 5 measuring community care perception as a placement, 17 as a future profession, and 2 on the reasons underlying student preference. Principal axis factoring yielded two factors in the affective component scale reflecting ‘enjoyment’ and ‘utility’, two in the placement scale reflecting ‘learning possibilities’ and ‘personal satisfaction’, and four in the profession scale: ‘professional development’, ‘collaboration’, ‘caregiving’, and ‘complexity and workload’. Cronbach’s α of the complete scale was .892 and of the subscales .862, .696, and .810 respectively. SCOPE is a psychometrically sound instrument for measuring students’ perceptions of community care. By determining these perceptions, it becomes possible to positively influence them with targeted curriculum redesign, eventually contributing to decreasing the workforce shortage in community nursing.
DOCUMENT
Purpose: The purpose of this study was to validate optimized algorithm parameter settings for step count and physical behavior for a pocket worn activity tracker in older adults during ADL. Secondly, for a more relevant interpretation of the results, the performance of the optimized algorithm was compared to three reference applications Methods: In a cross-sectional validation study, 20 older adults performed an activity protocol based on ADL with MOXMissActivity versus MOXAnnegarn, activPAL, and Fitbit. The protocol was video recorded and analyzed for step count and dynamic, standing, and sedentary time. Validity was assessed by percentage error (PE), absolute percentage error (APE), Bland-Altman plots and correlation coefficients. Results: For step count, the optimized algorithm had a mean APE of 9.3% and a correlation coefficient of 0.88. The mean APE values of dynamic, standing, and sedentary time were 15.9%, 19.9%, and 9.6%, respectively. The correlation coefficients were 0.55, 0.91, and 0.92, respectively. Three reference applications showed higher errors and lower correlations for all outcome variables. Conclusion: This study showed that the optimized algorithm parameter settings can more validly estimate step count and physical behavior in older adults wearing an activity tracker in the trouser pocket during ADL compared to reference applications.
DOCUMENT
The aim of this study is to contribute to the body of knowledge on the use of contextual mathematical problems. Word problems are a predominant genre in mathematics classrooms in assessing students’ ability to solve problems from everyday life. Research on word problems, however, reveals a range of difficulties in their use in mathematics education. In our research we took an alternative approach: we designed image-rich numeracy problems as alternatives for word problems. A set of word problems was modified by systematically replacing the descriptive representation of the problem situation by a more depictive representation and an instrument was designed to measure the effect of this modification on students’ performance. The instrument can measure the effect of this alternative approach in a randomized controlled trial. In order to use the instrument at scale, we made this instrument also usable as a diagnostic test for an upcoming nationwide examination on numeracy. In this article we explain and discuss the design of the instrument and the validation of its intended uses.
DOCUMENT
The aim of this study was to assess the criterion validity of a new screening instrument, the Early Language Scale (ELS), for the identification of young children at risk for developmental language disorder (DLD), and to determine optimal age-adjusted cut-off scores. We recruited a community-based sample of 265 children aged 1 to 6 years of age. Parents of these children responded on the ELS, a 26-item "yes-no" questionnaire. The children were assessed with extended language tests (language comprehension, word production, sentence production, communication). A composite score out of these tests (two tests below - 1 SD or one below - 1.5 SD) was used as reference standard. We assessed the validity of the ELS, measured by sensitivity, specificity, predictive values, and AUC. The optimal sensitivity/specificity age-dependent cut-off ELS score was at 15th percentile. Sensitivity and specificity were 0.62 and 0.93, respectively. Positive predictive value was moderate (0.53), negative predictive value was high (0.95), the positive likelihood ratio was 9.16, and negative likelihood ratio was 0.41. The area under the ROC curve was 0.88. The items covered the increasing language development for the ages from 1 to 6.Conclusion: The ELS is a valid instrument to identify children with DLD covering an age range of 1 to 6 years in community-based settings.What is Known:• Early identification and treatment of developmental language disorders can reduce negative effects on children's emotional functioning, academic success, and social relationships.• Short, validated language screening instruments that cover the full age range of early childhood language development lack.What is New:• The 26-item Early Language Scale (ELS) is a valid instrument to identify children at risk for developmental language disorder in well-child care and early educational settings among Dutch children aged 1-6 years.
DOCUMENT
The aim of this study was to assess the predictive ability of the frailty phenotype (FP), Groningen Frailty Indicator (GFI), Tilburg Frailty Indicator (TFI) and frailty index (FI) for the outcomes mortality, hospitalization and increase in dependency in (instrumental) activities of daily living ((I)ADL) among older persons. This prospective cohort study with 2-year follow-up included 2420 Dutch community-dwelling older people (65+, mean age 76.3±6.6 years, 39.5% male) who were pre-frail or frail according to the FP. Mortality data were obtained from Statistics Netherlands. All other data were self-reported. Area under the receiver operating characteristic curves (AUC) was calculated for each frailty instrument and outcome measure. The prevalence of frailty, sensitivity and specifcity were calculated using cutoff values proposed by the developers and cutoff values one above and one below the proposed ones (0.05 for FI). All frailty instruments poorly predicted mortality, hospitalization and (I)ADL dependency (AUCs between 0.62–0.65, 0.59–0.63 and 0.60–0.64, respectively). Prevalence estimates of frailty in this population varied between 22.2% (FP) and 64.8% (TFI). The FP and FI showed higher levels of specifcity, whereas sensitivity was higher for the GFI and TFI. Using a different cutoff point considerably changed the prevalence, sensitivity and specifcity. In conclusion, the predictive ability of the FP, GFI, TFI and FI was poor for all outcomes in a population of pre-frail and frail community-dwelling older people. The FP and the FI showed higher values of specifcity, whereas sensitivity was higher for the GFI and TFI.
DOCUMENT
