This study evaluates psychometric properties of the Individual Recovery Outcomes Counter (I.ROC) in a Dutch population of participants with a schizophrenia spectrum disorder (SSD). B. Esther Sportel1*† , Hettie Aardema1†, Nynke Boonstra2 , Johannes Arends1 , Bridey Rudd3 , Margot J. Metz4 , Stynke Castelein5 and Gerdina H.M. Pijnenborg6
MULTIFILE
Purpose: This study aims to systematically identify items that measure commu-nicative participation from measurement instruments that measure (aspects of) communication and/or participation in children and adolescents (5–18 years old) with communication disorders, for developing an item bank. Method: A systematic literature search was performed in MEDLINE and Embase to search for patient-reported outcome measures (PROMs) or parent reports measuring aspects of communication and/or participation in children and adolescents. The individual items of the included measurement instruments were reviewed on whether they measure communicative participation. The items were then classified into one of the International Classification of Functioning, Disability and Health (ICF) for Children and Youth (World Health Organization, 2007) domains of activities and participation. Results: A total of 29 instruments were found, nine PROMs and 20 parent reports. One hundred forty-five items were identified that measure communica-tive participation. From these 145 items, 74 were retrieved from PROMs (51%), and 71 were retrieved from parent reports (49%). The majority of items were classified in ICF Domain 7, interpersonal interactions and relationships (73.8%), followed by Domain 8, major life areas (13.8%), and Domain 9, community, social, and civic life (8.3%). Only a few items were found in Domains 5 and 6, and none was found in Domains 1, 2, and 4. Conclusions: We identified 145 items potentially useful for developing an item bank addressing communicative participation in children and adolescents with communication disorders. However, item development in collaboration with the target population is needed to ensure that these items fully reflect the construct.
LINK
The use of measurement instruments has become a major issue in physical therapy, but their use in daily practice is infrequent. The aims of this case report were to develop and evaluate a plan for the systematic implementation of two measurement instruments frequently recommended in Dutch physical therapy clinical guidelines: the Patient-Specific Complaints instrument and the Six-Minute Walk Test.
DOCUMENT
A list of measurement instruments used in Urban Vitality research projects regarding frailty and ageing. The list is based on the research protocols of the 14 projects that were examined.Per instrument a link to https://meetinstrumentenzorg.nl/instrumenten/ is provided (if available).
MULTIFILE
Background: Observing and analyzing movement quality (MQ) in patients with non-specific low back pain (NS-LBP) is important in the clinical reasoning of primary care physiotherapists and exercise therapists. However, there is no standardized form of assessment. Research question: which MQ domains are measured with which instruments, and which activities are relevant, appropriate and methodologically sound for assessing MQ in patients with NS-LBP?Methods: The study had three phases. In phase 1 we conducted a systematic review in PubMed, CINAHL and SPORTDiscus of literature published until October 2018. The selected studies measured MQ domains with instruments that enabled us to 1) compare MQ in self-paced dynamic activities of patients with NS-LBP and healthy controls, and/or 2) determine change over time of MQ in patients with NS-LBP. In phase 2 we established relevant dynamic activities to assess in patients with NS-LBP. In phase 3 we determined appropriateness and methodological qualities of the selected instruments.Results: Thirty cross-sectional and three pre-post-test studies were eligible. The instruments consisted of complex (n = 19) and simple (n = 7) instrumented motion analysis systems and standardized observational tests (n = 7). We identified three domains representative for MQ: range of motion (ROM), inter-segmental coordination, and whole-body movements. In these domains, patients with NS-LBP significantly differed from healthy controls, respectively 7/12, 12/13 and 13/20 studies. Moreover, ROM and whole-body movements significantly improved over time in patients with NS-LBP (3/3 studies). Based on phase 3, we concluded that none of the instruments are appropriate to assess MQ in patients with NS-LBP in primary care.Significance: Forward bending, lifting, and walking seem the most relevant activities to evaluate in patients with NS-LBP. However, we found no suitable instruments to measure ROM, inter-segmental coordination, or whole-body movements as determinants of MQ in these activities in daily practice. We therefore recommend such an instrument be developed.
DOCUMENT
Objective: To determine the construct validity, criterion validity, and responsiveness of measurement instruments evaluating scapular function. Design: Systematic review of measurement properties. Literature Search: The MEDLINE, Embase, CINAHL, and SPORTDiscus databases were systematically searched from inception until March 2019. Study Selection Criteria: Studies published in Dutch, English, or German were included when they evaluated at least 1 of the measurement properties of interest. No restrictions were made regarding participants' health status. Data Synthesis: Two reviewers independently evaluated study quality using the COSMIN checklist and extracted and analyzed data. Quality of evidence was graded by measurement property for each distinctive type of measurement. Results: Thirty-one measurement instruments in 14 studies were categorized into instruments to measure scapular posture and movement, and to assess scapular dyskinesis. Quality of evidence was at most moderate for 4 instruments with respect to criterion validity. Of these, criterion validity for instruments measuring scapular protraction/retraction posture and rotation angles up to 120° of thoracohumeral elevation was sufficient. Criterion validity for instruments measuring asymmetrical scapular posture, range of motion, and the lateral scapular slide test was insufficient. Quality of evidence for measurement properties of all other instruments was graded lower. Conclusion: There is currently insufficient evidence to recommend any instrument for the clinical examination of scapular function. Measurement instruments to assess scapular dyskinesis are prone to misinterpretation and should therefore not be used as such.
LINK
Background: Due to differences in the definition of frailty, many different screening instruments have been developed. However, the predictive validity of these instruments among community-dwelling older people remains uncertain. Objective: To investigate whether combined (i.e. sequential or parallel) use of available frailty instruments improves the predictive power of dependency in (instrumental) activities of daily living ((I)ADL), mortality and hospitalization. Design, setting and participants: A prospective cohort study with two-year followup was conducted among pre-frail and frail community-dwelling older people in the Netherlands. Measurements: Four combinations of two highly specific frailty instruments (Frailty Phenotype, Frailty Index) and two highly sensitive instruments (Tilburg Frailty Indicator, Groningen Frailty Indicator) were investigated. We calculated sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) for all single instruments as well as for the four combinations, sequential and parallel. Results: 2,420 individuals participated (mean age 76.3 ± 6.6 years, 60.5% female) in our study. Sequential use increased the levels of specificity, as expected, whereas the PPV hardly increased. Parallel use increased the levels of sensitivity, although the NPV hardly increased. Conclusions: Applying two frailty instruments sequential or parallel might not be a solution for achieving better predictions of frailty in community-dwelling older people. Our results show that the combination of different screening instruments does not improve predictive validity. However, as this is one of the first studies to investigate the combined use of screening instruments, we recommend further exploration of other combinations of instruments among other study populations.
DOCUMENT
Background: With the increased attention on implementing inquiry activities in primary science classrooms, a growing interest has emerged in assessing students’ science skills. Research has been concerned with the limitations and advantages of different test formats to assess students’ science skills. Purpose: This study explores the construction of different instruments for measuring science skills by categorizing items systematically on three subskill levels (science-specific, thinking, metacognition,) and different activities of the empirical cycle.Sample: The study included 128 5th and 6th grade students from seven primary schools in the Netherlands.Design and method: Seven measures were used: a paper-and-pencil test, three performance assessments, two metacognitive self-report tests and a test used as an indication of general cognitive ability.Results: Reliabilities of all tests indicate sufficient internal consistency. Positive correlations between the paper-and-pencil test and performance assessments reinforce that the different tests measure a common core of similar skills thus providing evidence for convergent validity. Results also show that students’ ability in performing scientific inquiry is significantly related to general cognitive ability. No relations are found between the measure of general metacognitive ability and the paper-and-pencil test or the three performance assessments. By contrast the metacognitive self-report test constructed to obtain information about application of metacognitive abilities in performing scientific inquiry, shows significant - although small - correlations with two performance assessments. Further explorations reveal sufficient scale reliabilities on subskill and empirical step level.Conclusions: The present study shows that science skills can be measured reliably by categorizing items on subskill and step level. Additional diagnostic information can be obtained by examining mean scores on both subskill and step level. Such measures are not only suitable for assessing students’ mastery of science skills but can also provide teachers diagnostic information to adapt their instructions and foster the learning process of their students.
DOCUMENT
Background: In clinical practice, nurses’ attitudes regarding older patients are important in relation to quality of care. The Older People in Acute Care Survey (OPACS) is an instrument measuring hospital nurses attitudes regarding older patients and is validated in Australia and the USA. The OPACS is translated in Dutch language and content validity of this translation is previously assessed, presenting questionable results. Measurement instruments, however, cannot be “validated” based on content validity evidence alone. Judgmental evidence and statistical analysis should be combined to fully evaluate content domain definition and representation and guide further development. Objective: Assess structural validity and reliability to fully evaluate the OPACS for use in the Netherlands, complementing previous conducted content validity results. Design: Cross-sectional. Setting: Three general hospitals in the Netherlands. Participants: 201 registered nurses. Methods: Confirmatory factor analysis was used to assess the structural validity. Reliability was assessed with Cronbach’s alpha. Results: OPACS Section A (measuring practice experiences) demonstrated to have acceptable structural validity- and good reliability outcomes after exclusion of two items (model fit: x² [df=537]=8475.40, p <0.001, CFI=0.96, TLI=0.96, RMSEA=0.21; Cronbach’s alpha=0.82). Section B (measuring general opinion) demonstrated to have inadequate structural validity outcomes (model fit: x² [df=1127]=9200.29, p<0.001, CFI=0.68, TLI=0.67, RMSEA=0.15). None of the items contributed significant to the factor and therefore no further analysis could be performed (range p(>|z|)= 0.551 -0 .788). Conclusion: Even though structural validity for section A was acceptable, content validity scores of a majority of items in this subscale were low, resulting in questionable use of this subscale for the Dutch context. The findings of this study, in relation to the earlier findings regarding content validity, justify the conclusion that use of the Dutch OPACS in clinical practice and research is not recommended. Given these findings, future research should pursue the development or (cross-cultural) validation of other instruments measuring hospital nurses attitudes towards older patients for the Dutch cultural context. Furthermore, this study demonstrated the influence of cultural differences on measurement instruments and the need for rigorous research before using a measurement instrument in a new culture or context.
DOCUMENT
The aim of this study was to assess the predictive ability of the frailty phenotype (FP), Groningen Frailty Indicator (GFI), Tilburg Frailty Indicator (TFI) and frailty index (FI) for the outcomes mortality, hospitalization and increase in dependency in (instrumental) activities of daily living ((I)ADL) among older persons. This prospective cohort study with 2-year follow-up included 2420 Dutch community-dwelling older people (65+, mean age 76.3±6.6 years, 39.5% male) who were pre-frail or frail according to the FP. Mortality data were obtained from Statistics Netherlands. All other data were self-reported. Area under the receiver operating characteristic curves (AUC) was calculated for each frailty instrument and outcome measure. The prevalence of frailty, sensitivity and specifcity were calculated using cutoff values proposed by the developers and cutoff values one above and one below the proposed ones (0.05 for FI). All frailty instruments poorly predicted mortality, hospitalization and (I)ADL dependency (AUCs between 0.62–0.65, 0.59–0.63 and 0.60–0.64, respectively). Prevalence estimates of frailty in this population varied between 22.2% (FP) and 64.8% (TFI). The FP and FI showed higher levels of specifcity, whereas sensitivity was higher for the GFI and TFI. Using a different cutoff point considerably changed the prevalence, sensitivity and specifcity. In conclusion, the predictive ability of the FP, GFI, TFI and FI was poor for all outcomes in a population of pre-frail and frail community-dwelling older people. The FP and the FI showed higher values of specifcity, whereas sensitivity was higher for the GFI and TFI.
DOCUMENT
