The Kennedy Axis V is a routine outcome measurement instrument which can assist the assessment of the short-term risk for violence and other adverse patient outcomes. The purpose of this study was to evaluate the interrater reliability and clinical utility of the instrument when used by mental health nurses in daily care of patients with mental illness. This cross-sectional study was conducted in inpatient and outpatient adult psychiatric care units and in one adolescent inpatient unit at a university hospital in the Netherlands. Interrater reliability was measured based on the independent scores of two different nurses for the same patients. The clinical utility of the instrument was evaluated by means of a clinical utility questionnaire. To gain a deeper understanding of rating difficulties at the adolescent unit, additional data were collected in two focus group interviews. The overall results revealed a substantial level of agreement between nurses (intraclass correlation coefficient and Pearson 0.79). Some rating challenges were identified, including difficulties with scoring the instrument and using tailor-made interventions related to the scores. These challenges can be resolved using refined training and implementation strategies. When the Kennedy Axis V is accompanied by a solid implementation strategy in adult mental health care, the instrument can be used for short-term risk assessment and thereby contribute in efforts to reduce violence, suicide, self-harm, severe selfneglect, and enhanced objectivity in clinical decision-making.
Purpose: The main purpose of the research was to measure reliability and validity of the Scoring Rubric for Information Literacy (Van Helvoort, 2010). Design/methodology/approach: Percentages of agreement and Intraclass Correlation were used to describe interrater reliability. For the determination of construct validity, factor analysis and reliability analysis were used. Criterion validity was calculated with Pearson correlations. Findings: In the described case, the Scoring Rubric for Information Literacy appears to be a reliable and valid instrument for the assessment of information literate performance. Originality/value: Reliability and validity are prerequisites to recommend a rubric for application. The results confirm that this Scoring Rubric for Information Literacy can be used in courses in higher education, not only for assessment purposes but also to foster learning. Oorspronkelijke artikel bij Emerald te vinden bij http://dx.doi.org/10.1108/JD-05-2016-0066
MULTIFILE
Caregivers of persons with profound intellectual and multiple disabilities (PIMD) often describe the quality of the daily movements of these persons in terms of flexibility or stiffness. Objective outcome measures for flexibility and stiffness are muscle tone or level of spasticity. Two instruments used to grade muscle tone and spasticity are the Modified Ashworth Scale (MAS) and the Modified Tardieu Scale (MTS). To date, however, no research has been performed to determine the psychometric properties of the MAS and MTS in persons with PIMD. Therefore, the purpose of this study was to determine the feasibility, test-retest reliability, and interrater reliability of the MAS and MTS in persons with PIMD. We assessed 35 participants on the MAS and MTS twice, first for the test and second a week later for the retest. Two observers performed the measurements. Feasibility was assessed based on the percentage of successful measurements. Test-retest and interrater reliability were determined by using the Wilcoxon signed rank test, intraclass correlation coefficients (ICC), Spearman's correlation, and either limits of agreement (LOA) or quadratically weighted kappa. The feasibility of the measurements was good, because an acceptable percentage of successful measurements were performed. MAS measurements had substantial to almost perfect quadratically weighted kappa (>0.8) and an acceptable ICC (>0.8) for both inter- and intrarater reliability. However, MTS measurements had insufficient ICCs, Spearman's correlations, and LOAs for both inter- and interrater reliability. Our data indicated that the feasibility of the MAS and MTS for measuring muscle tone in persons with PIMD was good. The MAS had sufficient test-retest and interrater reliability; however, the MTS had an insufficient test-retest and interrater reliability in persons with PIMD. Thus, the MAS may be a good method for evaluating the quality of daily movements in persons with PIMD. Providing test administrators with training and clear instructions will improve test reliability.
