There is emerging evidence that the performance of risk assessment instruments is weaker when used for clinical decision‐making than for research purposes. For instance, research has found lower agreement between evaluators when the risk assessments are conducted during routine practice. We examined the field interrater reliability of the Short‐Term Assessment of Risk and Treatability: Adolescent Version (START:AV). Clinicians in a Dutch secure youth care facility completed START:AV assessments as part of the treatment routine. Consistent with previous literature, interrater reliability of the items and total scores was lower than previously reported in non‐field studies. Nevertheless, moderate to good interrater reliability was found for final risk judgments on most adverse outcomes. Field studies provide insights into the actual performance of structured risk assessment in real‐world settings, exposing factors that affect reliability. This information is relevant for those who wish to implement structured risk assessment with a level of reliability that is defensible considering the high stakes.
DOCUMENT
Risk assessment instruments are widely used to predict risk of adverse outcomes, such as violence or victimization, and to allocate resources for managing these risks among individuals involved in criminal justice and forensic mental health services. For risk assessment instruments to reach their full potential, they must be implemented with fidelity. A lack of information on administration fidelity hinders transparency about the implementation quality, as well as the interpretation of negative or inconclusive findings from predictive validity studies. The present study focuses on adherence, a dimension of fidelity. Adherence denotes the extent to which the risk assessment is completed according to the instrument’s guidelines. We developed an adherence measure, tailored to the ShortTerm Assessment of Risk and Treatability: Adolescent Version (START:AV), an evidence-based risk assessment instrument for adolescents. With the START:AV Adherence Rating Scale, we explored the degree to which 11 key features of the instrument were adhered to in 306 START:AVs forms, completed by 17 different evaluators in a Dutch residential youth care facility over a two-year period. Good to excellent interrater reliability was found for all adherence items. We identified differences in adherence scores on the various START:AV features, as well as significant improvement in adherence for those who attended a START:AV refresher workshop. Outcomes of risk assessment instruments potentially impact decision-making, for example, whether a youth’s secure placement should be extended. Therefore, we recommend fidelity monitoring to ensure the risk assessment practice was delivered as intended.
DOCUMENT
Risk assessment plays an important role in forensic mental health care. The way the conclusions of those risk assessments are communicated varies considerably across instruments. In an effort to make them more comparable, Hanson, R. K., Bourgon, G., McGrath, R., Kroner, D. D., Amora, D. A., Thomas, S. S., & Tavarez, L. P. [2017. A five-level risk and needs system: Maximizing assessment results in corrections through the development of a common language. The Council of State Governments Justice Center. https:// csgjusticecenter.org/wp-content/uploads/2017/01/A-Five-Level-Risk-and-Needs-system_Report.pdf] developed the Five-Level Risk and Needs System, placing the conclusions of different instruments along five theoretically meaningful levels. The current study explores a Five-Level Risk and Needs system for violent recidivism to which the numerical codings of the HCR-20 Version 2 and its successor, the HCR-20V3 are calibrated, using a combined sample from six previous studies for the HCR-20 Version 2 (n = 411 males with a violent index offence) and a pilot sample for the HCR-20V3 (n = 66 males with a violent index offence). Baselines for the five levels were defined by a combination of theoretical (e.g. expert meetings) and empirical (e.g. literature review) considerations. The calibration of the HCR-20 Version 2 was able to detect four levels, from a combined level I/II to an adjusted level V. The provisional calibration of the HCR-20V3 showed a substantial overlap with the HCR-20 Version 2, with each level boundary having a 2-point difference. Implications for practice and future research are discussed.
DOCUMENT
The HCR-20V3 is a violence risk assessment tool that is widely used in forensic clinical practice for risk management planning. The predictive value of the tool, when used in court for legal decisionmaking, is not yet intensively been studied and questions about legal admissibility may arise. This article aims to provide legal and mental health practitioners with an overview of the strengths and weaknesses of the HCR-20V3 when applied in legal settings. The HCR-20V3 is described and discussed with respect to its psychometric properties for different groups and settings. Issues involving legal admissibility and potential biases when conducting violence risk assessments with the HCR-20V3 are outlined. To explore legal admissibility challenges with respect to the HCR-20V3, we searched case law databases since 2013 from Australia, Canada, Ireland, the Netherlands, New Zealand, the UK, and the USA. In total, we found 546 cases referring to the HCR-20/HCR-20V3. In these cases, the tool was rarely challenged (4.03%), and when challenged, it never resulted in a court decision that the risk assessment was inadmissible. Finally, we provide recommendations for legal practitioners for the cross-examination of risk assessments and recommendations for mental health professionals who conduct risk assessments and report to the court. We conclude with suggestions for future research with the HCR-20V3 to strengthen the evidence base for use of the instrument in legal contexts.
DOCUMENT
An effective implementation approach is crucial for successful integration of structured risk assessment instruments into practice. This qualitative study explored barriers and facilitators to the implementation of the Short-Term Assessment of Risk and Treatability: Adolescent Version (START:AV) in a Dutch residential youth care service. Perceptions of staff members from various disciplines were gathered through focus group interviews at three consecutive occasions. After inductive coding of the interview extracts using thematic analysis, the identified codes were linked to the consolidated framework for implementation research. Through this framework, factors that influence an implementation project can be organized into multiple domains and constructs. In the present study, staff members described implementation barriers related to characteristics of the risk assessment instrument, staff, and the implementation process. In addition, features of the setting were frequently mentioned as hindering the implementation, such as hierarchy, culture, communication, as well as implementation climate and readiness for change. Staff members also identified multiple facilitators, such as experienced advantages of the START:AV compared to the previous risk assessment practice and positive beliefs about the instrument. The article concludes with recommendations for successful implementation of structured risk assessment instruments in forensic-clinical practice.
DOCUMENT
Most violence risk assessment tools have been validated predominantly in males. In this multicenter study, the Historical, Clinical, Risk Management–20 (HCR-20), Historical, Clinical, Risk Management–20 Version 3 (HCR-20V3), Female Additional Manual (FAM), Short-Term Assessment of Risk and Treatability (START), Structured Assessment of Protective Factors for violence risk (SAPROF), and Psychopathy Checklist–Revised (PCL-R) were coded on file information of 78 female forensic psychiatric patients discharged between 1993 and 2012 with a mean follow-up period of 11.8 years from one of four Dutch forensic psychiatric hospitals. Notable was the high rate of mortality (17.9%) and readmission to psychiatric settings (11.5%) after discharge. Official reconviction data could be retrieved from the Ministry of Justice and Security for 71 women. Twenty-four women (33.8%) were reconvicted after discharge, including 13 for violent offenses (18.3%). Overall, predictive validity was moderate for all types of recidivism, but low for violence. The START Vulnerability scores, HCR-20V3, and FAM showed the highest predictive accuracy for all recidivism. With respect to violent recidivism, only the START Vulnerability scores and the Clinical scale of the HCR-20V3 demonstrated significant predictive accuracy.
MULTIFILE
AIM: To systematically review the available literature on the diagnostic accuracy of questionnaires and measurement instruments for headaches associated with musculoskeletal symptoms.DESIGN: Articles were eligible for inclusion when the diagnostic accuracy (sensitivity/specificity) was established for measurement instruments for headaches associated with musculoskeletal symptoms in an adult population. The databases searched were PubMed (1966-2018), Cochrane (1898-2018) and Cinahl (1988-2018). Methodological quality was assessed with the Quality Assessment of Diagnostic Accuracy Studies tool (QUADAS-2) and COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist for criterion validity. When possible, a meta-analysis was performed. The Grading of Recommendations Assessment, Development and Evaluation (GRADE) recommendations were applied to establish the level of evidence per measurement instrument.RESULTS: From 3450 articles identified, 31 articles were included in this review. Eleven measurement instruments for migraine were identified, of which the ID-Migraine is recommended with a moderate level of evidence and a pooled sensitivity of 0.87 (95% CI: 0.85-0.89) and specificity of 0.75 (95% CI: 0.72-0.78). Six measurement instruments examined both migraine and tension-type headache and only the Headache Screening Questionnaire - Dutch version has a moderate level of evidence with a sensitivity of 0.69 (95% CI 0.55-0.80) and specificity of 0.90 (95% CI 0.77-0.96) for migraine, and a sensitivity of 0.36 (95% CI 0.21-0.54) and specificity of 0.86 (95% CI 0.74-0.92) for tension-type headache. For cervicogenic headache, only the cervical flexion rotation test was identified and had a very low level of evidence with a pooled sensitivity of 0.83 (95% CI 0.72-0.94) and specificity of 0.82 (95% CI 0.73-0.91).DISCUSSION: The current review is the first to establish an overview of the diagnostic accuracy of measurement instruments for headaches associated with musculoskeletal factors. However, as most measurement instruments were validated in one study, pooling was not always possible. Risk of bias was a serious problem for most studies, decreasing the level of evidence. More research is needed to enhance the level of evidence for existing measurement instruments for multiple headaches.
DOCUMENT
Malnutrition screening instruments used in hospitals mainly include criteria to identify characteristics of malnutrition. However, to tackle malnutrition in an early stage, identifying risk factors for malnutrition in addition to characteristics may be valuable.The aim of this study was to determine the predictive validity of the Patient-Generated Subjective Global Assessment (PG-SGA SF), which addresses malnutrition characteristics and risk factors, and the Short Nutritional Assessment Questionnaire (SNAQ), which addresses mainly malnutrition characteristics, for length of stay (LOS) in a mixed hospital population.
DOCUMENT
The Short-Term Assessment of Risk and Treatability: Adolescent Version (START:AV) is a risk assessment instrument for adolescents that estimates the risk of multiple adverse outcomes. Prior research into its predictive validity is limited to a handful of studies conducted with the START:AV pilot version and often by the instrument’s developers. The present study examines the START:AV’s field validity in a secure youth care sample in the Netherlands. Using a prospective design, we investigated whether the total scores, lifetime history, and the final risk judgments of 106 START:AVs predicted inpatient incidents during a 4-month follow-up. Final risk judgments and lifetime history predicted multiple adverse outcomes, including physical aggression, institutional violations, substance use, self-injury, and victimization. The predictive validity of the total scores was significant only for physical aggression and institutional violations. Hence, the short-term predictive validity of the START:AV for inpatient incidents in a residential youth care setting was partially demonstrated and the START:AV final risk judgments can be used to guide treatment planning and decision-making regarding furlough or discharge in this setting.
DOCUMENT
Psychologische instrumenten worden regelmatig gebruikt in de rechtbank om beeldvorming en besluitvorming te ondersteunen. Veel van deze instrumenten zijn echter oorspronkelijk niet ontwikkeld voor gebruik binnen deze context, wat vragen oproept over de validiteit en betrouwbaarheid van de uitkomsten. Wat weten we eigenlijk over de toepassing van psychologische instrumenten in de juridische context?
LINK
