Formative assessment (FA) is an effective educational approach for optimising student learning and is considered as a promising avenue for assessment within physical education (PE). Nevertheless, implementing FA is a complex and demanding task for in-service PE teachers who often lack formal training on this topic. To better support PE teachers in implementing FA into their practice, we need better insight into teachers’ experiences while designing and implementing formative strategies. However, knowledge on this topic is limited, especially within PE. Therefore, this study examined the experiences of 15 PE teachers who participated in an 18-month professional development programme. Teachers designed and implemented various formative activities within their PE lessons, while experiences were investigated through logbook entries and focus groups. Findings indicated various positive experiences, such as increased transparency in learning outcomes and success criteria for students as well as increased student involvement, but also revealed complexities, such as shifting teacher roles and insufficient feedback literacy among students. Overall, the findings of this study underscore the importance of a sustained, collaborative, and supported approach to implementing FA.
DOCUMENT
Assessment in higher education (HE) is often focused on concluding modules with one or more tests that students need to pass. As a result, both students and teachers are primarily concerned with the summative function of assessment: information from tests is used to make pass/fail decisions about students. In recent years, increasing attention has been paid to the formative function of assessment and focus has shifted towards how assessment can stimulate learning. However, this also leads to a search for balance between both functions of assessment. Programmatic assessment (PA) is an assessment concept in which their intertwining is embraced to strike a new balance. A growing number of higher education programmes has implemented PA. Although there is consensus about the theoretical principles that form the basis for the design of PA, programmes make various specific design choices based on these principles, fitting with their own context. This paper provides insight into the design choices that programmes make when implementing PA and into the considerations that play a role in making these design choices. Such an overview is important for research purposes because it creates a framework for investigating the effects of different design choices within PA.
DOCUMENT
Objectives: Malnutrition is associated with a twofold higher risk of dying in patients with tuberculosis (TB) and considered an important potentially reversible risk factor for failure of TB treatment. The construct of malnutrition has three domains: intake or uptake of nutrition; body composition and physical and cognitive function. The objectives of this systematic review are to identify malnutrition assessment methods, and to quantify how malnutrition assessment methods capture the international consensus definition for malnutrition, in patients with TB.Design: Different assessment methods were identified. We determined the extent of capturing of the three domains of malnutrition, that is, intake or uptake of nutrition, body composition and physical and cognitive function.Results: Seventeen malnutrition assessment methods were identified in 69 included studies. In 53/69 (77%) of studies, body mass index was used as the only malnutrition assessment method. Three out of 69 studies (4%) used a method that captured all three domains of malnutrition.Conclusions: Our study focused on published articles. Implementation of new criteria takes time, which may take longer than the period covered by this review. Most patients with TB are assessed for only one aspect of the conceptual definition of malnutrition. The use of international consensus criteria is recommended to establish uniform diagnostics and treatment of malnutrition.
LINK
Objectives: Goal setting and motivational interviewing (MI) may increase well-being by promoting healthy behavior. Since we failed to show improved well-being in a proactive assessment service for community-dwelling older adults applying these techniques, we studied whether implementation processes could explain this. Methods: Goals set during the comprehensive geriatric assessment were evaluated on their potential for behavior change. MI and goal setting adherence wasassessed by reviewing audiotaped interactions and interviewing care professionals. Results: Among the 280 goals set with 230 frail older adults (mean age 77 ± 6.9 years, 59% women), more than 90% had a low potential for behavior change. Quality thresholds for MI were reached in only one of the 11 interactions. Application was hindered by the context and the limited proficiency of care professionals. Discussion: Implementation was suboptimal for goal setting and MI. This decreased the potential for improved well-being in the participating older adults.
MULTIFILE
Aim: To evaluate healthcare professionals' performance and treatment fidelity in the Cardiac Care Bridge (CCB) nurse-coordinated transitional care intervention in older cardiac patients to understand and interpret the study results. Design: A mixed-methods process evaluation based on the Medical Research Council Process Evaluation framework. Methods: Quantitative data on intervention key elements were collected from 153 logbooks of all intervention patients. Qualitative data were collected using semi-structured interviews with 19 CCB professionals (cardiac nurses, community nurses and primary care physical therapists), from June 2017 until October 2018. Qualitative data-analysis is based on thematic analysis and integrated with quantitative key element outcomes. The analysis was blinded to trial outcomes. Fidelity was defined as the level of intervention adherence. Results: The overall intervention fidelity was 67%, ranging from severely low fidelity in the consultation of in-hospital geriatric teams (17%) to maximum fidelity in the comprehensive geriatric assessment (100%). Main themes of influence in the intervention performance that emerged from the interviews are interdisciplinary collaboration, organizational preconditions, confidence in the programme, time management and patient characteristics. In addition to practical issues, the patient's frailty status and limited motivation were barriers to the intervention. Conclusion: Although involved healthcare professionals expressed their confidence in the intervention, the fidelity rate was suboptimal. This could have influenced the non-significant effect of the CCB intervention on the primary composite outcome of readmission and mortality 6 months after randomization. Feasibility of intervention key elements should be reconsidered in relation to experienced barriers and the population. Impact: In addition to insight in effectiveness, insight in intervention fidelity and performance is necessary to understand the mechanism of impact. This study demonstrates that the suboptimal fidelity was subject to a complex interplay of organizational, professionals' and patients' issues. The results support intervention redesign and inform future development of transitional care interventions in older cardiac patients.
DOCUMENT
The purpose was to perform a systematic review of clinical assessment methods for classifying Generalized Joint Hypermobility (GJH), evaluate their clinimetric properties, and perform the best evidence synthesis of these methods. Four test assessment methods (Beighton Score [BS], Carter and Wilkinson, Hospital del Mar, Rotes‐Querol) and two questionnaire assessment methods (Five‐part questionnaire [5PQ], Beighton Score‐self reported [BS‐self]) were identified on children or adults. Using the Consensus‐based Standards for selection of health Measurement Instrument (COSMIN) checklist for evaluating the methodological quality of the identified studies, all included studies were rated “fair” or “poor.” Most studies were using BS, and for BS the reliability most of the studies showed limited positive to conflicting evidence, with some shortcomings on studies for the validity. The three other test assessment methods lack satisfactory information on both reliability and validity. For the questionnaire assessment methods, 5PQ was the most frequently used, and reliability showed conflicting evidence, while the validity had limited positive to conflicting evidence compared with test assessment methods. For BS‐self, the validity showed unknown evidence compared with test assessment methods. In conclusion, following recommended uniformity of testing procedures, the recommendation for clinical use in adults is BS with cut‐point of 5 of 9 including historical information, while in children it is BS with cut‐point of at least 6 of 9. However, more studies are needed to conclude on the validity properties of these assessment methods, and before evidence‐based recommendations can be made for clinical use on the “best” assessment method for classifying GJH.
DOCUMENT
Living labs are complex multi-stakeholder collaborations that often employ a usercentred and design-driven methodology to foster innovation. Conventional management tools fall short in evaluating them. However, some methods and tools dedicated to living labs' special characteristics and goals have already been developed. Most of them are still in their testing phase. Those tools are not easily accessible and can only be found in extensive research reports, which are difficult to dissect. Therefore, this paper reviews seven evaluation methods and tools specially developed for living labs. Each section of this paper is structured in the following manner: tool’s introduction (1), who uses the tool (2), and how it should be used (3). While the first set of tools, namely “ENoLL 20 Indicators”, “SISCODE Self-assessment”, and “SCIROCCO Exchange Tool” assess a living lab as an organisation and are diving deeper into the organisational activities and the complex context, the second set of methods and tools, “FormIT” and “Living Lab Markers”, evaluate living labs’ methodologies: the process they use to come to innovations. The paper's final section presents “CheRRIes Monitoring and Evaluation Tool” and “TALIA Indicator for Benchmarking Service for Regions”, which assess the regional impact made by living labs. As every living lab is different regarding its maturity (as an organisation and in its methodology) and the scope of impact it wants to make, the most crucial decision when evaluating is to determine the focus of the assessment. This overview allows for a first orientation on worked-out methods and on possible indicators to use. It also concludes that the existing tools are quite managerial in their method and aesthetics and calls for designers and social scientists to develop more playful, engaging and (possibly) learning-oriented tools to evaluate living labs in the future. LinkedIn: https://www.linkedin.com/in/overdiek12345/ https://www.linkedin.com/in/mari-genova-17a727196/?originalSubdomain=nl
DOCUMENT
ObjectiveTo identify malnutrition assessment methods in cancer patients and assess their content validity based on internationally accepted definitions for malnutrition.Study Design and SettingSystematic review of studies in cancer patients that operationalized malnutrition as a variable, published since 1998. Eleven key concepts, within the three domains reflected by the malnutrition definitions acknowledged by European Society for Clinical Nutrition and Metabolism (ESPEN) and the American Society for Parenteral and Enteral Nutrition (ASPEN): A: nutrient balance; B: changes in body shape, body area and body composition; and C: function, were used to classify content validity of methods to assess malnutrition. Content validity indices (M-CVIA–C) were calculated per assessment method. Acceptable content validity was defined as M-CVIA–C ≥ 0.80.
DOCUMENT
Objectives: There is virtually no literature on how to assess competencies of applied sport psychologists. We assessed casework of applied sport psychology students and compared written case report assessment (WCRA) with structured case presentation assessment (SCPA) on reliability and acceptability (e.g., validity, transparency, feedback function and preference of methods, as perceived by students and assessors). Design: A quantitative, comparative study of two assessment methods. Method: Participants were 11 students, nine supervisors and three exam committee members. A number of 18 cases were evaluated with both WCRA by the supervisor and SCPA by two exam committee members. Ten of these cases were also evaluated with WCRA by exam committee members. Interrater reliability measures were calculated and compared for the different assessment methods. Participants' perception of the validity, transparency, and feedback function of the methods, and the preferences for assessment methods were surveyed with a brief questionnaire. Results: SCPA by the exam committee resulted in higher interrater reliability than WCRA by supervisor and exam committee. The feedback function of SCPA seemed superior to WCRA by either supervisor or exam committee. For assessment by the exam committee, the perceived validity and transparency of SCPA seemed higher than of WCRA. Students and exam committee had the highest preference for SCPA by supervisor and exam committee. Conclusions: Overall it can be concluded that, for assessment by the exam committee, structured case presentations provided a more reliable and acceptable method of assessment than written case reports only.
DOCUMENT
This study examines completion rate for a self-assessment survey designed to assess employees' digital skills levels in the workplace. The aim is to improve data quality by investigating completion of the survey. The study reviews the theoretical background related to self-assessment surveys and completion rate, and explores the influence of survey length and format in survey design on completion rate. The research design and data analysis are described in detail, with a focus on identifying factors that may influence completion rate. Results suggest that survey designers should consider using Likert scales to optimize completion rate and completion time. However, this study did not find a significant increase in completion rate as a result of motivation, which was claimed from the literature. The study concludes with implications for the design and implementation of self-assessment surveys in the workplace, including the importance of reducing length and complexity of survey items and questions.
DOCUMENT
