Background: A feasible and reliable instrument to measure strength in persons with severe intellectual and visual disabilities (SIVD) is lacking. The aim of our study was to determine feasibility, learning period and reliability of three strength tests.Methods: Twenty-nine participants with SIVD performed the Minimum Sit-to-Stand Height test (MSST), the Leg Extension test (LE) and the 30 seconds Chair-Stand test (30sCS), once per week for 5 weeks. Feasibility was determined by the percentage of successful measurements; learning effect by using paired t test between two consecutive measurements; test–retest reliability by intraclass correlation coefficient and Limits of Agreement and, correlations by Pearson correlations.Results: A sufficient feasibility and learning period of the tests was shown. The methods had sufficient test–retest reliability and moderate-to-sufficient correlations. Conclusion: The MSST, the LE, and the 30sCS are feasible tests for measuring muscle strength in persons with SIVD, having sufficient test re-test reliability.
DOCUMENT
Organizations are currently facing substantial challenges regarding becoming circular by 2050 – also referred to as Circular Economy (CE). Subsequently, increasing complexity on all organizational levels creates uncertainty about respective organizational and technological capabilities and adequate strategies to develop these capabilities. Organizations are struggling in picking up the CE ambitions and answering the what’s in it for me question. Scholars are developing models and frameworks to enable organizations to measure CE performance. Over 125 assessment methods are available for micro level assessment – measuring up to 365 different metrics. Moreover, extant literature is available presenting barriers and opportunities for CE transformation focusing on industry, sector, region, etc. And, although a more holistic perspective is required to become circular mature, this is currently lacking. In this paper we present a multi-methodology view on approaches and how they are used (or not). Our main goal is to extend the existing body of knowledge with an eye on applicability and research directions to untie the Gordian knot of measuring circularity.
LINK
Exergames provide a challenging opportunity for home-based training and evaluation of postural control in the elderly population, but affordable sensor technology and algorithms for assessment of whole body movement patterns in the home environment are yet to be developed. The aim of the present study was to evaluate the use of Kinect, a commonly available video game sensor, for capturing and analyzing whole body movement patterns. Healthy adults (. n=20) played a weight shifting exergame under five different conditions with varying amplitudes and speed of sway movement, while 3D positions of ten body segments were recorded in the frontal plane using Kinect and a Vicon 3D camera system. Principal Component Analysis (PCA) was used to extract and compare movement patterns and the variance in individual body segment positions explained by these patterns. Using the identified patterns, balance outcome measures based on spatiotemporal sway characteristics were computed. The results showed that both Vicon and Kinect capture >90% variance of all body segment movements within three PCs. Kinect-derived movement patterns were found to explain variance in trunk movements accurately, yet explained variance in hand and foot segments was underestimated and overestimated respectively by as much as 30%. Differences between both systems with respect to balance outcome measures range 0.3-64.3%. The results imply that Kinect provides the unique possibility of quantifying balance ability while performing complex tasks in an exergame environment.
DOCUMENT
This study evaluates psychometric properties of the Individual Recovery Outcomes Counter (I.ROC) in a Dutch population of participants with a schizophrenia spectrum disorder (SSD). B. Esther Sportel1*† , Hettie Aardema1†, Nynke Boonstra2 , Johannes Arends1 , Bridey Rudd3 , Margot J. Metz4 , Stynke Castelein5 and Gerdina H.M. Pijnenborg6
MULTIFILE
Abstract Teaching project management is becoming a standard part of curricula in higher education. Assessing the added value of the teaching efforts needs pre- and post assessments. Given the wide variety of skills and knowledge project management embraces a proper assessment of project management is difficult. A method of assessing added value has been designed and tested on the first part of a professional Master in Project and Process Management. The design is based on students assessment of learning gains (SALG) with several extra criteria. The design was evaluated, updated and tested again. The third test with a tweaked design is being performed. The results do not convince that this SALG-based instrument can be used to measure added value. Presented at ICEE2015 : International conference on engineering education, 20th - 24th July 2015, Zagreb, Zadar (Croatia).
DOCUMENT
During the 2024 Open Science Retreat, the Measuring Open Science team collected, reviewed, and analyzed existing research into open science practices. As a team, we developed an interactive overview of open science surveys, which may be used e.g. to reuse questionnaire items on different open science practices.
MULTIFILE
Living labs are complex multi-stakeholder collaborations that often employ a usercentred and design-driven methodology to foster innovation. Conventional management tools fall short in evaluating them. However, some methods and tools dedicated to living labs' special characteristics and goals have already been developed. Most of them are still in their testing phase. Those tools are not easily accessible and can only be found in extensive research reports, which are difficult to dissect. Therefore, this paper reviews seven evaluation methods and tools specially developed for living labs. Each section of this paper is structured in the following manner: tool’s introduction (1), who uses the tool (2), and how it should be used (3). While the first set of tools, namely “ENoLL 20 Indicators”, “SISCODE Self-assessment”, and “SCIROCCO Exchange Tool” assess a living lab as an organisation and are diving deeper into the organisational activities and the complex context, the second set of methods and tools, “FormIT” and “Living Lab Markers”, evaluate living labs’ methodologies: the process they use to come to innovations. The paper's final section presents “CheRRIes Monitoring and Evaluation Tool” and “TALIA Indicator for Benchmarking Service for Regions”, which assess the regional impact made by living labs. As every living lab is different regarding its maturity (as an organisation and in its methodology) and the scope of impact it wants to make, the most crucial decision when evaluating is to determine the focus of the assessment. This overview allows for a first orientation on worked-out methods and on possible indicators to use. It also concludes that the existing tools are quite managerial in their method and aesthetics and calls for designers and social scientists to develop more playful, engaging and (possibly) learning-oriented tools to evaluate living labs in the future. LinkedIn: https://www.linkedin.com/in/overdiek12345/ https://www.linkedin.com/in/mari-genova-17a727196/?originalSubdomain=nl
DOCUMENT
From the article: "Various programs in higher education feel a need to teach project management skills to students. Measuring the effect of education is a challenge especially when focused on behavioral skills. Research on learning gains usually turns to the method of Students Assessment of Learning Gains (SALG), which can be questioned on reliability. This article constructs five design criteria for an improved Students Assessment of Learning Gains (SALG): measure satisfaction, use pre- and posttests, use perceived ability, account for learning stage one and account for attrition. A first test on a semester of a professional master in project management yields ambiguous results. The second test with a 360 degrees measurement is performed on the same semester with different students. The post test is scheduled for June 2014, results will be reported at the World Congress."
MULTIFILE
Activity trackers like Fitbit are used for self-tracking of physical activity by an increasing number of individuals. Comparing physical activity scores with peers can contribute to the desired behavioural change. However, for meaningful social comparison a high inter-device reliability is paramount. This study aimed to determine the inter-device reliability of Fitbit activity trackers in measuring steps. Ten activity trackers (Fitbit Ultra) were worn by a single person (male,46 years) during eight consecutive days. Inter-device reliability was assessed on three different levels of aggregation (minutes, hours, days) with various methods, including intra-class correlation coefficient (ICC), Bland-Altman plots, limits of agreement (LOA) and Mixed Model Analysis. Results showed that the inter-device reliability of the Fitbit in measuring steps is good at all levels of aggregation (minutes, hours, days), but especially when steps were measuredper day. This implies that individuals can reliably compare their daily physical activity scores with peers.
DOCUMENT
A literature review conducted as part of a research project named “Measuring Safety in Aviation – Developing Metrics for Safety Management Systems” revealed several challenges regarding the safety metrics used in aviation. One of the conclusions was that there is limited empirical evidence about the relationship between Safety Management System (SMS) processes and safety outcomes. In order to explore such a relationship, respective data from 7 European airlines was analyzed to explore whether there is a monotonic relation between safety outcome metrics and SMS processes, operational activity and demographic data widely used by the industry. Few, diverse, and occasionally contradictory associations were found, indicating that (1) there is a limited value of linear thinking followed by the industry, i.e., “the more you do with an SMS the higher the safety performance”, (2) the diversity in SMS implementation across companies renders the sole use of output metrics not sufficient for assessing the impact of SMS processes on safety levels, and (3) only flight hours seem as a valid denominator in safety performance indicators. At the next phase of the research project, we are going to explore what alternative metrics can reflect SMS/safety processes and safety performance in a more valid manner
DOCUMENT
