We use a randomised experiment to study the effect of offering half of 556 freshman students a learning analytics dashboard and a weekly email with a link to their dashboard, on student behaviour in the online environment and final exam performance. The dashboard shows their online progress in the learning management systems, their predicted chance of passing, their predicted grade and their online intermediate performance compared with the total cohort. The email with dashboard access, as well as dashboard use, has positive effects on student behaviour in the online environment, but no effects are found on student performance in the final exam of the programming course. However, we do find differential effects by specialisation and student characteristics.
MULTIFILE
Abstract Summary: Program fidelity instruments are a key ingredient for clinical supervision and implementation as well as effectiveness studies. This study examines the factor structure of the Functional Family Parole services Global Rating Measure (FFP-GRM); the program fidelity instrument of Functional Family Parole services for case management in youth parole, child protection and child welfare services. Between October 2012 and February 2015, program fidelity was measured with the FFP-GRM by Functional Family Parole supervisors. Confirmatory factor analysis was performed on 380 cases and internal consistency reliability coefficients were calculated. Findings: Confirmatory factor analyses showed that the 33-item and four-factor model of the FFP-GRM achieved a good fit to the data. Internal validity testing results showed that subscale Cronbach’s a ranged between .82 and .90. Applications: Findings affirm a good fit to the data and a good-to-excellent internal consistency of the FFP-GRM, which is considered sufficient to justify its use. The results are discussed with regard to the use of fidelity instruments for both clinical and research purposes.
Background: The aging population is increasingly faced with daily life limitations, threatening their Functional Independence (FI). These limitations extend different life domains and require a broad range of community-care professionals to be addressed. The Decision Support Tool for Functional Independence (DST-FI) facilitates community-care professionals in providing uncontradictory recommendations regarding the maintenance of FI in community-dwelling older people. The current study aims to determine the validity and reliability of the DST-FI. Methods: Sixty community-care professionals completed a twofold assessment. To assess construct validity, participants were asked to assign predefined recommendations to fifty cases of older people to maintain their level of FI. Hypotheses were tested regarding the expected recommendations per case. Content validity was assessed by questions on relevance, comprehensiveness, and comprehensibility of the current set of recommendations. Twelve participants repeated the assessment after two weeks to enable both within- and between rater reliability properties, expressed by an Intraclass Correlation Coefficient. Results: Seven out of eight predefined hypotheses confirmed expectations, indicating high construct validity. As the recommendations were indicated 'relevant' and 'complete', content validity was high as well. Agreement between raters was poor to moderate while agreement within raters was moderate to excellent, resulting in moderate overall reliability. Conclusion: The DST-FI suggests high validity and moderate reliability properties when used in a population of community-dwelling older people. The tool could facilitate community-care professionals in their task to preserve FI in older people. Future research should focus on psychometric properties like feasibility, acceptability, and developing and piloting strategies for implementation in community-care.
LINK