Formula scoring (FS) is the use of a don't know option (DKO) with subtraction of points for wrong answers. Its effect on construct validity and reliability of progress test scores, is subject of discussion. Choosing a DKO may not only be affected by knowledge level, but also by risk taking tendency, and may thus introduce construct-irrelevant variance into the knowledge measurement. On the other hand, FS may result in more reliable test scores. To evaluate the impact of FS on construct validity and reliability of progress test scores, a progress test for radiology residents was divided into two tests of 100 parallel items (A and B). Each test had a FS and a number-right (NR) version, A-FS, B-FS, A-NR, and B-NR. Participants (337) were randomly divided into two groups. One group took test A-FS followed by B-NR, and the second group test B-FS followed by A-NR. Evidence for impaired construct validity was sought in a hierarchical regression analysis by investigating how much of the participants' FS-score variance was explained by the DKO-score, compared to the contribution of the knowledge level (NR-score), while controlling for Group, Gender, and Training length. Cronbach's alpha was used to estimate NR and FS-score reliability per year group. NR score was found to explain 27 % of the variance of FS [F(1,332) = 219.2, p < 0.0005], DKO-score, and the interaction of DKO and Gender were found to explain 8 % [F(2,330) = 41.5, p < 0.0005], and the interaction of DKO and NR 1.6 % [F(1,329) = 16.6, p < 0.0005], supporting our hypothesis that FS introduces construct-irrelevant variance into the knowledge measurement. However, NR-scores showed considerably lower reliabilities than FS-scores (mean year-test group Cronbach's alphas were 0.62 and 0.74, respectively). Decisions about FS with progress tests should be a careful trade-off between systematic and random measurement error.
BACKGROUND: Patients who underwent surgery for aortic coarctation (COA) have an increased risk of arterial hypertension. We aimed at evaluating (1) differences between hypertensive and non-hypertensive patients and (2) the value of cardiopulmonary exercise testing (CPET) to predict the development or progression of hypertension. METHODS: Between 1999 and 2010, CPET was performed in 223 COA-patients of whom 122 had resting blood pressures of <140/90 mmHg without medication, and 101 were considered hypertensive. Comparative statistics were performed. Cox regression analysis was used to assess the relation between demographic, clinical and exercise variables and the development/progression of hypertension. RESULTS: At baseline, hypertensive patients were older (p=0.007), were more often male (p=0.004) and had repair at later age (p=0.008) when compared to normotensive patients. After 3.6 ± 1.2 years, 29/120 (25%) normotensive patients developed hypertension. In normotensives, VE/VCO2-slope (p=0.0016) and peak systolic blood pressure (SBP; p=0.049) were significantly related to the development of hypertension during follow-up. Cut-off points related to higher risk for hypertension, based on best sensitivity and specificity, were defined as VE/VCO2-slope ≥ 27 and peak SBP ≥ 220 mmHg. In the hypertensive group, antihypertensive medication was started/extended in 48/101 (48%) patients. Only age was associated with the need to start/extend antihypertensive therapy in this group (p=0.042). CONCLUSIONS: Higher VE/VCO2-slope and higher peak SBP are risk factors for the development of hypertension in adults with COA. Cardiopulmonary exercise testing may guide clinical decision making regarding close blood pressure control and preventive lifestyle recommendations.
Background In the Netherlands, general practitioners (GPs) play a key role in HIV testing. However, the proportion of people diagnosed with late-stage HIV remains high, and opportunities for earlier diagnosis are being missed. We implemented an educational intervention to improve HIV and STI testing in primary care in Amsterdam, the Netherlands. Methods GPs were invited to participate in an educational program between 2015 and 2020, which included repeat sessions using audit and feedback and quality improvement plans. Data on HIV, chlamydia and gonorrhoea testing by GPs were collected from 2011 through 2020. The primary outcome was HIV testing frequency, which was compared between GPs before and after participation using Poisson regression. Secondary outcomes were chlamydia and gonorrhoea testing frequencies, and positive test proportions. Additional analyses stratified by patient sex and age were done. Findings GPs after participation performed 7% more HIV tests compared to GPs before participation (adjusted relative ratio [aRR] 1.07, 95%CI 1.04–1.09); there was no change in the proportion HIV positive tests (aRR 0.87, 95%CI 0.63–1.19). HIV testing increased most among patients who were female and ≤19 or 50–64 years old. After participation, HIV testing continued to increase (aRR 1.02 per quarter, 95%CI 1.01–1.02). Chlamydia testing by GPs after participation increased by 6% (aRR 1.06, 95%CI 1.05–1.08), while gonorrhoea testing decreased by 2% (aRR 0.98, 95%CI 0.97–0.99). We observed increases specifically in extragenital chlamydia and gonorrhoea testing. Conclusions The intervention was associated with a modest increase in HIV testing among GPs after participation, while the proportion positive HIV tests remained stable. Our results suggest that the intervention yielded a sustained effect.
In the last decade, the automotive industry has seen significant advancements in technology (Advanced Driver Assistance Systems (ADAS) and autonomous vehicles) that presents the opportunity to improve traffic safety, efficiency, and comfort. However, the lack of drivers’ knowledge (such as risks, benefits, capabilities, limitations, and components) and confusion (i.e., multiple systems that have similar but not identical functions with different names) concerning the vehicle technology still prevails and thus, limiting the safety potential. The usual sources (such as the owner’s manual, instructions from a sales representative, online forums, and post-purchase training) do not provide adequate and sustainable knowledge to drivers concerning ADAS. Additionally, existing driving training and examinations focus mainly on unassisted driving and are practically unchanged for 30 years. Therefore, where and how drivers should obtain the necessary skills and knowledge for safely and effectively using ADAS? The proposed KIEM project AMIGO aims to create a training framework for learner drivers by combining classroom, online/virtual, and on-the-road training modules for imparting adequate knowledge and skills (such as risk assessment, handling in safety-critical and take-over transitions, and self-evaluation). AMIGO will also develop an assessment procedure to evaluate the impact of ADAS training on drivers’ skills and knowledge by defining key performance indicators (KPIs) using in-vehicle data, eye-tracking data, and subjective measures. For practical reasons, AMIGO will focus on either lane-keeping assistance (LKA) or adaptive cruise control (ACC) for framework development and testing, depending on the system availability. The insights obtained from this project will serve as a foundation for a subsequent research project, which will expand the AMIGO framework to other ADAS systems (e.g., mandatory ADAS systems in new cars from 2020 onwards) and specific driver target groups, such as the elderly and novice.
