Purpose Non-technical skills have gained attention, since enhancement of these skills is presumed to improve the process of trauma resuscitation. However, the reliability of assessing non-technical skills is underexposed, especially when using video analysis. Therefore, our primary aim was to assess the reliability of the Trauma Non-Technical Skills (T-NOTECHS) tool by video analysis. Secondarily, we investigated to what extent reliability increased when the T-NOTECHS was assessed by three assessors [average intra-class correlation (ICC)] instead of one (individual ICC). Methods As calculated by a pre-study power analysis, 18 videos were reviewed by three research assistants using the T-NOTECHS tool. Average and individual degree of agreement of the assessors was calculated using a two-way mixed model ICC. Results Average ICC was ‘excellent’ for the overall score and all five domains. Individual ICC was classified as ‘excellent’ for the overall score. Of the five domains, only one was classified as ‘excellent’, two as ‘good’ and two were even only ‘fair’. Conclusions Assessment of non-technical skills using the T-NOTECHS is reliable using video analysis and has an excellent reliability for the overall T-NOTECHS score. Assessment by three raters further improve the reliability, resulting in an excellent reliability for all individual domains.
Significant attention has been paid in the international literature to the effect of in-service training on the interaction skills of teachers in early childhood education and care. The growth of pre-service teachers during teacher education has received relatively little attention to date, however. In a mixed-methods longitudinal study, we monitored the development of interaction skills among a group of Dutch pre-service teachers with repeated measures for 3 years and structured interviews. The results of a linear mixed-effects model revealed an impressive growth of interaction skills during the pre-service training. The qualitative interview data revealed progress of pre-service teachers’ professional reflection on their interaction with young children. These outcomes show the effectiveness of pre-service training for the development of interaction skills and professional reflection in early childhood education and care. However, progress is relatively modest for instructional skills and this domain needs further investment in pre-service training.
This paper presents a mixed methods study in which 21 first-year student teachers took part that investigated learning outcomes of a modified learning by design task. The study is part of a series of studies that aims to improve student learning, teaching skills and teacher training. Design-based science challenges are reasonably successful project-based approaches for breaking down the boundaries between traditional school subjects. Previous learning outcomes of the extensively studied Learning by Design (LBD) approach demonstrated a strong positive effect on students’ skills. However, compared to traditional classroom settings, LBD provided little or no profit on (scientific) concept learning. For this, according to two preliminary studies, a lack of explicit teaching and scaffolding strategies, both strongly teacher-dependent, bears a share of responsibility. The results of this third study indicate that more emphasis on these strategies indeed strengthens concept learning without reducing positive effects on skill performance.
