The TOP program is a fully implemented responsive parenting intervention for very preterm born infants. Fidelity monitoring of interventions is important for preserving program adherence, impact outcomes and to make evidence-based adaptations. The aim of this study was to develop a fidelity tool for the TOP program following an iterative and co-creative process and subsequently evaluate the reliability of the tool. Three consecutive phases were carried out. Phase I: Initial development and pilot testing two methods namely self-report and video based observation. Phase II: Adaptations and refinements. Phase III: Evaluation of the psychometric properties of the tool based on 20 intervention videos rated by three experts.The interrater reliability of the adherence and competence subscales was good (ICC.81 to .84) and varied from moderate to excellent for specific items (ICC between .51 and .98). The FITT displayed a high correlation (Spearman’s rho.79 to.82) between the subscales and total impression item. The co-creative and iterative process resulted in a clinical useful and reliable tool for evaluating fidelity in the TOP program. This study offers insights in the practical steps in the development of a fidelity assessment tool which can be used by other intervention developers.
MULTIFILE
Background: Recently, research focus has shifted to the combination of all 24-h movement behaviors (physical activity, sedentary behavior and sleep) instead of each behavior separately. Yet, no reliable and valid proxy-report tools exist to assess all these behaviors in 0–4-year-old children. By involving end-users (parents) and key stakeholders (researchers, professionals working with young children), this mixed-methods study aimed to 1) develop a mobile application (app)-based proxy-report tool to assess 24-h movement behaviors in 0–4-year-olds, and 2) examine its content validity. Methods: First, we used concept mapping to identify activities 0–4-year-olds engage in. Parents (n = 58) and professionals working with young children (n = 21) generated a list of activities, sorted related activities, and rated the frequency children perform these activities. Second, using multidimensional scaling and cluster analysis, we created activity categories based on the sorted activities of the participants. Third, we developed the My Little Moves app in collaboration with a software developer. Finally, we examined the content validity of the app with parents (n = 14) and researchers (n = 6) using focus groups and individual interviews. Results: The app has a time-use format in which parents proxy-report the activities of their child, using eight activity categories: personal care, eating/drinking, active transport, passive transport, playing, screen use, sitting/lying calmly, and sleeping. Categories are clarified by providing examples of children’s activities. Additionally, 1–4 follow-up questions collect information on intensity (e.g., active or calm), posture, and/or context (e.g., location) of the activity. Parents and researchers considered filling in the app as feasible, taking 10–30 min per day. The activity categories were considered comprehensive, but alternative examples for several activity categories were suggested to increase the comprehensibility and relevance. Some follow-up questions were considered less relevant. These suggestions were adopted in the second version of the My Little Moves app. Conclusions: Involving end-users and key stakeholders in the development of the My Little Moves app resulted in a tailored tool to assess 24-h movement behaviors in 0–4-year-olds with adequate content validity. Future studies are needed to evaluate other measurement properties of the app.
MULTIFILE
OBJECTIVES: Sucking problems in preterm infants can be specified by means of visual observation. The Neonatal Oral-Motor Assessment Scale (NOMAS) is the visual observation method most commonly used to assess the non-nutritive sucking (NNS) and nutritive sucking (NS) skills of infants up to approximately 8 weeks postterm. During the first 2 min of a regular feeding the infant's sucking skill is assessed, either immediately or on video. Although NOMAS has been used since 1993, little is known about the method's reliability. The aim of our study was to determine the test-retest and inter-rater reliability of NOMAS.METHODS: The 75 infants included in this study were born at 26-36 weeks postmenstrual age (PMA). Four observers participated in the study. They were trained and certified to administer NOMAS in the Netherlands by M.M. Palmer between 2000 and 2002.RESULTS: We found the test-retest agreement of NOMAS to be 'fair' to 'almost perfect' (Cohen's kappa [kappa] between 0.33 and 0.94), whereas the inter-rater agreement with respect to the diagnosis was 'moderate' to 'substantial' (Cohen's kappa, between 0.40 and 0.65). As a diagnostic tool, however, the current version of NOMAS cannot be used for both full-term and preterm infants. For a measuring instrument such as NOMAS, one should aim at reliability coefficients for inter-rater and test-retest agreement of at least 0.8. A Cohen's kappa of 0.6 or less we find unacceptable. Nonetheless, by observing sucking and swallowing according to a protocol much useful information can be gathered about the development of an infant's sucking skills. For instance, whether the infant is able to co-ordinate sucking and swallowing, whether the infant can maintain sucking, swallowing and breathing during the continuous phase and whether the infant is able to suck rhythmically with equally long bursts. In addition, NOMAS offers useful aids for intervention.CONCLUSIONS: NOMAS should be re-adjusted in order to improve inter-rater agreement, and at the same time current insights into the development of sucking and swallowing should be incorporated in the method.
