Background: A pragmatic, stepped wedge trial design can be an appealing design to evaluate complex interventions in real-life settings. However, there are certain pitfalls that need to be considered. This paper reports on the experiences and lessons learned from the conduct of a cluster randomized, stepped wedge trial evaluating the effect of the Hospital Elder Life Program (HELP) in a Dutch hospital setting to prevent older patients from developing delirium. Methods: We evaluated our trial which was conducted in eight departments in two hospitals in hospitalized patients aged 70 years or older who were at risk for delirium by reflecting on the assumptions that we had and on what we intended to accomplish when we started, as compared to what we actually realized in the different phases of our study. Lessons learned on the design, the timeline, the enrollment of eligible patients and the use of routinely collected data are provided accompanied by recommendations to address challenges. Results: The start of the trial was delayed which caused subsequent time schedule problems. The requirement for individual informed consent for a quality improvement project made the inclusion more prone to selection bias. Most units experienced major difficulties in including patients, leading to excluding two of the eight units from participation. This resulted in failing to include a similar number of patients in the control condition versus the intervention condition. Data on outcomes routinely collected in the electronic patient records were not accessible during the study, and appeared to be often missing during analyses. Conclusions: The stepped wedge, cluster randomized trial poses specific risks in the design and execution of research in real-life settings of which researchers should be aware to prevent negative consequences impacting the validity of their results. Valid conclusions on the effectiveness of the HELP in the Dutch hospital setting are hampered by the limited quantity and quality of routine clinical data in our pragmatic trial. Executing a stepped wedge design in a daily practice setting using routinely collected data requires specific attention to ethical review, flexibility, a spacious time schedule, the availability of substantial capacity in the research team and early checks on the data availability and quality.
DOCUMENT
Severe mental illness (SMI) imposes a significant burden on individuals, resulting in long-lasting symptoms, lower social functioning and impaired physical health. Physical activity (PA) interventions can improve both mental and physical health and care workers can serve as healthy role models. Yet, individuals with SMI face barriers to PA participation. This study evaluated the effects of Muva, and assessed if mental health worker’s (MHW) characteristics were associated with clients’ change in social functioning. Muva, an intervention package primarily created to increase PA of people with SMI, places a special focus on MHWs as they might play a key role in overcoming barriers. Other PA barrier-decreasing elements of Muva were a serious game app, lifestyle education, and optimization of the medication regime. Method: This study is a pragmatic stepped wedge cluster controlled trial. Controls received care as usual. Mixedeffects linear regressions were performed to assess changes in the primary outcome social functioning, and secondary outcomes quality of life, psychiatric symptoms, PA, body mass index, waist circumference, and blood pressure. Results: 84 people with SMI were included in three intervention clusters, and 38 people with SMI in the control cluster. Compared to the control condition, there was significant clinical improvement of social functioning in interpersonal communication (p=<0.01) and independent competence (p=<0.01) in people receiving Muva. These outcomes were not associated with MHW’s characteristics. There were no changes in the other outcome measures. Conclusions: Muva improved social functioning in people with SMI compared to care as usual.
DOCUMENT
Background: Early childhood caries is considered one of the most prevalent diseases in childhood, affecting almost half of preschool-age children globally. In the Netherlands, approximately one-third of children aged 5 years already have dental caries, and dental care providers experience problems reaching out to these children. Objective: Within the proposed trial, we aim to test the hypothesis that, compared to children who receive usual care, children who receive the Toddler Oral Health Intervention as add-on care will have a reduced cumulative caries incidence and caries incidence density at the age of 48 months. Methods: This pragmatic, 2-arm, individually randomized controlled trial is being conducted in the Netherlands and has been approved by the Medical Ethics Research Board of University Medical Center Utrecht. Parents with children aged 6 to 12 months attending 1 of the 9 selected well-baby clinics are invited to participate. Only healthy children (ie, not requiring any form of specialized health care) with parents that have sufficient command of the Dutch language and have no plans to move outside the well-baby clinic region are eligible. Both groups receive conventional oral health education in well-baby clinics during regular well-baby clinic visits between the ages of 6 to 48 months. After concealed random allocation of interventions, the intervention group also receives the Toddler Oral Health Intervention from an oral health coach. The Toddler Oral Health Intervention combines behavioral interventions of proven effectiveness in caries prevention. Data are collected at baseline, at 24 months, and at 48 months. The primary study endpoint is cumulative caries incidence for children aged 48 months, and will be analyzed according to the intention-to-treat principle. For children aged 48 months, the balance between costs and effects of the Toddler Oral Health Intervention will be evaluated, and for children aged 24 months, the effects of the Toddler Oral Health Intervention on behavioral determinants, alongside cumulative caries incidence, will be compared. Results: The first parent-child dyads were enrolled in June 2017, and recruitment was finished in June 2019. We enrolled 402 parent-child dyads. Conclusions: All follow-up interventions and data collection will be completed by the end of 2022, and the trial results are expected soon thereafter. Results will be shared at international conferences and via peer-reviewed publication.
LINK
This study evaluated the Toddler Oral Health Intervention (TOHI) for preventing early childhood caries (ECC) by 48 months. TOHI, an add-on to standard care in well-baby clinics (WBCs), aims to reduce ECC incidence and severity.
MULTIFILE
Abstract Background: People with severe mental illness (SMI) often suffer from long-lasting symptoms that negatively influence their social functioning, their ability to live a meaningful life, and participation in society. Interventions aimed at increasing physical activity can improve social functioning, but people with SMI experience multiple barriers to becoming physically active. Besides, the implementation of physical activity interventions in day-to-day practice is difficult. In this study, we aim to evaluate the effectiveness and implementation of a physical activity intervention to improve social functioning, mental and physical health. Methods: In this pragmatic stepped wedge cluster randomized controlled trial we aim to include 100 people with SMI and their mental health workers from a supported housing organization. The intervention focuses on increasing physical activity by implementing group sports activities, active guidance meetings, and a serious game to set physical activity goals. We aim to decrease barriers to physical activity through active involvement of the mental health workers, lifestyle courses, and a medication review. Participating locations will be divided into four clusters and randomization will decide the start of the intervention. The primary outcome is social functioning. Secondary outcomes are quality of life, symptom severity, physical activity, cardiometabolic risk factors, cardiorespiratory fitness, and movement disturbances with specific attention to postural adjustment and movement sequencing in gait. In addition, we will assess the implementation by conducting semi-structured interviews with location managers and mental health workers and analyze them by direct content analysis. Discussion: This trial is innovative since it aims to improve social functioning in people with SMI through a physical activity intervention which aims to lower barriers to becoming physically active in a real-life setting. The strength of this trial is that we will also evaluate the implementation of the intervention. Limitations of this study are the risk of poor implementation of the intervention, and bias due to the inclusion of a medication review in the intervention that might impact outcomes. Trial registration: This trial was registered prospectively in The Netherlands Trial Register (NTR) as NTR NL9163 on December 20, 2020. As the The Netherlands Trial Register is no longer available, the trial can now be found in the International Clinical Trial Registry Platform via: https:// trial search. who. int/ Trial2. aspx? Trial ID= NL9163.
DOCUMENT
Peer reviewed research paper SEFI Engineering Education congress 2018 Within higher engineering education, students have to learn to close knowledge gaps that arise in professional assignments, such as capstone projects. These knowledge gaps can be closed through simple inquiry, but can also require more rigorous research. Since professionals work under tight constraints, they face constant trade-offs between quality, risk and efficiency to find answers that are acceptable. This means engineers use pragmatic research tactics that aim for the highest chance to find answers that fit sufficiently to close knowledge gaps in order to solve the problem with optimal use of time and resources. The problem is that research and problem-solving literature richly supplies solid strategies suitable to plan the research in projects as a whole, but hardly supplies flexible tactics to search for information within a project. This paper reports pragmatic tactics that starting bachelor engineering professionals use to acquire sufficiently good answers to questions that arise in the context of their assignments. For this, we conducted semi-structured interviews among computer science engineers with three to five years of work experience. The study reveals three pragmatic tactics: concentric, iterative and probe-response. The ambition level of the project determines when questions are sufficiently answered, and we distinguish tree sufficiency levels: check for viable answer, boost critical demand and change the game. The aim of this research is to add a view that makes pragmatic research choices for novice engineers more open to discussion and realistic.
DOCUMENT
Abstract Background: Antipsychotic-induced Weight Gain (AiWG) is a debilitating and common adverse effect of antipsychotics. AiWG negatively impacts life expectancy, quality of life, treatment adherence, likelihood of developing type-2 diabetes and readmission. Treatment of AiWG is currently challenging, and there is no consensus on the optimal management strategy. In this study, we aim to evaluate the use of metformin for the treatment of AiWG by comparing metformin with placebo in those receiving treatment as usual, which includes a lifestyle intervention. Methods: In this randomized, double-blind, multicenter, placebo-controlled, pragmatic trial with a follow-up of 52 weeks, we aim to include 256 overweight participants (Body Mass Index (BMI) > 25 kg/m2) of at least 16years of age. Patients are eligible if they have been diagnosed with schizophrenia spectrum disorder and if they have been using an antipsychotic for at least three months. Participants will be randomized with a 1:1 allocation to placebo or metformin, and will be treated for a total of 26 weeks. Metformin will be started at 500 mg b.i.d. and escalated to 1000 mg b.i.d. 2 weeks thereafter (up to a maximum of 2000mg daily). In addition, all participants will undergo a lifestyle intervention as part of the usual treatment consisting of a combination of an exercise program and dietary consultations. The primary outcome measure is difference in body weight as a continuous trait between the two arms from treatment inception until 26 weeks of treatment, compared to baseline. Secondary outcome measures include: 1) Any element of metabolic syndrome (MetS); 2) Response, defined as ≥5% body weight loss at 26 weeks relative to treatment inception; 3) Quality of life; 4) General mental and physical health; and 5) Cost-effectiveness. Finally, we aim to assess whether genetic liability to BMI and MetS may help estimate the amount of weight reduction following initiation of metformin treatment. Discussion: The pragmatic design of the current trial allows for a comparison of the efficacy and safety of metformin in combination with a lifestyle intervention in the treatment of AiWG, facilitating the development of guidelines on the interventions for this major health problem.
DOCUMENT
OBJECTIVE: PRECIS - 2 is a tool that could improve design insight for trialists. Our aim was to validate the PRECIS - 2 tool, unlike its predecessor, testing the discriminant validity and inter-rater reliability.STUDY DESIGN AND SETTING: Over 80 international trialists, methodologists, clinicians and policymakers created PRECIS - 2 helping to ensure face and content validity. The inter-rater reliability of PREC IS - 2 was measured using 19 experienced trialists who used PRECIS - 2 to score a diverse sample of 15 RCT protocols. Discriminant validity was tested with two raters to independently determine if the trial protocols were more pragmatic or more explanatory, with scores from the 19 raters for the 15 trials as predictors of pragmatism.RESULTS: Inter-rater reliability was generally good, with seven out of nine domains having an ICC over 0.65. Flexibility (Adherence) and Recruitment had wide confidence intervals but raters found these difficult to rate and wanted more information. Each of the nine PRECIS - 2 domains could be used to differentiate between trials taking more pragmatic or more explanatory approaches with better than chance discrimination for all domains.CONCLUSION: We have assessed the validity and reliability of PRECIS - 2. An elaboration paper and website provide guidance to help future users of the tool which is continuing to be tested by trial teams, systematic reviewers and funders.
DOCUMENT
OBJECTIVE: The Pragmatic-Explanatory Continuum Indicator Summary (PRECIS) tool was designed to classify randomized clinical trials (RCT) as being more pragmatic or explanatory. We modified the PRECIS tool (called PRECIS-Review tool [PR-tool]) to grade individual trials and systematic reviews of trials. This should help policy makers, clinicians, researchers, and guideline developers to judge the applicability of individual trials and systematic reviews. STUDY DESIGN AND SETTING: To illustrate the usefulness and applicability of the PR-tool, we applied it to two systematic reviews. Each included RCT was scored on the 10 PRECIS domains on a scale of 1-5. After this scoring, a 10-domain average for each individual trial and for the systematic review a single domain average and an overall average was calculated. RESULTS: One review was more pragmatic with an average score of 3.7 (range, 2.9-4.6) on our PR-tool, whereas the other review was more explanatory with an average score of 1.9 (range, 1.1-3.3). The results also suggest that the included studies within each systematic review were rather uniform in their approach, although some domains seemed more prone to heterogeneity. CONCLUSION: The PR-tool provides a useful estimate that gives insight by estimating quantitatively how pragmatic each RCT in the review is, which methodological domains are pragmatic or explanatory, and how pragmatic the review is.
DOCUMENT
Abstract Background: Cardiovascular disease is the leading cause of the estimated 11–25 years reduced life expectancy for persons with serious mental illness (SMI). This excess cardiovascular mortality is primarily attributable to obesity, diabetes, hypertension, and dyslipidaemia. Obesity is associated with a sedentary lifestyle, limited physical activity and an unhealthy diet. Lifestyle interventions for persons with SMI seem promising in reducing weight and cardiovascular risk. The aim of this study is to evaluate the effectiveness and cost-effectiveness of a lifestyle intervention among persons with SMI in an outpatient treatment setting. Methods: The Serious Mental Illness Lifestyle Evaluation (SMILE) study is a cluster-randomized controlled trial including an economic evaluation in approximately 18 Flexible Assertive Community Treatment (FACT) teams in the Netherlands. The intervention aims at a healthy diet and increased physical activity. Randomisation takes place at the level of participating FACT-teams. We aim to include 260 outpatients with SMI and a body mass index of 27 or higher who will either receive the lifestyle intervention or usual care. The intervention will last 12 months and consists of weekly 2-h group meetings delivered over the first 6 months. The next 6 months will include monthly group meetings, supplemented with regular individual contacts. Primary outcome is weight loss. Secondary outcomes are metabolic parameters (waist circumference, lipids, blood pressure, glucose), quality of life and health related self-efficacy. Costs will be measured from a societal perspective and include costs of the lifestyle program, health care utilization, medication and lost productivity. Measurements will be performed at baseline and 3, 6 and 12 months. Discussion: The SMILE intervention for persons with SMI will provide important information on the effectiveness, cost-effectiveness, feasibility and delivery of a group-based lifestyle intervention in a Dutch outpatient treatment setting. Trial registration: Dutch Trial Registration NL6660, registration date: 16 November 2017.
DOCUMENT
