Background: Quality Improvement (QI) is the key for every healthcare organization. QI programs may help healthcare professionals to develop the needed skills for interprofessional collaboration through interprofessional education. Furthermore, the role of diversity in QI teams is not yet fully understood. This evaluation study aimed to obtain in-depth insights into the expectations and experiences of different stakeholders of a hospital-wide interprofessional QI program. Methods: This qualitative study builds upon 20 semi-structured interviews with participants and two focus groups with the coaches and program advisory board members of this QI program. Data were coded and analyzed using thematic analysis. Results: Three themes emerged from the analysis: “interprofessional education”, “networking” and “motivation: presence with pitfalls”. Working within interprofessional project groups was valuable, because participants with different experiences and skills helped to move the QI project forward. It was simultaneously challenging because IPE was new and revealed problems with hierarchy, communication and planning. Networking was also deemed valuable, but a shared space to keep in contact after finalizing the program was missing. The participants were highly motivated to finish their QI project, but they underestimated the challenges. Conclusions: A hospital-wide QI program must explicitly pay attention to interprofessional collaboration and networking. Leaders of the QI program must cherish the motivation of the participants and make sure that the QI projects are realistic.
Explainable Artificial Intelligence (XAI) aims to provide insights into the inner workings and the outputs of AI systems. Recently, there’s been growing recognition that explainability is inherently human-centric, tied to how people perceive explanations. Despite this, there is no consensus in the research community on whether user evaluation is crucial in XAI, and if so, what exactly needs to be evaluated and how. This systematic literature review addresses this gap by providing a detailed overview of the current state of affairs in human-centered XAI evaluation. We reviewed 73 papers across various domains where XAI was evaluated with users. These studies assessed what makes an explanation “good” from a user’s perspective, i.e., what makes an explanation meaningful to a user of an AI system. We identified 30 components of meaningful explanations that were evaluated in the reviewed papers and categorized them into a taxonomy of human-centered XAI evaluation, based on: (a) the contextualized quality of the explanation, (b) the contribution of the explanation to human-AI interaction, and (c) the contribution of the explanation to human- AI performance. Our analysis also revealed a lack of standardization in the methodologies applied in XAI user studies, with only 19 of the 73 papers applying an evaluation framework used by at least one other study in the sample. These inconsistencies hinder cross-study comparisons and broader insights. Our findings contribute to understanding what makes explanations meaningful to users and how to measure this, guiding the XAI community toward a more unified approach in human-centered explainability.
MULTIFILE
Background: Collaboration between parents and speech and language therapists (SLTs) is seen as a key element in family-centred models. Collaboration can have positive impacts on parental and children’s outcomes. However, collaborative practice has not been well described and researched in speech and language therapy for children and may not be easy to achieve. It is important that we gain a deeper understanding of collaborative practice with parents, how it can be achieved and how it can impact on outcomes. This understanding could support practitioners in daily practice with regard to achieving collaborative practice with parents in different contexts. Aims: To set a research agenda on collaborative practice between parents and SLTs in order to generate evidence regarding what works, how, for whom, in what circumstances and to what extent. Methods & Procedures: A realist evaluation approach was used to make explicit what collaborative practice with parents entails. The steps suggested by the RAMESES II project were used to draft a preliminary programme theory about collaborative practice between parents and SLTs. This process generates explicit hypotheses which form a potential research agenda. Discussion & Conclusions: A preliminary programme theory of collaborative practice with parents was drafted using a realist approach. Potential contextual factors (C), mechanisms (M) and outcomes (O) were presented which could be configured into causal mechanisms to help explain what works for whom in what circumstances. CMO configurations were drafted, based on the relevant literature, which serve as exemplars to illustrate how this methodology could be used. In order to debate, test and expand our hypothesized programme theory for collaborative practice with parents, further testing against a broader literature is required alongside research to explore the functionality of the configurations across contexts. This paper highlights the importance of further research on collaborative practice with parents and the potential value of realist evaluation methodology
Size measurement plays an essential role for micro-/nanoparticle characterization and property evaluation. Due to high costs, complex operation or resolution limit, conventional characterization techniques cannot satisfy the growing demand of routine size measurements in various industry sectors and research departments, e.g., pharmaceuticals, nanomaterials and food industry etc. Together with start-up SeeNano and other partners, we will develop a portable compact device to measure particle size based on particle-impact electrochemical sensing technology. The main task in this project is to extend the measurement range for particles with diameters ranging from 20 nm to 20 um and to validate this technology with realistic samples from various application areas. In this project a new electrode chip will be designed and fabricated. It will result in a workable prototype including new UMEs (ultra-micro electrode), showing that particle sizing can be achieved on a compact portable device with full measuring range. Following experimental testing with calibrated particles, a reliable calibration model will be built up for full range measurement. In a further step, samples from partners or potential customers will be tested on the device to evaluate the application feasibility. The results will be validated by high-resolution and mainstream sizing techniques such as scanning electron microscopy (SEM), dynamic light scattering (DLS) and Coulter counter.
Nederland kent ongeveer 220.000 bedrijfsongevallen per jaar (met 60 mensen die overlijden). Vandaar dat elke werkgever verplicht is om bedrijfshulpverlening (BHV) te organiseren, waaronder BHV-trainingen. Desondanks brengt slechts een-derde van alle bedrijven de arbeidsrisico’s in kaart via een Risico-Inventarisatie & Evaluatie (RI&E) en blijft het aandeel werknemers met een arbeidsongeval hoog. Daarom wordt er continu geïnnoveerd om BHV-trainingen te optimaliseren, o.a. door middel van Virtual Reality (VR). VR is niet nieuw, maar is wel doorontwikkeld en betaalbaarder geworden. VR biedt de mogelijkheid om veilige realistische BHV-noodsimulaties te ontwikkelen waarbij de cursist het gevoel heeft daar echt te zijn. Ondanks de toename in VR-BHV-trainingen, is er weinig onderzoek gedaan naar het effect van VR in BHV-trainingen en zijn resultaten tegenstrijdig. Daarnaast zijn er nieuwe technologische ontwikkelingen die het mogelijk maken om kijkgedrag te meten in VR m.b.v. Eye-Tracking. Tijdens een BHV-training kan met Eye-Tracking gemeten worden hoe een instructie wordt opgevolgd, of cursisten worden afgeleid en belangrijke elementen (gevaar en oplossingen) waarnemen tijdens de simulatie. Echter, een BHV-training met VR en Eye-Tracking (interacties) bestaat niet. In dit project wordt een prototype ontwikkeld waarin Eye-Tracking wordt verwerkt in een 2021 ontwikkelde VR-BHV-training, waarin noodsituaties zoals een kantoorbrand worden gesimuleerd (de BHVR-toepassing). Door middel van een experiment zal het prototype getest worden om zo voor een deel de vraag te beantwoorden in hoeverre en op welke manier Eye-Tracking in VR een meerwaarde biedt voor (RI&E) BHV-trainingen. Dit project sluit daarmee aan op het missie-gedreven innovatiebeleid ‘De Veiligheidsprofessional’ en helpt het MKB dat vaak middelen en kennis ontbreekt voor onderzoek naar effectiviteit rondom innovatieve-technologieën in educatie/training. Het project levert onder meer een prototype op, een productie-rapport en onderzoeks-artikel, en staat open voor nieuwe deelnemers bij het schrijven van een grotere aanvraag rondom de toepassing en effect van VR en Eye-Tracking in BHV-trainingen.
The Netherlands has approximately 220,000 industrial accidents per year (with 60 people who die). That is why every employer is obliged to organize company emergency response (BHV), including emergency response training. Despite this, only one-third of all companies map out their occupational risks via a Risk Inventory & Evaluation (RI&E) and the share of employees with an occupational accident remains high. That is why there is continuous innovation to optimize emergency response training, for example by means of Virtual Reality (VR). VR is not new, but it has evolved and become more affordable. VR offers the possibility to develop safe realistic emergency response simulations where the student has the feeling that they are really there. Despite the increase in VR-BHV training, little research has been done on the effect of VR in ER training and results are contradictory. In addition, there are new technological developments that make it possible to measure viewing behavior in VR using Eye-Tracking. During an emergency response training, Eye-Tracking can be used to measure how an instruction is followed, whether students are distracted and observe important elements (danger and solutions) during the simulation. However, emergency response training with VR and Eye-Tracking (interactions) does not exist. In this project, a prototype is being developed in which Eye-Tracking is incorporated into a VR-BHV training that was developed in 2021, in which emergency situations such as an office fire are simulated (the BHVR application). The prototype will be tested by means of an experiment in order to partly answer the question to what extent and in what way Eye-Tracking in VR offers added value for (RI&E) emergency response training. This project is therefore in line with the mission-driven innovation policy 'The Safety Professional' and helps SMEs that often lack resources and knowledge for research into the effectiveness of innovative technologies in education/training. The project will include a prototype, a production report and research article, and is open to new participants when writing a larger application about the application and effect of VR and Eye-Tracking in emergency response training.
