Living labs are complex multi-stakeholder collaborations that often employ a usercentred and design-driven methodology to foster innovation. Conventional management tools fall short in evaluating them. However, some methods and tools dedicated to living labs' special characteristics and goals have already been developed. Most of them are still in their testing phase. Those tools are not easily accessible and can only be found in extensive research reports, which are difficult to dissect. Therefore, this paper reviews seven evaluation methods and tools specially developed for living labs. Each section of this paper is structured in the following manner: tool’s introduction (1), who uses the tool (2), and how it should be used (3). While the first set of tools, namely “ENoLL 20 Indicators”, “SISCODE Self-assessment”, and “SCIROCCO Exchange Tool” assess a living lab as an organisation and are diving deeper into the organisational activities and the complex context, the second set of methods and tools, “FormIT” and “Living Lab Markers”, evaluate living labs’ methodologies: the process they use to come to innovations. The paper's final section presents “CheRRIes Monitoring and Evaluation Tool” and “TALIA Indicator for Benchmarking Service for Regions”, which assess the regional impact made by living labs. As every living lab is different regarding its maturity (as an organisation and in its methodology) and the scope of impact it wants to make, the most crucial decision when evaluating is to determine the focus of the assessment. This overview allows for a first orientation on worked-out methods and on possible indicators to use. It also concludes that the existing tools are quite managerial in their method and aesthetics and calls for designers and social scientists to develop more playful, engaging and (possibly) learning-oriented tools to evaluate living labs in the future. LinkedIn: https://www.linkedin.com/in/overdiek12345/ https://www.linkedin.com/in/mari-genova-17a727196/?originalSubdomain=nl
Background: Quality Improvement (QI) is the key for every healthcare organization. QI programs may help healthcare professionals to develop the needed skills for interprofessional collaboration through interprofessional education. Furthermore, the role of diversity in QI teams is not yet fully understood. This evaluation study aimed to obtain in-depth insights into the expectations and experiences of different stakeholders of a hospital-wide interprofessional QI program. Methods: This qualitative study builds upon 20 semi-structured interviews with participants and two focus groups with the coaches and program advisory board members of this QI program. Data were coded and analyzed using thematic analysis. Results: Three themes emerged from the analysis: “interprofessional education”, “networking” and “motivation: presence with pitfalls”. Working within interprofessional project groups was valuable, because participants with different experiences and skills helped to move the QI project forward. It was simultaneously challenging because IPE was new and revealed problems with hierarchy, communication and planning. Networking was also deemed valuable, but a shared space to keep in contact after finalizing the program was missing. The participants were highly motivated to finish their QI project, but they underestimated the challenges. Conclusions: A hospital-wide QI program must explicitly pay attention to interprofessional collaboration and networking. Leaders of the QI program must cherish the motivation of the participants and make sure that the QI projects are realistic.
Background: Peer review is at the heart of the scientific process. With the advent of digitisation, journals started to offer electronic articles or publishing online only. A new philosophy regarding the peer review process found its way into academia: the open peer review. Open peer review as practiced by BioMed Central (BMC) is a type of peer review where the names of authors and reviewers are disclosed and reviewer comments are published alongside the article. A number of articles have been published to assess peer reviews using quantitative research. However, no studies exist that used qualitative methods to analyse the content of reviewers’ comments. Methods: A focused mapping review and synthesis (FMRS) was undertaken of manuscripts reporting qualitative research submitted to BMC open access journals from 1 January – 31 March 2018. Free-text reviewer comments were extracted from peer review reports using a 77-item classification system organised according to three key dimensions that represented common themes and sub-themes. A two stage analysis process was employed. First, frequency counts were undertaken that allowed revealing patterns across themes/sub-themes. Second, thematic analysis was conducted on selected themes of the narrative portion of reviewer reports. Results: A total of 107 manuscripts submitted to nine open-access journals were included in the FMRS. The frequency analysis revealed that among the 30 most frequently employed themes “writing criteria” (dimension II) is the top ranking theme, followed by comments in relation to the “methods” (dimension I). Besides that, some results suggest an underlying quantitative mindset of reviewers. Results are compared and contrasted in relation to established reporting guidelines for qualitative research to inform reviewers and authors of frequent feedback offered to enhance the quality of manuscripts. Conclusions: This FMRS has highlighted some important issues that hold lessons for authors, reviewers and editors. We suggest modifying the current reporting guidelines by including a further item called “Degree of data transformation” to prompt authors and reviewers to make a judgment about the appropriateness of the degree of data transformation in relation to the chosen analysis method. Besides, we suggest that completion of a reporting checklist on submission becomes a requirement.
Due to societal developments, like the introduction of the ‘civil society’, policy stimulating longer living at home and the separation of housing and care, the housing situation of older citizens is a relevant and pressing issue for housing-, governance- and care organizations. The current situation of living with care already benefits from technological advancement. The wide application of technology especially in care homes brings the emergence of a new source of information that becomes invaluable in order to understand how the smart urban environment affects the health of older people. The goal of this proposal is to develop an approach for designing smart neighborhoods, in order to assist and engage older adults living there. This approach will be applied to a neighborhood in Aalst-Waalre which will be developed into a living lab. The research will involve: (1) Insight into social-spatial factors underlying a smart neighborhood; (2) Identifying governance and organizational context; (3) Identifying needs and preferences of the (future) inhabitant; (4) Matching needs & preferences to potential socio-techno-spatial solutions. A mixed methods approach fusing quantitative and qualitative methods towards understanding the impacts of smart environment will be investigated. After 12 months, employing several concepts of urban computing, such as pattern recognition and predictive modelling , using the focus groups from the different organizations as well as primary end-users, and exploring how physiological data can be embedded in data-driven strategies for the enhancement of active ageing in this neighborhood will result in design solutions and strategies for a more care-friendly neighborhood.
The Dutch main water systems face pressing environmental, economic and societal challenges due to climatic changes and increased human pressure. There is a growing awareness that nature-based solutions (NBS) provide cost-effective solutions that simultaneously provide environmental, social and economic benefits and help building resilience. In spite of being carefully designed and tested, many projects tend to fail along the way or never get implemented in the first place, wasting resources and undermining trust and confidence of practitioners in NBS. Why do so many projects lose momentum even after a proof of concept is delivered? Usually, failure can be attributed to a combination of eroding political will, societal opposition and economic uncertainties. While ecological and geological processes are often well understood, there is almost no understanding around societal and economic processes related to NBS. Therefore, there is an urgent need to carefully evaluate the societal, economic, and ecological impacts and to identify design principles fostering societal support and economic viability of NBS. We address these critical knowledge gaps in this research proposal, using the largest river restoration project of the Netherlands, the Border Meuse (Grensmaas), as a Living Lab. With a transdisciplinary consortium, stakeholders have a key role a recipient and provider of information, where the broader public is involved through citizen science. Our research is scientifically innovative by using mixed methods, combining novel qualitative methods (e.g. continuous participatory narrative inquiry) and quantitative methods (e.g. economic choice experiments to elicit tradeoffs and risk preferences, agent-based modeling). The ultimate aim is to create an integral learning environment (workbench) as a decision support tool for NBS. The workbench gathers data, prepares and verifies data sets, to help stakeholders (companies, government agencies, NGOs) to quantify impacts and visualize tradeoffs of decisions regarding NBS.
Electronic Sports (esports) is a form of digital entertainment, referred to as "an organised and competitive approach to playing computer games". Its popularity is growing rapidly as a result of an increased prevalence of online gaming, accessibility to technology and access to elite competition.Esports teams are always looking to improve their performance, but with fast-paced interaction, it can be difficult to establish where and how performance can be improved. While qualitative methods are commonly employed and effective, their widespread use provides little differentiation among competitors and struggles with pinpointing specific issues during fast interactions. This is where recent developments in both wearable sensor technology and machine learning can offer a solution. They enable a deep dive into player reactions and strategies, offering insights that surpass traditional qualitative coaching techniquesBy combining insights from gameplay data, team communication data, physiological measurements, and visual tracking, this project aims to develop comprehensive tools that coaches and players can use to gain insight into the performance of individual players and teams, thereby aiming to improve competitive outcomes. Societal IssueAt a societal level, the project aims to revolutionize esports coaching and performance analysis, providing teams with a multi-faceted view of their gameplay. The success of this project could lead to widespread adoption of similar technologies in other competitive fields. At a scientific level, the project could be the starting point for establishing and maintaining further collaboration within the Dutch esports research domain. It will enhance the contribution from Dutch universities to esports research and foster discussions on optimizing coaching and performance analytics. In addition, the study into capturing and analysing gameplay and player data can help deepen our understanding into the intricacies and complexities of teamwork and team performance in high-paced situations/environments. Collaborating partnersTilburg University, Breda Guardians.
