In this paper, we report on the initial results of an explorative study that aims to investigate the occurrence of cognitive biases when designers use generative AI in the ideation phase of a creative design process. When observing current AI models utilised as creative design tools, potential negative impacts on creativity can be identified, namely deepening already existing cognitive biases but also introducing new ones that might not have been present before. Within our study, we analysed the emergence of several cognitive biases and the possible appearance of a negative synergy when designers use generative AI tools in a creative ideation process. Additionally, we identified a new potential bias that emerges from interacting with AI tools, namely prompt bias.
DOCUMENT
Abstract: Background: Chronic obstructive pulmonary disease (COPD) and asthma have a high prevalence and disease burden. Blended self-management interventions, which combine eHealth with face-to-face interventions, can help reduce the disease burden. Objective: This systematic review and meta-analysis aims to examine the effectiveness of blended self-management interventions on health-related effectiveness and process outcomes for people with COPD or asthma. Methods: PubMed, Web of Science, COCHRANE Library, Emcare, and Embase were searched in December 2018 and updated in November 2020. Study quality was assessed using the Cochrane risk of bias (ROB) 2 tool and the Grading of Recommendations, Assessment, Development, and Evaluation. Results: A total of 15 COPD and 7 asthma randomized controlled trials were included in this study. The meta-analysis of COPD studies found that the blended intervention showed a small improvement in exercise capacity (standardized mean difference [SMD] 0.48; 95% CI 0.10-0.85) and a significant improvement in the quality of life (QoL; SMD 0.81; 95% CI 0.11-1.51). Blended intervention also reduced the admission rate (relative ratio [RR] 0.61; 95% CI 0.38-0.97). In the COPD systematic review, regarding the exacerbation frequency, both studies found that the intervention reduced exacerbation frequency (RR 0.38; 95% CI 0.26-0.56). A large effect was found on BMI (d=0.81; 95% CI 0.25-1.34); however, the effect was inconclusive because only 1 study was included. Regarding medication adherence, 2 of 3 studies found a moderate effect (d=0.73; 95% CI 0.50-0.96), and 1 study reported a mixed effect. Regarding self-management ability, 1 study reported a large effect (d=1.15; 95% CI 0.66-1.62), and no effect was reported in that study. No effect was found on other process outcomes. The meta-analysis of asthma studies found that blended intervention had a small improvement in lung function (SMD 0.40; 95% CI 0.18-0.62) and QoL (SMD 0.36; 95% CI 0.21-0.50) and a moderate improvement in asthma control (SMD 0.67; 95% CI 0.40-0.93). A large effect was found on BMI (d=1.42; 95% CI 0.28-2.42) and exercise capacity (d=1.50; 95% CI 0.35-2.50); however, 1 study was included per outcome. There was no effect on other outcomes. Furthermore, the majority of the 22 studies showed some concerns about the ROB, and the quality of evidence varied. Conclusions: In patients with COPD, the blended self-management interventions had mixed effects on health-related outcomes, with the strongest evidence found for exercise capacity, QoL, and admission rate. Furthermore, the review suggested that the interventions resulted in small effects on lung function and QoL and a moderate effect on asthma control in patients with asthma. There is some evidence for the effectiveness of blended self-management interventions for patients with COPD and asthma; however, more research is needed. Trial Registration: PROSPERO International Prospective Register of Systematic Reviews CRD42019119894; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=119894
DOCUMENT
ChatGPT’s emergence and subsequent evolution as a generative artificial intelligence tool introduces new ways of assisting students with research design. Fostering research skills with undergraduate students presents opportunities and challenges for faculty to aid with drafting research plans, questions for investigation, and methods for conducting the research. While some educators rightfully voice concerns over the ethical aspects of such a tool, this article will draw on my own experiences using ChatGPT 4.0 as a tool in research project supervision. I demonstrate how to prompt ChatGPT to give useful suggestions that can be used as actionable feedback. I also discuss how to instruct students to include ChatGPT in their research methodology when using the tool to refine research questions.
LINK
De ontwikkelingen op het gebied van artificial intelligence (AI) gaan razendsnel. Hoe ga je als schooldirecteur om met de kansen en keerzijden van generatieve AI in het onderwijs, zoals ChatGPT? Onderwijskundige en specialist digitale geletterdheid Josien Boetje geeft uitleg, inzichten en tips om jou en je team te inspireren.
LINK
Learning Analytics en bias – Learning analytics richt zich op het meten en analyseren van studentgegevens om onderwijs te verbeteren. Bakker onderscheidt hierin verschillende niveaus, zoals student analytics en institutional analytics, en focust op inclusion analytics, waarin gekeken wordt naar kansengelijkheid. Bias – systematische vooroordelen in data – kan vooroordelen in algoritmen versterken en zo kansenongelijkheid veroorzaken. De onderzoeksmethode maakt gebruik van het 4/5-criterium, waarbij fairness in uitkomsten gemeten wordt door te kijken of de kansen voor de beschermde groep minstens 80% zijn van die van de bevoorrechte groep.Onderzoeksaanpak – Bakker gebruikt machine learning om retentie na het eerste studiejaar te voorspellen en onderzoekt vervolgens verschillen tussen groepen studenten, zoals mbo-en vwo-studenten. Hij volgt drie stappen: (1) Data voorbereiden en modellen bouwen: Data worden opgesplitst en opgeschoond om accurate voorspelmodellen te maken. (2) Variabelen analyseren: Invloed van kenmerken op uitkomsten wordt beoordeeld voor verschillende groepen. (3) Fairness berekenen: Het 4/5-criterium wordt toegepast op metrics zoals accuraatheid en statistische gelijkheid om bias en ongelijkheden te identificeren. Resultaten, aanbevelingen en vervolgonderzoek – Uit het onderzoek blijkt dat kansengelijkheid bij veel opleidingen ontbreekt, met name voor mannen en mbo-studenten, die een hogere kans op uitval hebben. Bakker adviseert sensitieve kenmerken zoals migratieachtergrond mee te nemen in analyses op basis van informed consent. Daarnaast pleit hij voor meer flexibiliteit in het beleid, geïnspireerd door maatregelen tijdens de coronacrisis, die een positief effect hadden op studiesucces.Toekomstvisie – Bakker benadrukt dat niet elke ongelijkheid het gevolg is van discriminatie en roept op tot data-informed interventies om sociale rechtvaardigheid in het onderwijs te bevorderen. Zijn methode wordt open access beschikbaar gesteld, zodat ook andere instellingen deze kunnen toepassen en kansengelijkheid systematisch en bewust kunnen onderzoeken.
DOCUMENT
Background: Peer review is at the heart of the scientific process. With the advent of digitisation, journals started to offer electronic articles or publishing online only. A new philosophy regarding the peer review process found its way into academia: the open peer review. Open peer review as practiced by BioMed Central (BMC) is a type of peer review where the names of authors and reviewers are disclosed and reviewer comments are published alongside the article. A number of articles have been published to assess peer reviews using quantitative research. However, no studies exist that used qualitative methods to analyse the content of reviewers’ comments. Methods: A focused mapping review and synthesis (FMRS) was undertaken of manuscripts reporting qualitative research submitted to BMC open access journals from 1 January – 31 March 2018. Free-text reviewer comments were extracted from peer review reports using a 77-item classification system organised according to three key dimensions that represented common themes and sub-themes. A two stage analysis process was employed. First, frequency counts were undertaken that allowed revealing patterns across themes/sub-themes. Second, thematic analysis was conducted on selected themes of the narrative portion of reviewer reports. Results: A total of 107 manuscripts submitted to nine open-access journals were included in the FMRS. The frequency analysis revealed that among the 30 most frequently employed themes “writing criteria” (dimension II) is the top ranking theme, followed by comments in relation to the “methods” (dimension I). Besides that, some results suggest an underlying quantitative mindset of reviewers. Results are compared and contrasted in relation to established reporting guidelines for qualitative research to inform reviewers and authors of frequent feedback offered to enhance the quality of manuscripts. Conclusions: This FMRS has highlighted some important issues that hold lessons for authors, reviewers and editors. We suggest modifying the current reporting guidelines by including a further item called “Degree of data transformation” to prompt authors and reviewers to make a judgment about the appropriateness of the degree of data transformation in relation to the chosen analysis method. Besides, we suggest that completion of a reporting checklist on submission becomes a requirement.
MULTIFILE
In this short article the author reflects on AI’s role in education by posing three questions about its application: choosing a partner, grading assignments, and replacing teachers. These questions prompt discussions on AI’s objectivity versus human emotional depth and creativity. The author argues that AI won’t replace teachers but will enhance those who embrace its potential while understanding its limits. True education, the author asserts, is about inspiring renewal and creativity, not merely transmitting knowledge, and cautions against letting AI define humanity’s future.
LINK
Prompt design can be understood similarly to query design, as a prompt aiming to understand cultural dimensions in visual research, forcing the AI to make sense of ambiguity as a way to understand its training dataset and biases ( Niederer, S. and Colombo, G., ‘Visual Methods for Digital Research’). It moves away from prompting engineering and efforts to make “code-like” prompts that suppress ambiguity and prevent the AI from bringing biases to the surface. Our idea is to keep the ambiguity present in the image descriptions like in natural language and let it flow through different stages (degrees) of the broken telephone dynamics. This way we have less control over the result or selection of the ideal result and more questions about the dynamics implicit in the biases present in the results obtained.Different from textual or mathematical results, in which prompt chains or asking the AI to explain how it got the result might be enough, images and visual methods assisted by AI demand new methods to deal with that. Exploring and developing a new approach for it is the main goal of this research project, particularly interested in possible biases and unexplored patterns in AI’s image affordances.How could we detect small biases in describing images and creating based on descriptions when it comes to AI? What exactly do the words written by AI when describing an image stand for? When detecting a ‘human’ or ‘science’, for example, what elements or archetypes are invisible between prompting, and the image created or described?Turning an AI’s image description into a new image could help us to have a glimpse behind the scenes. In the broken telephone game, small misperceptions between telling and hearing, coding and decoding, produce big divergences in the final result - and the cultural factors in between have been largely studied. To amplify and understand possible biases, we could check how this new image would be described by AI, starting a broken telephone cycle. This process could shed light not just into the gap between AI image description and its capacity to reconstruct images using this description as part of prompts, but also illuminate biases and patterns in AI image description and creation based on description.It is in line with previous projects on image clustering and image prompt analysis (see reference links), and questions such as identification of AI image biases, cross AI models analysis, reverse engineering through prompts, image clustering, and analysis of large datasets of images from online image and video-based platforms.The experiment becomes even more relevant in light of the results from recent studies (Shumailov et al., 2024) that show that AI models trained on AI generated data will eventually collapse.To frame this analysis, the proposal from Munn, Magee and Arora (2023) titled Unmaking AI Imagemaking introduces three methodological approaches for investigating AI image models: Unmaking the ecosystem, Unmaking the data and Unmaking the outputs.First, the idea of ecosystem was taken for these authors to describe socio-technical implications that surround the AI models: the place where they have been developed; the owners, partners, or supporters; and their interests, goals, and impositions. “Research has already identified how these image models internalize toxic stereotypes (Birnhane 2021) and reproduce forms of gendered and ethnic bias (Luccioni 2023), to name just two issues” (Munn et al., 2023, p. 2).There are also differences between the different models that currently dominate the market. Although Stable Diffusion seems to be the most open due to its origin, when working with images with this model, biases appear even more quickly than in other models. “In this framing, Stable Diffusion becomes an internet-based tool, which can be used and abused by “the people,” rather than a corporate product, where responsibility is clear, quality must be ensured, and toxicity must be mitigated” (Munn et al., 2023, p. 5).To unmaking the data, it is important to ask ourselves about the source and interests for the extraction of the data used. According to the description of their project “Creating an Ad Library Political Observatory”, “This project aims to explore diverse approaches to analyze and visualize the data from Meta’s ad library, which includes Instagram, Facebook, and other Meta products, using LLMs. The ultimate goal is to enhance the Ad Library Political Observatory, a tool we are developing to monitor Meta’s ad business.” That is to say, the images were taken from political advertising on the social network Facebook, as part of an observation process that seeks to make evident the investments in advertising around politics. These are prepared images in terms of what is seen in the background of the image, the position and posture of the characters, the visible objects. In general, we could say that we are dealing with staged images. This is important since the initial information that describes the AI is in itself a representation, a visual creation.
LINK
Technological developments have a major impact on how we live, work and learn together. Several authors refer to a fourth revolution in which robots and other intelligent systems take over an increasing number of the current (routine) tasks carried out by humans (Brynjolfsson & McAfee, 2014; Est et al., 2015; Ford, 2016; Helbing, 2014; Ross, 2017; Schwab, 2016). The relationship between man and machine will change fundamentally as a result. We are already noticing this shift, most specifically in the workplace. E.g., in the field of health care, digitalisation and robotisation can empower patients and their families. Hospitals are primarily intended for clients with complex care needs. This has consequences for the tasks carried out by nurses, who become more of a ‘care director’ or ‘research nurse’. Hospitals approach this in different ways, resulting in considerable diversity as to how these roles are fulfilled. These changes, albeit diverse, can also be seen in the roles of accountants, police officers and financial advisers at banks (Biemans, Sjoer, Brouwer and Potting, 2017). The traditional occupational profiles no longer exist and the essence of these professions is shifting. This does not make such occupations less attractive, but requires different qualities. The demand for more highly educated professionals who can carry out complex tasks in a creative and interdisciplinary manner will increase (McKinsey, 2017). Also, other social developments, such as migration and greenification, prompt us to ask new questions, resulting in new paths towards identifying solutions.
MULTIFILE
