In this whitepaper (available in Dutch and English) some practical tips for sensory and consumer research during product development are provided.
MULTIFILE
This pilot study explores the possibility of cognitive training software Neurotracker (NT), to have potential beneficial effects for Traumatic Brain Injury patients with Sensory Processing Disorder. Five subjects with TBI and SPD trained for 5 weeks/21 sessions with Neurotracker. Pre-post training cognitive tests (WAIS TMTA, TMTB, LNS) and surveys were conducted to measure possible cognitive differences with no statistical significant results. However, significant improvement in Neurotracker scores were found. =2.73, SD = 0.55) and positive changes associated with attention attention span, divided attention, (multiple) object tracking and motion sickness. LinkedIn: https://www.linkedin.com/in/bernard-de-roosz-28b96b125/
DOCUMENT
Different inputs from a multisensory object or event are often integrated into a coherent and unitary percept, despite differences in sensory formats, neural pathways, and processing times of the involved modalities. Presumably, multisensory integration occurs if the cross-modal inputs are presented within a certain window of temporal integration where inputs are perceived as being simultaneous. Here, we examine the role of ongoing neuronal alpha (i.e. 10-Hz) oscillations in multimodal synchrony perception. While EEG was measured, participants performed a simultaneity judgement task with visual stimuli preceding auditory ones. At stimulus onset asynchronies (SOA's) of 160–200 ms, simultaneity judgements were around 50%. For trials with these SOA's, occipital alpha power was smaller preceding correct judgements, and the individual alpha frequency was correlated with the size of the temporal window of integration. In addition, simultaneity judgements were modulated as a function of oscillatory phase at 12.5 Hz, but the latter effect was only marginally significant. These results support the notion that oscillatory neuronal activity in the alpha frequency range, which has been taken to shape perceptual cycles, is instrumental in multisensory perception.
LINK
This project develops a European network for transdisciplinary innovation in artistic engagement as a catalyst for societal transformation, focusing on immersive art. It responds to the professionals in the field’s call for research into immersive art’s unique capacity to ‘move’ people through its multisensory, technosocial qualities towards collective change. The project brings together experts leading state-of-the-art research and practice in related fields with an aim to develop trajectories for artistic, methodological, and conceptual innovation for societal transformation. The nascent field of immersive art, including its potential impact on society, has been identified as a priority research area on all local-to-EU levels, but often suffers from the common (mis)perception as being technological spectacle prioritising entertainment values. Many practitioners create immersive art to enable novel forms of creative engagement to address societal issues and enact change, but have difficulty gaining recognition and support for this endeavour. A critical challenge is the lack of knowledge about how their predominantly sensuous and aesthetic experience actually lead to collective change, which remains unrecognised in the current systems of impact evaluation predicated on quantitative analysis. Recent psychological insights on awe as a profoundly transformative emotion signals a possibility to address this challenge, offering a new way to make sense of the transformational effect of directly interacting with such affective qualities of immersive art. In parallel, there is a renewed interest in the practice of cultural mediation, which brings together different stakeholders to facilitate negotiation towards collective change in diverse domains of civic life, often through creative engagements. Our project forms strategic grounds for transdisciplinary research at the intersection between these two developments. We bring together experts in immersive art, psychology, cultural mediation, digital humanities, and design across Europe to explore: How can awe-experiences be enacted in immersive art and be extended towards societal transformation?
This project aims to develop a measurement tool to assess the inclusivity of experiences for people with varying challenges and capabilities on the auditory spectrum. In doing so, we performed an in-depth exploration of scientific literature and findings from previous projects by Joint Projects. Based on this, we developed an initial conceptual model that focuses on sensory perception, emotion, cognition, and e[ort in relation to hearing and fatigue. Within, this model a visitor attraction is seen as an “experienscape” with four key elements: content, medium, context, and individual. In co-creative interviews with experts by experience with varying challenges on the auditory spectrum, they provided valuable insights that led to a significant expansion of this initial model. This was a relevant step, as in the scientific and professional literature, little is known about the leisure experiences of people with troubled hearing. For example, personal factors such as a person’s attitude toward their own hearing loss and the social dynamics within their group turned out to greatly influence the experience. The revised model was then applied in a case study at Apenheul, focusing on studying differences in experience of their gorilla presentation amongst people with varying challenges on the auditory spectrum.Societal issueThe Netherlands is one of the countries in Europe with the highest density of visitor attractions. Despite this abundance, many visitor attractions are not fully accessible to everyone, particularly to visitors with disabilities who sometimes are not eligible to ride due to safety concerns, yet when eligible generally still encounter numerous barriers. Accessibility of visitor attractions can be approached in various ways. However, because the focus often lies on operational and technical aspects (e.g., reducing stimuli at certain times of the day by turning o[ music, o[ering alternative wheelchair entrances), strategic and community-focused approaches are often overlooked. More importantly, there is also a lack of attention to the experience of visitors with disabilities. This becomes apparent from several studies from Joint Projects, where visitor attractions are being visited together with experts by experience with various disabilities. Nevertheless, experience is often being regarded as the 'core product' of the leisure sector. The right to meet, discover, develop, relax and thus enjoy this core product is hindered for many people with disabilities due to a lack of knowledge, inaccessibility (physical, digital, social, communicative as well as financial) and discrimination in society. Additionally, recreation entrepreneurs still face a significant gap in reaching the potential market of guests with disabilities and their networks. Thus, despite the numerous initiatives in the leisure sector aimed at improving accessibility on technical and operational fronts, often people with disabilities are still not being able to experience the same kind of enjoyment as those without. These observations form the pressing impetus for initiating the current research project, tapping into the numerous opportunities for learning, development and growth on making leisure offer more inclusive.Benefit to societyIn total, the current project approach comes with a number of enrichments in terms of both knowledge and methodology: a mixed-methods approach that allows for comparing data from different sources to obtain a more complete picture of the experience; a methodological co-design process that honours the 'nothing about us without us' principle; and benchmarking for a group (i.e., people with challenges on the auditory spectrum) that despite the size of its population has thus far mostly been overlooked.
Inside Out is an innovative research project that translates cutting-edge microbiome science into immersive, multisensory experiences aimed at long-term behavioral and mental health transformation. Combining extended reality (XR), speculative gastronomy, and narrative therapy, the project enables participants to explore their inner microbiome landscape through taste, smell, touch, and interactive storytelling. This pioneering methodology connects gut-brain science with emotional and sensory engagement. Participants experience their bodies from the inside out, cultivating a visceral understanding of the symbiotic microbial worlds within us. The project includes AI-generated "drinkable memories," microbiome-inspired food designs, haptic-olfactory VR environments, and robotic interactions that choreograph the body as terrain. Developed in collaboration with designers from Polymorf, producer Studio Biarritz, psychiatrist-researcher Anja Lok, and microbiome scientists from Amsterdam UMC and the Amsterdam Microbiome Expertise Center, Inside Out bridges scientific rigor with artistic expression. The project seeks to: • Increase embodied understanding of the microbiome’s role in health and well-being • Shift public perception from hygiene-based fear to ecological thinking • Inspire behavioral change related to food, gut health, and mental resilience The outcomes are designed to reach a large audience and implementation in science museums, art-science festivals, and educational programs, with a view toward future clinical applications in preventive healthcare and mental well-being. By making the invisible microbiome tangible, Inside Out aims not only to inform, but to transform—redefining how we relate to the ecosystems within us.
