The interplay between sound and vision is a key determinant of human perception. With the development of Virtual Reality (VR) technologies and their commercial applications, there is emergent need to better understand how audio-visual signals manipulated in virtual environments influence perception and human behaviour. The current study addresses this challenge in simulated VR environments mirroring real life scenarios. In particular, we investigated the parameters that might enhance perception, and thus VR experiences when sound and vision are manipulated. A VR museum was created mimicking a real art gallery featuring Japanese paintings. Participants were exposed to the gallery via Samsung Gear VR, head mounted display, and could freely walk in. To half of the participants newly composed music clips were played, during the VR gallery visit. The other participants were exposed to the same environment, but no music was played (control condition). The results showed that music played altered the way people are engaged in, perceive and experience the VR art gallery. Opposite to our expectation, the VR experience was liked more when no music was played. The naturalness and presence were perceived to be relatively high, and did not differ significantly depending on whether music was played or not. Regression modelling further explored the relationship between the parameters hypothesised to influence the VR experiences. The findings are summarised in a theoretical model. The study outcomes could be implemented to successfully develop efficient VR applications for art and entertainment.
Creating and testing the first Brand Segmentation Model in Augmented Reality using Microsoft Hololens. Sanoma together with SAMR launched an online brand segmentation tool based on large scale research, The brand model uses several brand values divided over three axes. However they cannot be displayed clearly in a 2D model. The space of BSR Quality Planner can be seen as a 3-dimensional meaningful space that is defined by the terms used to typify the brands. The third axis concerns a behaviour-based dimension: from ‘quirky behaviour’ to ‘standardadjusted behaviour’ (respectful, tolerant, solidarity). ‘Virtual/augmented reality’ does make it possible to clearly display (and experience) 3D. The Academy for Digital Entertainment (ADE) of Breda University of Applied Sciences has created the BSR Quality Planner in Virtual Reality – as a hologram. It’s the world’s first segmentation model in AR. Breda University of Applied Sciences (professorship Digital Media Concepts) has deployed hologram technology in order to use and demonstrate the planning tool in 3D. The Microsoft HoloLens can be used to experience the model in 3D while the user still sees the actual surroundings (unlike VR, with AR the space in which the user is active remains visible). The HoloLens is wireless, so the user can easily walk around the hologram. The device is operated using finger gestures, eye movements or voice commands. On a computer screen, other people who are present can watch along with the user. Research showed the added value of the AR model.Partners:Sanoma MediaMarketResponse (SAMR)
The AR in Staged Entertainment project focuses on utilizing immersive technologies to strengthen performances and create resiliency in live events. In this project The Experiencelab at BUas explores this by comparing live as well as pre-recorded events that utilize Augmented Reality technology to provide an added layer to the experience of the user. Experiences will be measured among others through observational measurements using biometrics. This projects runs in the Experience lab of BUas with partners The Effenaar and 4DR Studio and is connected to the networks and goals related to Chronosphere, Digireal and Makerspace. Project is powered by Fieldlab Events (PPS / ClickNL)..
This project develops a European network for transdisciplinary innovation in artistic engagement as a catalyst for societal transformation, focusing on immersive art. It responds to the professionals in the field’s call for research into immersive art’s unique capacity to ‘move’ people through its multisensory, technosocial qualities towards collective change. The project brings together experts leading state-of-the-art research and practice in related fields with an aim to develop trajectories for artistic, methodological, and conceptual innovation for societal transformation. The nascent field of immersive art, including its potential impact on society, has been identified as a priority research area on all local-to-EU levels, but often suffers from the common (mis)perception as being technological spectacle prioritising entertainment values. Many practitioners create immersive art to enable novel forms of creative engagement to address societal issues and enact change, but have difficulty gaining recognition and support for this endeavour. A critical challenge is the lack of knowledge about how their predominantly sensuous and aesthetic experience actually lead to collective change, which remains unrecognised in the current systems of impact evaluation predicated on quantitative analysis. Recent psychological insights on awe as a profoundly transformative emotion signals a possibility to address this challenge, offering a new way to make sense of the transformational effect of directly interacting with such affective qualities of immersive art. In parallel, there is a renewed interest in the practice of cultural mediation, which brings together different stakeholders to facilitate negotiation towards collective change in diverse domains of civic life, often through creative engagements. Our project forms strategic grounds for transdisciplinary research at the intersection between these two developments. We bring together experts in immersive art, psychology, cultural mediation, digital humanities, and design across Europe to explore: How can awe-experiences be enacted in immersive art and be extended towards societal transformation?
