In 2021, Breda University of Applied Sciences – 7,000 students in the domains of Hotel Management, Facility Management, Games, Media, Logistics, Built Environment, Leisure & Events, and Tourism –discussed the impact of the emerging developments of immersive technologies (VR, AR, AI, Digital Twins) within the sectoral industries.This project, DigiReal – Digital Realities (DR) for Smart Industries - aimed to look beyond the diversity and variety of individual use cases to develop valuable concepts and innovations in methodologies and lab infrastructure, discussing questions: how do we create, use and experience DR sensibly, meaningfully, and responsibly?This report contains a coherent summary of the project with a lot of (domain) examples and technological developments. As a result, this report contains a BUas-wide research agenda on Digital Realities with a framework of overall, generic research questions, methodologies and ecosystems. This research has been financed by Regieorgaan SIA, part of the Dutch National Funding Organisation for Scientific Research (NWO)
DOCUMENT
Created for the 2019 Prague Quadrennial’s 36Q°, Blue Hour VR was a site-responsive mixed reality performative installation that placed the spectator, as experiencer, within a hybrid landscape of real- time three-dimensional computer graphics and 360-degree video. This article describes the design process, staging and experience of Blue Hour VR from the vantage point of its creators. Using a phenomenological perspective, the article discusses how Blue Hour VR staged presence and embodiment within an intermedial haptic experience. Blue Hour VR demonstrates how virtual reality technology can be harnessed by a mixed reality performance design, which includes both the material and virtual environment, creating a complex stratigraphy of intermedial textures and visual dramaturgies that co-exist inside, outside and in between perceptual realities. In doing so, the article aims to contribute to the limited body of work on mixed and virtual reality in the context of theatre and performance design.
DOCUMENT
The 6th issue of the Fresh Perspectives series takes you on a playful but serious journey along the issues at stake when designing a mixed reality experience in the context of theatre and performance. The publication features a selection of projects describing in detail the artistic design processes, as well as the challenges and opportunities brought about by the use of mixed reality technologies.Joris Weijdom, researcher and lecturer at the Professorship, wrote the key article and curated this publication.
DOCUMENT
This position paper presents a proposal for evaluating interaction with light in a mixed reality setup. Current processes of designing and testing new forms of user interaction (UI) for controlling lighting are long and end up being restricted in actually testing a small number of possible interactions. Apart from the apparent advantage of overcoming testing a small number of potential interactions, the advantages of a simulated environment lie in the fact that such an environment is fully controllable and adaptable to the researchers' needs. Finally, we sketch potential challenges of using a mixed reality setup for evaluating interaction with light.
LINK
The aim of this research is to explore the potential of Mixed Reality (MR) technologies for Operator Support in order to progress towards Industry 4.0 (I4.0) particularly for SMEs. Through a series of interventions and interviews conducted with local SMEs, potential use cases and their drawbacks have been identified. From this, insights were derived that serve as a starting point for conducting further experiments with MR technology in the smart manufacturing laboratory at the THUAS in Delft. The intervention consisted of a free form workshop in which the participants get ‘tinkering’ time to explore MR in their own work environment. The various levels of awareness were assessed in three stages: during an introductory interview, and after an instruction meeting and some ‘tinkering’. The study took place in the period from January 2022 to July 2022 with 10 local SMEs in the Netherlands. The results show that for all SMEs the awareness and understanding increased. The use cases identified by operators themselves concerned Quality Control, Diagnostics, Instruction, Specification and Improvement of Operations. Drawbacks foreseen related to Ergonomic Concerns, Resistance from operators, Technical considerations, Unavailability of MR device and an insufficient digital infrastructure to support MR in full extent. The use case most promising to the participants was further developed into a physical prototype for an ‘assisted assembly cell’ by which the aspects of ergonomics and the mentioned technical considerations could be analysed.
MULTIFILE
Virtual, Augmented and Mixed Reality technologies are embraced by designers, scholars and charities alike, some primarily for their entertaining properties, others also for the opportunities in education, motivation or persuasion. Applications with the latter objective, that of persuasion, are designed not only to be entertaining, but are also designed (or framed) to shape how players think and feel about issues in reality. However, despite the growing interest in the persuasive opportunities of these immersive technologies, we still lack the design strategies and best-practices that could support in the design of these ‘immersive persuasive games’. To address this still-unexplored and fragmented design space, we organize a design-oriented workshop that brings together academia and industry. The workshop is informed by a Research through Design approach in which the primary focus is to generate knowledge through designing. Participants design and evaluate ideas on-the-spot in an iterative manner using low-fidelity, life-size, prototyping and role-playing techniques, thereby mimicking an embodied interactive immersive environment. By reflecting on design practices and player experiences, we construct a body of knowledge, built exemplar work and distil best-practices to formulate design strategies for the design of immersive persuasive games.
DOCUMENT
In this study, we test the immersive character in an interactive content narrative developed for Microsoft HoloLens 2 mixed reality glasses in the dining context. We use retrospective think aloud protocol (RTAP) and galvanic skin response (GSR) to explore different types of immersion that can be created through interactive content narratives. Leaning on the core dimensions of the experience economy, we expand the current understanding on the role of immersion through integration of four immersive experience facilitators. The study revealed that these immersive experience facilitators occur simultaneously and can be enhanced through interactive content narrative design. Perceived novelty and curiosity were identified as key determinants to keep consumers engaged in the immersive experience and engage with the content. The study verifies the use of galvanic skin response in combination with retrospective think aloud protocol as a suitable approach to measure emotional engagement potential in interpreting consumers’ recollection of immersive experiences.
MULTIFILE
One of the key challenges in the rapid technological advance of Virtual Reality (VR) and Mixed Reality (MR) concerns the design of collaborative experiences. VR systems do not readily support team collaboration because they tend to focus on individual experiences and do not easily facilitate naturalistic collaboration. MR environments provide solutions for collaborative experiences, but establishing smooth communication between hardware components and software modules faces a major hurdle. This paper presents the background to and main challenges of an ongoing project on collaboration in an MR lab, aiming to design a serious 'team collaboration' game. To this end, we utilized a common game engine to engineer a cost-effective solution that would make the game playable in a configuration operated by WorldViz and Volfoni equipment. Evaluation of various solutions in the development process found a Unity 3D Cluster Rendering Beta solution to be the most cost-effective and successful.
DOCUMENT
One of the key challenges in the rapid technological advance of Virtual Reality (VR) and Mixed Reality (MR) concerns the design of collaborative experiences. VR systems do not readily support team collaboration because they tend to focus on individual experiences and do not easily facilitate naturalistic collaboration. MR environments provide solutions for collaborative experiences, but establishing smooth communication between hardware components and software modules faces a major hurdle. This paper presents the background to and main challenges of an ongoing project on collaboration in an MR lab, aiming to design a serious 'team collaboration' game. To this end, we utilized a common game engine to engineer a cost-effective solution that would make the game playable in a configuration operated by WorldViz and Volfoni equipment. Evaluation of various solutions in the development process found a Unity 3D Cluster Rendering Beta solution to be the most cost-effective and successful.
DOCUMENT
The use of immersive technologies has changed the consumption environment in which retailers provide services. We present findings from a study designed to investigate consumer responses toward a $17 million AI-embedded mixed reality (MR) exhibit in a retail/entertainment complex which combines advanced technology entertainment with retail shopping. Findings from our study demonstrate that the quality of AI (i.e., speech recognition and synthesis via machine learning) associated with an augmented object increases MR immersion associated with spatial immersion, MR enjoyment, and consumers’ perceptions of novel experiences. Collectively, these increase consumer engagement, and positively influence behavioral responses—specifically, purchase intentions and intentions to share experiences with social groups. Overall, findings from this study show that interactive AI and MR technology open new avenues to promote consumer engagement.
LINK
