This chapter considers the use of haptics for learning fundamental rhythm skills, including skills that depend on multi-limb coordination. Different sensory modalities have different strengths and weaknesses for the development of skills related to rhythm. For example, vision has low temporal resolution and performs poorly for tracking rhythms in real time, whereas hearing is highly accurate. However, in the case of multi-limbed rhythms, neither hearing nor sight is particularly well suited to communicating exactly which limb does what and when, or how the limbs coordinate. By contrast, haptics can work especially well in this area, by applying haptic signals independently to each limb. We review relevant theories, including embodied interaction and biological entrainment. We present a range of applications of the Haptic Bracelets, which are computer-controlled wireless vibrotactile devices, one attached to each wrist and ankle. Haptic pulses are used to guide users in playing rhythmic patterns that require multi-limb coordination. One immediate aim of the system is to support the development of practical rhythm skills and multi-limb coordination. A longer-term goal is to aid the development of a wider range of fundamental rhythm skills including recognising, identifying, memorising, retaining, analysing, reproducing, coordinating, modifying and creating rhythms—particularly multi-stream (i.e. polyphonic) rhythmic sequences. Empirical results are presented. We reflect on related work and discuss design issues for using haptics to support rhythm skills. Skills of this kind are essential not just to drummers and percussionists but also to keyboards’ players and more generally to all musicians who need a firm grasp of rhythm.
DOCUMENT
Lectorale rede waarin wordt ingegaan op de manier waarop de mens nu binnen zijn natuurlijke omgeving functioneert. Dit wordt getypeerd als een ‘mismatch’. Tegelijkertijd is de lector er ook van overtuigd dat de technologie uiteindelijk zorgt voor een beter leven.
DOCUMENT
Inside Out is an innovative research project that translates cutting-edge microbiome science into immersive, multisensory experiences aimed at long-term behavioral and mental health transformation. Combining extended reality (XR), speculative gastronomy, and narrative therapy, the project enables participants to explore their inner microbiome landscape through taste, smell, touch, and interactive storytelling. This pioneering methodology connects gut-brain science with emotional and sensory engagement. Participants experience their bodies from the inside out, cultivating a visceral understanding of the symbiotic microbial worlds within us. The project includes AI-generated "drinkable memories," microbiome-inspired food designs, haptic-olfactory VR environments, and robotic interactions that choreograph the body as terrain. Developed in collaboration with designers from Polymorf, producer Studio Biarritz, psychiatrist-researcher Anja Lok, and microbiome scientists from Amsterdam UMC and the Amsterdam Microbiome Expertise Center, Inside Out bridges scientific rigor with artistic expression. The project seeks to: • Increase embodied understanding of the microbiome’s role in health and well-being • Shift public perception from hygiene-based fear to ecological thinking • Inspire behavioral change related to food, gut health, and mental resilience The outcomes are designed to reach a large audience and implementation in science museums, art-science festivals, and educational programs, with a view toward future clinical applications in preventive healthcare and mental well-being. By making the invisible microbiome tangible, Inside Out aims not only to inform, but to transform—redefining how we relate to the ecosystems within us.
Psychosocial problems related to social isolation are a growing issue for wellbeing and health and have become a significant societal problem. This is especially relevant for children and adults with chronic illnesses and disabilities, and those spending extended periods in hospitals or permanently living in assisted living facilities. A lack of social relationships, social connectivity, and the inability to travel freely leads to feelings of isolation and loneliness. Loneliness interventions often use mediated environments to improve the feeling of connectedness. It has been proven that the utilization of haptic technologies enhances realism and the sense of presence in both virtual environments and telepresence in physical places by allowing the user to experience interaction through the sense of touch. However, the technology application is mostly limited to the experiences of serious games in professional environments and for-entertainment-gaming. This project aims to explore how haptic technologies can support the storytelling of semi-scripted experiences in VR to improve participants’ sense of presence and, therefore, the feeling of connectedness. By designing and prototyping the experience, the project aims to obtain insights and offer a better understanding of designing haptic-technology-supported storytelling and its potential to improve connectedness and become a useful tool in isolation interventions. The project will be conducted through the process of participants’ co-creation.
