product

CUBE: Conversational User-Interface-Based Embodiment: developing a digital humans embodiment for conversational agents: design, implementation, and integration challenges.


Description

Our study introduces an open general-purpose platform for the embodiment of conversational AI systems. Conversational User-interface Based Embodiment (CUBE) is designed to streamline the integration of embodied solutions into text-based dialog managers, providing flexibility for customization depending on the specific use case and application. CUBE is responsible for naturally interacting with users by listening, observing, and responding to them. A detailed account of the design and implementation of the solution is provided, as well as a thorough examination of how it can be integrated by developers and AI dialogue manager integrators. Through interviews with developers, insight was gained into the advantages of such systems. Additionally, key areas that require further research were identified in the current challenges in achieving natural interaction between the user and the embodiments. CUBE bridges some of the gaps by providing controls to further develop natural non-verbal communication.


Part of project

    project

    VIBE (Virtual Humans in the Brabant Economy)

    Can computers talk like humans? Look like humans? Behave like humans? Project Virtual Humans in the Brabant Economy (VIBE) focuses on developing and testing virtual humans to make this happen. The virtual humans developed by VIBE will be able to communicate with normal people in a natural way, both verbal and non-verbal, and deliver a valuable contribution to the training of healthcare professionals. The agents developed by VIBE can be used in any training simulation in various instances, including virtual, mixed and augmented reality.VIBE agents are designed to also allow customization for other domains to enhance training and education programs even beyond the healthcare domain.Funding:EU EFRO, Province of Noord Brabant, municipalities.

    Finished