Beyond the potential of new layers of urban infrastructure - sensor-laden networks, big data, artificial intelligence - to optimize cities functionally, lay promising opportunities to also use these technologies for new forms of social interactions. In an ongoing smart city development project, we explore the potential of distributed conversational speech interfaces in the social context of local urban communities. LinkedIn: https://www.linkedin.com/in/atjylha/ https://www.linkedin.com/in/josvanleeuwen/
DOCUMENT
Our study introduces an open general-purpose platform for the embodiment of conversational AI systems. Conversational User-interface Based Embodiment (CUBE) is designed to streamline the integration of embodied solutions into text-based dialog managers, providing flexibility for customization depending on the specific use case and application. CUBE is responsible for naturally interacting with users by listening, observing, and responding to them. A detailed account of the design and implementation of the solution is provided, as well as a thorough examination of how it can be integrated by developers and AI dialogue manager integrators. Through interviews with developers, insight was gained into the advantages of such systems. Additionally, key areas that require further research were identified in the current challenges in achieving natural interaction between the user and the embodiments. CUBE bridges some of the gaps by providing controls to further develop natural non-verbal communication.
LINK
In de afgelopen jaren hebben technologische ontwikkelingen de aard van dienstverlening ingrijpend veranderd (Huang & Rust, 2018). Technologie wordt steeds vaker ingezet om menselijke servicemedewerkers te vervangen of te ondersteunen (Larivière et al., 2017; Wirtz et al., 2018). Dit stelt dienstverleners in staat om meer klanten te bedienen met minder werknemers, waardoor de operationele efficiëntie toeneemt (Beatson et al., 2007). Deze operationele efficiëntie leidt weer tot lagere kosten en een groter concurrentievermogen. Ook voor klanten kan de inzet van technologie voordelen hebben, zoals betere toegankelijkheid en consistentie, tijd- en kostenbesparing en (de perceptie van) meer controle over het serviceproces (Curran & Meuter, 2005). Mede vanwege deze beoogde voordelen is de inzet van technologie in service-interacties de afgelopen twee decennia exponentieel gegroeid. De inzet van zogenaamde conversational agents is een van de belangrijkste manieren waarop dienstverleners technologie kunnen inzetten om menselijke servicemedewerkers te ondersteunen of vervangen (Gartner, 2021). Conversational agents zijn geautomatiseerde gesprekspartners die menselijk communicatief gedrag nabootsen (Laranjo et al., 2018; Schuetzler et al., 2018). Er bestaan grofweg drie soorten conversational agents: chatbots, avatars, en robots. Chatbots zijn applicaties die geen virtuele of fysieke belichaming hebben en voornamelijk communiceren via gesproken of geschreven verbale communicatie (Araujo, 2018;Dale, 2016). Avatars hebben een virtuele belichaming, waardoor ze ook non-verbale signalen kunnen gebruiken om te communiceren, zoals glimlachen en knikken (Cassell, 2000). Robots, ten slotte, hebben een fysieke belichaming, waardoor ze ook fysiek contact kunnen hebben met gebruikers (Fink, 2012). Conversational agents onderscheiden zich door hun vermogen om menselijk gedrag te vertonen in service-interacties, maar op de vraag ‘hoe menselijk is wenselijk?’ bestaat nog geen eenduidig antwoord. Conversational agents als sociale actoren Om succesvol te zijn als dienstverlener, is kwalitatief hoogwaardige interactie tussen servicemedewerkers en klanten van cruciaal belang (Palmatier et al., 2006). Dit komt omdat klanten hun percepties van een servicemedewerker (bijv. vriendelijkheid, bekwaamheid) ontlenen aan diens uiterlijk en verbale en non verbale gedrag (Nickson et al., 2005; Specht et al., 2007; Sundaram & Webster, 2000). Deze klantpercepties beïnvloeden belangrijke aspecten van de relatie tussen klanten en dienstverleners, zoals vertrouwen en betrokkenheid, die op hun beurt intentie tot gebruik, mond-tot-mondreclame, loyaliteit en samenwerking beïnvloeden (Hennig-Thurau, 2004; Palmatier et al., 2006).Er is groeiend bewijs dat de uiterlijke kenmerken en communicatieve gedragingen (hierna: menselijke communicatieve gedragingen) die percepties van klanten positief beïnvloeden, ook effectief zijn wanneer ze worden toegepast door conversational agents (B.R. Duffy, 2003; Holtgraves et al., 2007). Het zogenaamde ‘Computers Als Sociale Actoren’ (CASA paradigma vertrekt vanuit de aanname dat mensen de neiging hebben om onbewust sociale regels en gedragingen toe te passen in interacties met computers, ondanks het feit dat ze weten dat deze computers levenloos zijn (Nass et al., 1994). Dit kan verder worden verklaard door het fenomeen antropomorfisme (Epley et al., 2007; Novak & Hoffman, 2019). Antropomorfisme houdt in dat de aanwezigheid van mensachtige kenmerken of gedragingen in niet-menselijke agenten, onbewust cognitieve schema's voor menselijke interactie activeert (Aggarwal & McGill, 2007; M.K. Lee et al., 2010). Door computers te antropomorfiseren komen mensen tegemoet aan hun eigen behoefte aan sociale verbinding en begrip van de sociale omgeving (Epley et al., 2007; Waytz et al., 2010). Dit heeft echter ook tot gevolg dat mensen cognitieve schema’s voor sociale perceptie toepassen op conversational agents.
DOCUMENT
Speech interactions are often associated with virtual assistants and smart home devices, designed primarily for private contexts. A less developed domain is speech interfaces in public contexts. In a smart city development project, we explored the potential of distributed conversational speech interfaces in lampposts. Deploying a research-through-design method, we created a lo-fi prototype of the speech interface that test subjects could interact with during experiments in a lab setting. Our first exploratory prototype consisted of a loudspeaker that acted as the interface and preconceived dialogues designed to investigate the boundaries of desirable and acceptable experiences regarding issues such as privacy. Experiencing the interaction with this rudimentary prototype helped people envision potential use cases and reflect on privacy issues: the dialogues revealed subjective limits of what kind of (personal) information people were willing to share with the lamppost. They also elicited thoughts on possible consequences in the social context of citizens. LinkedIn: https://www.linkedin.com/in/atjylha/ https://www.linkedin.com/in/josvanleeuwen/
DOCUMENT
Algorithmic affordances are defined as user interaction mechanisms that allow users tangible control over AI algorithms, such as recommender systems. Designing such algorithmic affordances, including assessing their impact, is not straightforward and practitioners state that they lack resources to design adequately for interfaces of AI systems. This could be amended by creating a comprehensive pattern library of algorithmic affordances. This library should provide easy access to patterns, supported by live examples and research on their experiential impact and limitations of use. The Algorithmic Affordances in Recommender Interfaces workshop aimed to address key challenges related to building such a pattern library, including pattern identification features, a framework for systematic impact evaluation, and understanding the interaction between algorithmic affordances and their context of use, especially in education or with users with a low algorithmic literacy. Preliminary solutions were proposed for these challenges.
LINK
In an on-going smart city development project, we are exploring the potential of distributed conversational speech interfaces in the public context of a city. By using the well-known Wizard of Oz method in combination with a lo-fi prototype, we involve participants in co-design with the focus on potential use cases, social acceptability, and privacy aspects of interacting with a speech interface publicly. The work taps into the gap of design-oriented work in the domain of speech-based HCI. LinkedIn: https://www.linkedin.com/in/atjylha/ https://www.linkedin.com/in/josvanleeuwen/
DOCUMENT
Post-partum hemorrhaging is a medical emergency that occurs during childbirth and, in extreme cases, can be life-threatening. It is the number one cause of maternal mortality worldwide. High-quality training of medical staff can contribute to early diagnosis and work towards preventing escalation towards more serious cases. Healthcare education uses manikin-based simulators to train obstetricians for various childbirth scenarios before training on real patients. However, these medical simulators lack certain key features portraying important symptoms and are incapable of communicating with the trainees. The authors present a digital embodiment agent that can improve the current state of the art by providing a specification of the requirements as well as an extensive design and development approach. This digital embodiment allows educators to respond and role-play as the patient in real time and can easily be integrated with existing training procedures. This research was performed in collaboration with medical experts, making a new contribution to medical training by bringing digital humans and the representation of affective interfaces to the field of healthcare.
DOCUMENT
In flexible education, recommender systems that support course selection, are considered a viable means to help students in making informed course selections, especially where curricula offer greater flexibility. However, these recommender systems present both potential benefits and looming risks, such as overdependence on technology, biased recommendations, and privacy issues. User control mechanisms in recommender interfaces (or algorithmic affordances) might offer options to address those risks, but they have not been systematically studied yet. This paper presents the outcomes of a design session conducted during the INTERACT23 workshop on Algorithmic Affordances in Recommender Interfaces. This design session yielded insights in how the design of an interface, and specifically the algorithmic affordances in these interfaces, may address the ethical risks and dilemmas of using a recommender in such an impactful context by potentially vulnerable users. Through design and reflection, we discovered a host of design ideas for the interface of a flexible education interface, that can serve as conversation starters for practitioners implementing flexible education. More research is needed to explore these design directions and to gain insights on how they can help to approximate more ethically operating recommender systems.
LINK
DOCUMENT
This study investigates the evolvement of informalization of company communication on social media over time, based on actual social media data from the tourism industry. The development in the use of emoticons and emoji by companies is examined, as an expression of informalization and humanization of online company communication. We selected 33 companies from the tourism industry in The Netherlands and investigated their Facebook and Twitter messages supplemented with the messages of consumers who interacted with these companies, for the period 2011-2016. Results show that the use of emoticons and emoji in online company communication increased significantly over the period covered in this study, demonstrating a higher level of informalization of company communication. Since this is a key factor for improving relational outcomes, this finding has scholarly as well as managerial relevance. We discuss the implications of the results for the presence of organizations on social media
MULTIFILE
