Deictic gestures are gestures we make during communication to point at objects or persons. Indicative acts of directing-to guide the addressee to an object, while placing-for acts place an object for the addressee’s attention. Commonly used presentation software tools, such as PowerPoint and Keynote, offer ample support for placing-for gestures, e.g. slide transitions, progressive disclosure of list items and animations. Such presentation tools, however, do not generally offer adequate support for the directing-to indicative act (i.e. pointing gestures). In this paper we argue the value of presenting deictic gestures to a remote audience. Our research approach is threefold: identify indicative acts that are naturally produced by presenters; design tangible gestures for multi-touch surfaces that replicate the intent of those indicative acts; and design a set of graphical effects for remote viewing that best represent these indicative acts for the audience. Clinton Jorge1, Jos P. van Leeuwen2, Dennis Dams3, Jan Bouwen4 1 University of Madeira, Madeira-ITI, Funchal, Portugal; 2 The Hague University of Applied Sciences, The Hague, Netherlands; 3,4 Bell Labs, Alcatel-Lucent, Antwerp, Belgium Copyright shared between: University of Madeira, Madeira-ITI, Funchal, Portugal; The Hague University of Applied Sciences, The Hague, Netherlands; Bell Labs, Alcatel-Lucent, Antwerp, Belgium
DOCUMENT
In this paper, we examine the process of designing robot-performed iconic hand gestures in the context of a long-term study into second language tutoring with children of approximately 5 years old. We explore four factors that may relate to their efficacy in supporting second language tutoring: the age of participating children; differences between gestures for various semantic categories, e.g. measurement words, such as small, versus counting words, such as five; the quality (comprehensibility) of the robot’s gestures; and spontaneous reenactment or imitation of the gestures. Age was found to relate to children’s learning outcomes, with older children benefiting more from the robot’s iconic gestures than younger children, particularly for measurement words. We found no conclusive evidence that the quality of the gestures or spontaneous reenactment of said gestures related to learning outcomes. We further propose several improvements to the process of designing and implementing a robot’s iconic gesture repertoire.
DOCUMENT
Background: Research on maternity care often focuses on factors that prevent good communication and collaboration and rarely includes important stakeholders – parents – as co-researchers. To understand how professionals and parents in Dutch maternity care accomplish constructive communication and collaboration, we examined their interactions in the clinic, looking for “good practice”. Methods: We used the video-reflexive ethnographic method in 9 midwifery practices and 2 obstetric units. Findings: We conducted 16 meetings where participants reflected on video recordings of their clinical interactions. We found that informal strategies facilitate communication and collaboration: “talk work” – small talk and humour – and “work beyond words” – familiarity, use of sight, touch, sound, and non-verbal gestures. When using these strategies, participants noted that it is important to be sensitive to context, to the values and feelings of others, and to the timing of care. Our analysis of their ways of being sensitive shows that good communication and collaboration involves “paradoxical care”, e.g., concurrent acts of “regulated spontaneity” and “informal formalities”. Discussion: Acknowledging and reinforcing paradoxical care skills will help caregivers develop the competencies needed to address the changing demands of health care. The video-reflexive ethnographic method offers an innovative approach to studying everyday work, focusing on informal and implicit aspects of practice and providing a bottom up approach, integrating researchers, professionals and parents. Conclusion: Good communication and collaboration in maternity care involves “paradoxical care” requiring social sensitivity and self-reflection, skills that should be included as part of professional training.
DOCUMENT
Posterpresentatie op Conferentie. Introduction: Classifiers are handshapes (sometimes combined with a specific orientation) that, when combined with the other parameters of movement and location form a ‘verb of motion or location’. There is a limited body of research available on the acquisition of classifiers by children. The available studies have focused on deaf children of deaf (DOD) parents, who are native signers. Results show that classifiers emerge at 3 years and approach an adult like level at the age of 9 (Beal Alvarez & Easterbrooks, 2013). This small study was set out to investigate the production of classifiers in DOH children who acquire Sign Language of the Netherlands. Our expectation was that DOH children produce classifiers, but fail to use them correctly in all instances due to lack of pragmatic control (Slobin et al., 2003). Method: Four children (two girls, two boys) were recruited at a school for the Deaf in The Netherlands (5;10 – 6;8 years). All children were deaf or severely hearing-impaired from birth. Children used (sign supported) Dutch at home and sign language at school and had approximately three years of exposure to sign language. Narratives (Frog-story) were recorded. The recordings were transcribed and analyzed using ELAN-software. Analysis focused on type of classifier (entity and handling) and accuracy in production. Results: The children produced 22 classifiers in total, 20 entity classifiers and 2 handling classifiers. Ten percent of the entity classifiers was incorrect; the handshape to express the entity did not match the handshape frequently selected for that entity. Conclusion: DOH children produce classifiers after three years of exposure to sign language. Errors in classifier production involved errors in handshape selection. This compares to type of errors frequently found for DOD children. Results will be discussed in relation to the iconic and gestural properties of classifiers (Cormier et al., 2012). References: Beal-Alvarez, J.S. & Easterbrooks, S.R. (2013). Increasing children’s ASL classifier production: A multicomponent intervention. American Annals of the Deaf, 158, 311 – 333. Cormier, K., Quinto-Pozos, D., Sevcikova, Z., Schembri, A. (2012). Lexicalisation and de-lexicalisation processes in sign languages: Comparing depicting constructions and viewpoint gestures. Language & Communication, 32, 329 – 348. Slobin, D., Hoiting, N., Kuntze, K., Lindert, R., Weinberg, A. Pyers, J., Anthony, M., Biederman, Y., Thumann, H. (2003). A cognitive/functional perspective on the acquisition of ‘classifiers’. In: Emmorey, K. (Ed.). Perspectives on classifier constructions in sign languages. Lawrence Erlbaum Associates, Mahwah, NJ. Pp 297 – 310.
DOCUMENT
Music moves us, literally. We tend to move the body in synchrony with the beat. Individuals without any professional music training are capable of singing or humming along with an unfamiliar melody or indicating the melodic contour by means of hand gestures. Musicians who play by ear are able to do the same on an instrument.In this study an attempt was made to quantify the extent to which professional keyboard performers were able to play by ear, and whether improvising musicians were superior to non-improvising. During the experiment, subjects were asked to listen to short, unfamiliar music excerpts recorded on a MIDI controller. Subjects were asked either to play along, replicate the excerpt, transpose it to a different key, or to harmonize it. Subjects were recruited from two groups of classically-trained musicians: improvising and non-improvising pianists and church organists. The bass and treble parts extracted from each MIDI sequence were compared with the bass and treble from the aural model, yielding an alignment score for each task. The comparison was performed using content-based music retrieval software developed in the WITCHCRAFT project for the study of folksong melodies. Results showed that the top voice was replicated better than the bass. There were large differences between the musicians. As a group, improvising musicians scored better than non-improvising musicians, however this difference was not significant. Mixture analysis showed that top-scorers came from both groups. Subjects with perfect pitch did not perform better.
DOCUMENT
ion of verb agreement by hearing learners of a sign language. During a 2-year period, 14 novel learners of Sign Language of the Netherlands (NGT) with a spoken language background performed an elicitation task 15 times. Seven deaf native signers and NGT teachers performed the same task to serve as a benchmark group. The results obtained show that for some learners, the verb agreement system of NGT was difficult to master, despite numerous examples in the input. As compared to the benchmark group, learners tended to omit agreement markers on verbs that could be modified, did not always correctly use established locations associated with discourse referents, and made characteristic errors with respect to properties that are important in the expression of agreement (movement and orientation). The outcomes of the study are of value to practitioners in the field, as they are informative with regard to the nature of the learning process during the first stages of learning a sign language.
DOCUMENT
The aim of this dissertation is to examine how adult learners with a spoken language background who are acquiring a signed language, learn how to use the space in front of the body to express grammatical and topographical relations. Moreover, it aims at investigating the effectiveness of different types of instruction, in particular instruction that focuses the learner's attention on the agreement verb paradigm. To that end, existing data from a learner corpus (Boers-Visker, Hammer, Deijn, Kielstra & Van den Bogaerde, 2016) were analyzed, and two novel experimental studies were designed and carried out. These studies are described in detail in Chapters 3–6. Each chapter has been submitted to a scientific journal, and accordingly, can be read independently.1 Yet, the order of the chapters follows the chronological order in which the studies were carried out, and the reader will notice that each study served as a basis to inform the next study. As such, some overlap in the sections describing the theoretical background of each study was unavoidable.
MULTIFILE
To reach for abstraction is a major but challenging goal in mathematics education: teachers struggle with finding ways how to foster abstraction in their classes. To shed light on this issue for the case of geometry education, we align theoretical perspectives on embodied learning and abstraction with practical perspectives from in-service teachers. We focus on the teaching and learning of realistic geometry, not only because this domain is apt for sensori-motor action investigations, but also because abstraction in realistic geometry is under-researched in relation to other domains of mathematics, and teachers’ knowledge of geometry and confidence in teaching it lag behind. The following research question will be addressed: how can a theoretical embodied perspective on abstraction in geometry education in the higher grades of primary school inform current teacher practices? To answer this question, we carried out a literature study and an interview study with in-service teachers (n = 6). As a result of the literature study, we consider embodied abstraction in geometry as a process of reflecting on, describing, explaining, and structuring of sensory-motor actions in the experienced world through developing and using mathematical artifacts. The results from the interview study show that teachers are potentially prepared for using aspects of embodied learning (e.g., manipulatives), but are not aware of the different aspects of enactment that may invite students’ abstraction. We conclude that theories on embodiment and abstraction do not suffice to foster students’ abstraction process in geometry. Instead, teachers’ knowledge of embodied abstraction in geometry and how to foster this grows with experience in enactment, and with the discovery that cognition emerges to serve action.
LINK
In de afgelopen jaren hebben technologische ontwikkelingen de aard van dienstverlening ingrijpend veranderd (Huang & Rust, 2018). Technologie wordt steeds vaker ingezet om menselijke servicemedewerkers te vervangen of te ondersteunen (Larivière et al., 2017; Wirtz et al., 2018). Dit stelt dienstverleners in staat om meer klanten te bedienen met minder werknemers, waardoor de operationele efficiëntie toeneemt (Beatson et al., 2007). Deze operationele efficiëntie leidt weer tot lagere kosten en een groter concurrentievermogen. Ook voor klanten kan de inzet van technologie voordelen hebben, zoals betere toegankelijkheid en consistentie, tijd- en kostenbesparing en (de perceptie van) meer controle over het serviceproces (Curran & Meuter, 2005). Mede vanwege deze beoogde voordelen is de inzet van technologie in service-interacties de afgelopen twee decennia exponentieel gegroeid. De inzet van zogenaamde conversational agents is een van de belangrijkste manieren waarop dienstverleners technologie kunnen inzetten om menselijke servicemedewerkers te ondersteunen of vervangen (Gartner, 2021). Conversational agents zijn geautomatiseerde gesprekspartners die menselijk communicatief gedrag nabootsen (Laranjo et al., 2018; Schuetzler et al., 2018). Er bestaan grofweg drie soorten conversational agents: chatbots, avatars, en robots. Chatbots zijn applicaties die geen virtuele of fysieke belichaming hebben en voornamelijk communiceren via gesproken of geschreven verbale communicatie (Araujo, 2018;Dale, 2016). Avatars hebben een virtuele belichaming, waardoor ze ook non-verbale signalen kunnen gebruiken om te communiceren, zoals glimlachen en knikken (Cassell, 2000). Robots, ten slotte, hebben een fysieke belichaming, waardoor ze ook fysiek contact kunnen hebben met gebruikers (Fink, 2012). Conversational agents onderscheiden zich door hun vermogen om menselijk gedrag te vertonen in service-interacties, maar op de vraag ‘hoe menselijk is wenselijk?’ bestaat nog geen eenduidig antwoord. Conversational agents als sociale actoren Om succesvol te zijn als dienstverlener, is kwalitatief hoogwaardige interactie tussen servicemedewerkers en klanten van cruciaal belang (Palmatier et al., 2006). Dit komt omdat klanten hun percepties van een servicemedewerker (bijv. vriendelijkheid, bekwaamheid) ontlenen aan diens uiterlijk en verbale en non verbale gedrag (Nickson et al., 2005; Specht et al., 2007; Sundaram & Webster, 2000). Deze klantpercepties beïnvloeden belangrijke aspecten van de relatie tussen klanten en dienstverleners, zoals vertrouwen en betrokkenheid, die op hun beurt intentie tot gebruik, mond-tot-mondreclame, loyaliteit en samenwerking beïnvloeden (Hennig-Thurau, 2004; Palmatier et al., 2006).Er is groeiend bewijs dat de uiterlijke kenmerken en communicatieve gedragingen (hierna: menselijke communicatieve gedragingen) die percepties van klanten positief beïnvloeden, ook effectief zijn wanneer ze worden toegepast door conversational agents (B.R. Duffy, 2003; Holtgraves et al., 2007). Het zogenaamde ‘Computers Als Sociale Actoren’ (CASA paradigma vertrekt vanuit de aanname dat mensen de neiging hebben om onbewust sociale regels en gedragingen toe te passen in interacties met computers, ondanks het feit dat ze weten dat deze computers levenloos zijn (Nass et al., 1994). Dit kan verder worden verklaard door het fenomeen antropomorfisme (Epley et al., 2007; Novak & Hoffman, 2019). Antropomorfisme houdt in dat de aanwezigheid van mensachtige kenmerken of gedragingen in niet-menselijke agenten, onbewust cognitieve schema's voor menselijke interactie activeert (Aggarwal & McGill, 2007; M.K. Lee et al., 2010). Door computers te antropomorfiseren komen mensen tegemoet aan hun eigen behoefte aan sociale verbinding en begrip van de sociale omgeving (Epley et al., 2007; Waytz et al., 2010). Dit heeft echter ook tot gevolg dat mensen cognitieve schema’s voor sociale perceptie toepassen op conversational agents.
DOCUMENT
