We present a number of methodological recommendations concerning the online evaluation of avatars for text-to-sign translation, focusing on the structure, format and length of the questionnaire, as well as methods for eliciting and faithfully transcribing responses.
LINK
Communication between healthcare professionals and deaf patients has been particularly challenging during the COVID-19 pandemic. We have explored the possibility to automatically translate phrases that are frequently used in the diagnosis and treatment of hospital patients, in particular phrases related to COVID-19, from Dutch or English to Dutch Sign Language (NGT). The prototype system we developed displays translations either by means of pre-recorded videos featuring a deaf human signer (for a limited number of sentences) or by means of animations featuring a computer-generated signing avatar (for a larger, though still restricted number of sentences). We evaluated the comprehensibility of the signing avatar, as compared to the human signer. We found that, while individual signs are recognized correctly when signed by the avatar almost as frequently as when signed by a human, sentence comprehension rates and clarity scores for the avatar are substantially lower than for the human signer. We identify a number of concrete limitations of the JASigning avatar engine that underlies our system. Namely, the engine currently does not offer sufficient control over mouth shapes, the relative speed and intensity of signs in a sentence (prosody), and transitions between signs. These limitations need to be overcome in future work for the engine to become usable in practice.
DOCUMENT
During the medieval and early modern periods, the mock sermon was one of the most widely staged festive rituals. There are records of its performance in most European countries and cultures. But despite its clear popularity in England, few of these texts are extant in English. Fewer still have been translated in their entirety. To remedy this situation, we provide here a translation of the sixteenth century Dutch poem Spotsermoen over Sint Niemand. This piece embodies most of the key features of the mock sermon; the text's rhetorical strategies, its content, and the details it reveals about its performance are all typical of the genre. Thus, the poem is offered as a specimen of the mock sermon's overall conventions and forms.
DOCUMENT