Abstract In this paper several meaningful audio icons of classic arcade games such as Pong, Donkey Kong, Mario World and Pac-Man are analyzed, using the PRAAT software for speech analysis and musical theory. The analysis results are used to describe how these examples of best practice sound design obtain their meaning in the player's perception. Some aspects can be related to the use of tonal hierarchy (e.g. Donkey Kong and Mario World) which is a western culture related aspect of musical meaning. Other aspects are related to universal expressions of meaning such as the theory of misattribution, prosody, vocalization and cross-modal perceptions such as brightness and the uncanny valley hypothesis. Recent studies in the field of cognitive neuroscience support the universal and meaningful potential of all these aspects. The relationship between language related prosody, vocalization and phonology, and music seems to be an especially successful design principle for universally meaningful music icons in game sound design.
DOCUMENT
Analysis of spontaneous speech is an important tool for clinical linguists to diagnose various types of neurodegenerative disease that affect the language processing areas. Prosody, fluency and voice quality may be affected in individuals with Parkinson's disease (PD, degradation of voice quality, unstable pitch), Alzheimer's disease (AD, monotonic pitch), and the non-fluent type of Primary Progressive Aphasia (PPA-NF, hesitant, non-fluent speech). In this study, the performance of a SVM classifier is evaluated that is trained on acoustic features only. The goal is to distinguish different types of brain damage based on recorded speech. Results show that the classifier can distinguish some dementia types (PPA-NF, AD), but not others (PD).
DOCUMENT
From the article: "Individuals with dementia often experience a decline in their ability to use language. Language problems have been reported in individuals with dementia caused by Alzheimer’s disease, Parkinson’s disease or degeneration of the fronto-temporal area. Acoustic properties are relatively easy to measure with software, which promises a cost-effective way to analyze larger discourses. We study the usefulness of acoustic features to distinguish the speech of German-speaking controls and patients with dementia caused by (a) Alzheimer’s disease, (b) Parkinson’s disease or (c) PPA/FTD. Previous studies have shown that each of these types affects speech parameters such as prosody, voice quality and fluency (Schulz 2002; Ma, Whitehill, and Cheung 2010; Rusz et al. 2016; Kato et al. 2013; Peintner et al. 2008). Prior work on the characteristics of the speech of individuals with dementia is usually based on samples from clinical tests, such as the Western Aphasia Battery or the Wechsler Logical Memory task. Spontaneous day-to-day speech may be different, because participants may show less of their vocal abilities in casual speech than in specifically designed test scenarios. It is unclear to what extent the previously reported speech characteristics are still detectable in casual conversations by software. The research question in this study is: how useful for classification are acoustic properties measured in spontaneous speech."
MULTIFILE
When an adult claims he cannot sleep without his teddy bear, people tend to react surprised. Language interpretation is, thus, influenced by social context, such as who the speaker is. The present study reveals inter-individual differences in brain reactivity to social aspects of language. Whereas women showed brain reactivity when stereotype-based inferences about a speaker conflicted with the content of the message, men did not. This sex difference in social information processing can be explained by a specific cognitive trait, one's ability to empathize. Individuals who empathize to a greater degree revealed larger N400 effects (as well as a larger increase in γ-band power) to socially relevant information. These results indicate that individuals with high-empathizing skills are able to rapidly integrate information about the speaker with the content of the message, as they make use of voice-based inferences about the speaker to process language in a top-down manner. Alternatively, individuals with lower empathizing skills did not use information about social stereotypes in implicit sentence comprehension, but rather took a more bottom-up approach to the processing of these social pragmatic sentences.
MULTIFILE
Communication between healthcare professionals and deaf patients has been particularly challenging during the COVID-19 pandemic. We have explored the possibility to automatically translate phrases that are frequently used in the diagnosis and treatment of hospital patients, in particular phrases related to COVID-19, from Dutch or English to Dutch Sign Language (NGT). The prototype system we developed displays translations either by means of pre-recorded videos featuring a deaf human signer (for a limited number of sentences) or by means of animations featuring a computer-generated signing avatar (for a larger, though still restricted number of sentences). We evaluated the comprehensibility of the signing avatar, as compared to the human signer. We found that, while individual signs are recognized correctly when signed by the avatar almost as frequently as when signed by a human, sentence comprehension rates and clarity scores for the avatar are substantially lower than for the human signer. We identify a number of concrete limitations of the JASigning avatar engine that underlies our system. Namely, the engine currently does not offer sufficient control over mouth shapes, the relative speed and intensity of signs in a sentence (prosody), and transitions between signs. These limitations need to be overcome in future work for the engine to become usable in practice.
DOCUMENT
Parkinson’s disease is characterized not only by bradykinesia, rigidity, and tremor, but also by impairments of expressive and receptive linguistic prosody. The facilitating effect of music with a salient beat on patients’ gait suggests that it might have a similar effect on vocal behavior, however it is currently unknown whether singing is affected by the disease. In the present study, fifteen Parkinson patients were compared with fifteen healthy controls during the singing of familiar melodies and improvised melodic continuations. While patients’ speech could reliably be distinguished from that of healthy controls matched for age and gender, purely on the basis of aural perception, no significant differences in singing were observed, either in pitch, pitch range, pitch variability, and tempo, or in scale tone distribution, interval size or interval variability. The apparent dissociation of speech and singing in Parkinson’s disease suggests that music could be used to facilitate expressive linguistic prosody.
LINK
Pauses in speech may be categorized on the basis of their length. Some authors claim that there are two categories (short and long pauses) (Baken & Orlikoff, 2000), others claim that there are three (Campione & Véronis, 2002), or even more. Pause lengths may be affected in speakers with aphasia. Individuals with dementia probably caused by Alzheimer’s disease (AD) or Parkinson’s disease (PD) interrupt speech longer and more frequently. One infrequent form of dementia, non-fluent primary progressive aphasia (PPA-NF), is even defined as causing speech with an unusual interruption pattern (”hesitant and labored speech”). Although human listeners can often easily distinguish pathological speech from healthy speech, it is unclear yet how software can detect the relevant patterns. The research question in this study is: how can software measure the statistical parameters that characterize the disfluent speech of PPA-NF/AD/PD patients in connected conversational speech?
DOCUMENT
From the introduction: "There are two variants of fronto-temporal dementia: a behavioral variant (behavioral FTD, bvFTD, Neary et al. (1998)), which causes changes in behavior and personality but leaves syntax, phonology and semantics relatively intact, and a variant that causes impairments in the language processing system (Primary Progessive Aphasia, PPA (Gorno-Tempini et al., 2004). PPA can be subdivided into subtypes fluent (fluent but empty speech, comprehension of word meaning is affected / `semantic dementia') and non-fluent (agrammatism, hesitant or labored speech, word finding problems). Some identify logopenic aphasia as a FTD-variant: fluent aphasia with anomia but intact object recognition and underlying word meaning."
MULTIFILE
Under the premise that language learning is bidirectional in nature, this study aimed to investigate syntactic coordination within teacher-student interactions by using cross-recurrence quantification analysis (CRQA). Seven teachers’ and a group of their students’ interactions were repeatedly measured in the course of an intervention in early science education. Results showed changes in the proportion of recurrent points; in case of simple sentences teachers and students became less coordinated over time, whereas in case of complex sentences teachers and students showed increasing coordination. Results also revealed less rigid (more flexible) syntactic coordination, although there were no changes in the relative contribution of teacher and students to this. In the light of the intervention under investigation this is an important result. This means that teachers and students learn to use more complex language and coordinate their language complexity better in order to co-construct science discourse. The application of CRQA provides new insights and contributes to better understanding of the dynamics of syntactic coordination.
DOCUMENT
Patients with poststroke aphasia have higher mortality rates and worse functional outcome than patients without aphasia. Nurses are well aware of aphasia and the associated problems for patients with stroke because they have daily contact with them. The challenge is to provide evidence-based care directed at the aphasia. Although rehabilitation stroke guidelines are available, they do not address the caregiving of nurses to patients with aphasia. The aim of this study was to explore the evidence on rehabilitation of stroke patients with aphasia in relation to nursing care, focusing on the following themes: (1) the identification of aphasia, (2) the effectiveness of speech-language interventions.The findings of this study can be used to develop nursing rehabilitation guidelines for stroke patients with aphasia. Further research is necessary to explore the feasibility of using such guidelines in clinical nursing practice and to examine the experiences of patients with nursing interventions directed at aphasia.
DOCUMENT
