In an event related potential (ERP) experiment using written language materials only, we investigated a potential modulation of the N400 by the modality switch effect. The modality switch effect occurs when a first sentence, describing a fact grounded in one modality, is followed by a second sentence describing a second fact grounded in a different modality. For example, "A cellar is dark" (visual), was preceded by either another visual property "Ham is pink" or by a tactile property "A mitten is soft." We also investigated whether the modality switch effect occurs for false sentences ("A cellar is light"). We found that, for true sentences, the ERP at the critical word "dark" elicited a significantly greater frontal, early N400-like effect (270-370 ms) when there was a modality mismatch than when there was a modality-match. This pattern was not found for the critical word "light" in false sentences. Results similar to the frontal negativity were obtained in a late time window (500-700 ms). The obtained ERP effect is similar to one previously obtained for pictures. We conclude that in this paradigm we obtained fast access to conceptual properties for modality-matched pairs, which leads to embodiment effects similar to those previously obtained with pictorial stimuli.
LINK
Abstract: Embodied embedded cognition (EEC) has gained support in cognitive science as well as in human–computer interaction (HCI). EEC can be characterized both by its action-centeredness as well as its roots in phenomenology. The phenomenological aspects of EEC could be seen as support for trends in design emphasizing the user experience. Meanwhile, usability issues often are still approached using traditional methods based on cognitivist assumptions. In this paper, I argue for a renewed focus on improving usability from an EEC perspective. I draw mainly on a behavior-oriented interpretation of the theory, the key aspects of which are reviewed. A tentative sketch for an embodied embedded usability is proposed, doing justice to the embodied embedded nature of interaction while retaining the goal of developing technology that is easy to use in everyday practice.
LINK
To reach for abstraction is a major but challenging goal in mathematics education: teachers struggle with finding ways how to foster abstraction in their classes. To shed light on this issue for the case of geometry education, we align theoretical perspectives on embodied learning and abstraction with practical perspectives from in-service teachers. We focus on the teaching and learning of realistic geometry, not only because this domain is apt for sensori-motor action investigations, but also because abstraction in realistic geometry is under-researched in relation to other domains of mathematics, and teachers’ knowledge of geometry and confidence in teaching it lag behind. The following research question will be addressed: how can a theoretical embodied perspective on abstraction in geometry education in the higher grades of primary school inform current teacher practices? To answer this question, we carried out a literature study and an interview study with in-service teachers (n = 6). As a result of the literature study, we consider embodied abstraction in geometry as a process of reflecting on, describing, explaining, and structuring of sensory-motor actions in the experienced world through developing and using mathematical artifacts. The results from the interview study show that teachers are potentially prepared for using aspects of embodied learning (e.g., manipulatives), but are not aware of the different aspects of enactment that may invite students’ abstraction. We conclude that theories on embodiment and abstraction do not suffice to foster students’ abstraction process in geometry. Instead, teachers’ knowledge of embodied abstraction in geometry and how to foster this grows with experience in enactment, and with the discovery that cognition emerges to serve action.
LINK