Key to reinforcement learning in multi-agent systems is the ability to exploit the fact that agents only directly influence only a small subset of the other agents. Such loose couplings are often modelled using a graphical model: a coordination graph. Finding an (approximately) optimal joint action for a given coordination graph is therefore a central subroutine in cooperative multi-agent reinforcement learning (MARL). Much research in MARL focuses on how to gradually update the parameters of the coordination graph, whilst leaving the solving of the coordination graph up to a known typically exact and generic subroutine. However, exact methods { e.g., Variable Elimination { do not scale well, and generic methods do not exploit the MARL setting of gradually updating a coordination graph and recomputing the joint action to select. In this paper, we examine what happens if we use a heuristic method, i.e., local search, to select joint actions in MARL, and whether we can use outcome of this local search from a previous time-step to speed up and improve local search. We show empirically that by using local search, we can scale up to many agents and complex coordination graphs, and that by reusing joint actions from the previous time-step to initialise local search, we can both improve the quality of the joint actions found and the speed with which these joint actions are found.
LINK
Artificially intelligent agents increasingly collaborate with humans in human-agent teams. Timely proactive sharing of relevant information within the team contributes to the overall team performance. This paper presents a machine learning approach to proactive communication in AI-agents using contextual factors. Proactive communication was learned in two consecutive experimental steps: (a) multi-agent team simulations to learn effective communicative behaviors, and (b) human-agent team experiments to refine communication suitable for a human team member. Results consist of proactive communication policies for communicating both beliefs and goals within human-agent teams. Agents learned to use minimal communication to improve team performance in simulation, while they learned more specific socially desirable behaviors in the human-agent team experiment
DOCUMENT
The viability of novel network-level circular business models (CBMs) is debated heavily. Many companies are hesitant to implement CBMs in their daily practice, because of the various roles, stakes and opinions and the resulting uncertainties. Testing novel CBMs prior to implementation is needed. Some scholars have used digital simulation models to test elements of business models, but this this has not yet been done systematically for CBMs. To address this knowledge gap, this paper presents a systematic iterative method to explore and improve CBMs prior to actual implementation by means of agent-based modelling and simulation. An agent-based model (ABM) was co-created with case study participants in three Industrial Symbiosis networks. The ABM was used to simulate and explore the viability effects of two CBMs in different scenarios. The simulation results show which CBM in combination with which scenario led to the highest network survival rate and highest value captured. In addition, we were able to explore the influence of design options and establish a design that is correlated to the highest CBM viability. Based on these findings, concrete proposals were made to further improve the CBM design, from company level to network level. This study thus contributes to the development of systematic CBM experimentation methods. The novel approach provided in this work shows that agent-based modelling and simulation is a powerful method to study and improve circular business models prior to implementation.
DOCUMENT
As the Dutch population is aging, the field of music-in-healthcare keeps expanding. Healthcare, institutionally and at home, is multiprofessional and demands interprofessional collaboration. Musicians are sought-after collaborators in social and healthcare fields, yet lesser-known agents of this multiprofessional group. Although live music supports social-emotional wellbeing and vitality, and nurtures compassionate care delivery, interprofessional collaboration between musicians, social work, and healthcare professionals remains marginal. This limits optimising and integrating music-making in the care. A significant part of this problem is a lack of collaborative transdisciplinary education for music, social, and healthcare students that deep-dives into the development of interprofessional skills. To meet the growing demand for musical collaborations by particularly elderly care organisations, and to innovate musical contributions to the quality of social and healthcare in Northern Netherlands, a transdisciplinary education for music, physiotherapy, and social work studies is needed. This project aims to equip multiprofessional student groups of Hanze with interprofessional skills through co-creative transdisciplinary learning aimed at innovating and improving musical collaborative approaches for working with vulnerable, often older people. The education builds upon experiential learning in Learning LABs, and collaborative project work in real-life care settings, supported by transdisciplinary community forming.The expected outcomes include a new concept of a transdisciplinary education for HBO-curricula, concrete building blocks for a transdisciplinary arts-in-health minor study, innovative student-led approaches for supporting the care and wellbeing of (older) vulnerable people, enhanced integration of musicians in interprofessional care teams, and new interprofessional structures for educational collaboration between music, social work and healthcare faculties.
Teachers have a crucial role in bringing about the extensive social changes that are needed in the building of a sustainable future. In the EduSTA project, we focus on sustainability competences of teachers. We strengthen the European dimension of teacher education via Digital Open Badges as means of performing, acknowledging, documenting, and transferring the competencies as micro-credentials. EduSTA starts by mapping the contextual possibilities and restrictions for transformative learning on sustainability and by operationalising skills. The development of competence-based learning modules and open digital badge-driven pathways will proceed hand in hand and will be realised as learning modules in the partnering Higher Education Institutes and badge applications open for all teachers in Europe.Societal Issue: Teachers’ capabilities to act as active facilitators of change in the ecological transition and to educate citizens and workforce to meet the future challenges is key to a profound transformation in the green transition.Teachers’ sustainability competences have been researched widely, but a gap remains between research and the teachers’ practise. There is a need to operationalise sustainability competences: to describe direct links with everyday tasks, such as curriculum development, pedagogical design, and assessment. This need calls for an urgent operationalisation of educators’ sustainability competences – to support the goals with sustainability actions and to transfer this understanding to their students.Benefit to society: EduSTA builds a community, “Academy of Educators for Sustainable Future”, and creates open digital badge-driven learning pathways for teachers’ sustainability competences supported by multimodal learning modules. The aim is to achieve close cooperation with training schools to actively engage in-service teachers.Our consortium is a catalyst for leading and empowering profound change in the present and for the future to educate teachers ready to meet the challenges and act as active change agents for sustainable future. Emphasizing teachers’ essential role as a part of the green transition also adds to the attractiveness of teachers’ work.
The Dutch main water systems face pressing environmental, economic and societal challenges due to climatic changes and increased human pressure. There is a growing awareness that nature-based solutions (NBS) provide cost-effective solutions that simultaneously provide environmental, social and economic benefits and help building resilience. In spite of being carefully designed and tested, many projects tend to fail along the way or never get implemented in the first place, wasting resources and undermining trust and confidence of practitioners in NBS. Why do so many projects lose momentum even after a proof of concept is delivered? Usually, failure can be attributed to a combination of eroding political will, societal opposition and economic uncertainties. While ecological and geological processes are often well understood, there is almost no understanding around societal and economic processes related to NBS. Therefore, there is an urgent need to carefully evaluate the societal, economic, and ecological impacts and to identify design principles fostering societal support and economic viability of NBS. We address these critical knowledge gaps in this research proposal, using the largest river restoration project of the Netherlands, the Border Meuse (Grensmaas), as a Living Lab. With a transdisciplinary consortium, stakeholders have a key role a recipient and provider of information, where the broader public is involved through citizen science. Our research is scientifically innovative by using mixed methods, combining novel qualitative methods (e.g. continuous participatory narrative inquiry) and quantitative methods (e.g. economic choice experiments to elicit tradeoffs and risk preferences, agent-based modeling). The ultimate aim is to create an integral learning environment (workbench) as a decision support tool for NBS. The workbench gathers data, prepares and verifies data sets, to help stakeholders (companies, government agencies, NGOs) to quantify impacts and visualize tradeoffs of decisions regarding NBS.
