Introduction: In March 2014, the New South Wales (NSW) Government (Australia) announced the NSW Integrated Care Strategy. In response, a family-centred, population-based, integrated care initiative for vulnerable families and their children in Sydney, Australia was developed. The initiative was called Healthy Homes and Neighbourhoods. A realist translational social epidemiology programme of research and collaborative design is at the foundation of its evaluation. Theory and Method: The UK Medical Research Council (MRC) Framework for evaluating complex health interventions was adapted. This has four components, namely 1) development, 2) feasibility/piloting, 3) evaluation and 4) implementation. We adapted the Framework to include: critical realist, theory driven, and continuous improvement approaches. The modified Framework underpins this research and evaluation protocol for Healthy Homes and Neighbourhoods. Discussion: The NSW Health Monitoring and Evaluation Framework did not make provisions for assessment of the programme layers of context, or the effect of programme mechanism at each level. We therefore developed a multilevel approach that uses mixed-method research to examine not only outcomes, but also what is working for whom and why.
LINK
Behaviour change design has much to gain with the integration of insights from the behavioural sciences in the design process. However, this integration needs to be done without hampering the creative process. In two rich design cases aimed at health and safety behaviour change, we describe our efforts to develop a method for theory driven design based on the Double Diamond. Our method attempts to integrate insights from the Persuasive by Design-model (PbD) for behaviour change into the entire design process. Our case studies demonstrate that our method indeed augments the integration of theory and evidence in our designs, but only if the Double Diamond process model is complemented with an evaluation phase, and insights from the PbD-model are derived using rich, well developed tools.
DOCUMENT
Comprehensive understanding of the merits of bottom-up urban development is lacking, thus hampering and complicating associated collaborative processes. Therefore, and given the assumed relevancies, we mapped the social, environmental and economic values generated by bottom-up developments in two Dutch urban areas, using theory-based evaluation principles. These evaluations raised insights into the values, beneficiaries and path dependencies between successive values, confirming the assumed effect of placemaking accelerating further spatial developments. It also revealed broader impacts of bottom-up endeavors, such as influences on local policies and innovations in urban development.
MULTIFILE
Living labs are complex multi-stakeholder collaborations that often employ a usercentred and design-driven methodology to foster innovation. Conventional management tools fall short in evaluating them. However, some methods and tools dedicated to living labs' special characteristics and goals have already been developed. Most of them are still in their testing phase. Those tools are not easily accessible and can only be found in extensive research reports, which are difficult to dissect. Therefore, this paper reviews seven evaluation methods and tools specially developed for living labs. Each section of this paper is structured in the following manner: tool’s introduction (1), who uses the tool (2), and how it should be used (3). While the first set of tools, namely “ENoLL 20 Indicators”, “SISCODE Self-assessment”, and “SCIROCCO Exchange Tool” assess a living lab as an organisation and are diving deeper into the organisational activities and the complex context, the second set of methods and tools, “FormIT” and “Living Lab Markers”, evaluate living labs’ methodologies: the process they use to come to innovations. The paper's final section presents “CheRRIes Monitoring and Evaluation Tool” and “TALIA Indicator for Benchmarking Service for Regions”, which assess the regional impact made by living labs. As every living lab is different regarding its maturity (as an organisation and in its methodology) and the scope of impact it wants to make, the most crucial decision when evaluating is to determine the focus of the assessment. This overview allows for a first orientation on worked-out methods and on possible indicators to use. It also concludes that the existing tools are quite managerial in their method and aesthetics and calls for designers and social scientists to develop more playful, engaging and (possibly) learning-oriented tools to evaluate living labs in the future. LinkedIn: https://www.linkedin.com/in/overdiek12345/ https://www.linkedin.com/in/mari-genova-17a727196/?originalSubdomain=nl
DOCUMENT
Nonprofit organizations (NPOs) have deployed various strategies in motivating businesses to source sustainably, such as the co-development and promotion of sustainability certification and direct collaboration in cross-sector partnerships (CSPs). This is an important current-day priority, given the ambitions set out in the Sustainable Development Goals (SDGs). Increasingly, NPOs have taken up a role as conveners of such CSPs. Research on CSPs has, to date, often considered conveners as a ‘resource’ to the CSP, contributing to its effectiveness. In this study, we shift the focus towards the convener by considering a case of a ‘mission-driven convener’, an NPO that initiates CSPs as a strategy to realize its own sustainability objectives. Our explorative case study—comparing the NPO’s efforts across six countries in setting up national coffee platforms—reviews the concept of a mission-driven convener vis-à-vis established notions on convening and identifies which strategies it applies to realize a CSP. These strategies comprise productively combining certification-driven efforts with CSPs, combining process and outcomes of CSPs, and drawing on cross-level dynamics derived from outsourcing of convening work to local actors. With our study, we contribute to research on CSP conveners by offering an alternative interpretation to the relation between the CSP and the convener, attributing more agency to the convener as a mission-driven organization. Strengthening our understanding of CSPs and conveners is an important means to advance the Sustainable Development Goals (SDGs).
DOCUMENT
To improve people’s lives, human-computer interaction researchers are increasingly designing technological solutions based on behavior change theory, such as social comparison theory (SCT). However, how researchers operationalize such a theory as a design remains largely unclear. One way to clarify this methodological step is to clearly state which functional elements of a design are aimed at operationalizing a specific behavior change theory construct to evaluate if such aims were successful. In this article, we investigate how the operationalization of functional elements of theories and designs can be more easily conveyed. First, we present a scoping review of the literature to determine the state of operationalizations of SCT as behavior change designs. Second, we introduce a new tool to facilitate the operationalization process. We term the tool blueprints. A blueprint explicates essential functional elements of a behavior change theory by describing it in relation to necessary and sufficient building blocks incorporated in a design. We describe the process of developing a blueprint for SCT. Last, we illustrate how the blueprint can be used during the design refinement and reflection process.
DOCUMENT
Past research on designing for behavioural change mostly concerned linear design processes, whereas in practice, Agile design methods are increasingly popular. This paper evaluates the possibilities and limitations of using Agile design methods in theory-driven design for behavioural change. We performed a design case study, consisting of a student design team working on improving waiting experiences at Schiphol Airport security and check-in. Our study showed that Agile design methods are usable when designing for behavioural change. Moreover, the Behavioural Lenses toolkit used in the design process is beneficial in facilitating theory-driven Agile design. The combination of an Agile design process and tools to evidentially inform the design enabled the design team to formulate viable and interesting concepts for improving waiting-line experiences. However, limitations also occurred: a mismatch between the rate at which the Scream method proceeded and the time and momentum needed to conduct in-depth research.
MULTIFILE
The gap between research and design practice has long been a concern for the HCI community. In this article, we explore how different translations of HCI knowledge might bridge this gap. A literature review characterizes the gap as having two key dimensions - one between general theory and particular artefacts and a second between academic HCI research and professional UX design practice. We report on a 5-year engagement between HCI researchers and a major media company to explore how a particular piece of HCI research, the trajectories conceptual framework, might be translated for and with UX practitioners. We present various translations of this framework and fit them into the gap we previously identified. This leads us to refine the idea of translations, suggesting that they may be led by researchers, by practitioners or co-produced by both as boundary objects. We consider the benefits of each approach.
MULTIFILE
The concepts of metacognitive refection, refection, and metacognition are distinct but have undergone shifts in meaning as they migrated into medical education. Conceptual clarity is essential to the construction of the knowledge base of medical education and its educational interventions. We conducted a theoretical integrative review across diverse bodies of literature with the goal of understanding what metacognitive refection is. We searched PubMed, Embase, CINAHL, PsychInfo, and Web of Science databases, including all peer-reviewed research articles and theoretical papers as well as book chapters that addressed the topic, with no limitations for date, language, or location. A total of 733 articles were identified and 87 were chosen after careful review and application of exclusion criteria. The work of conceptually and empirically delineating metacognitive reflection has begun. Contributions have been made to root metacognitive refection in the concept of metacognition and moving beyond it to engage in cycles of refection. Other work has underscored its affective component, transformational nature, and contextual factors. Despite this merging of threads to develop a richer conceptualization, a theory of how metacognitive refection works is elusive. Debates address whether metacognition drives refection or vice versa. It has also been suggested that learners evolve along on a continuum from thinking, to task-related refection, to self-refection, and finally to metacognitive refection. Based on prior theory and research, as well as the findings of this review, we propose the following conceptualization: Metacognitive refection involves heightened internal observation, awareness, monitoring, and regulation of our own knowledge, experiences, and emotions by questioning and examining cognition and emotional processes to continually refine and enhance our perspectives and decisions while thoughtfully accounting for context. We argue that metacognitive refection brings a shift in perspective and can support valuable reconceptualization for lifelong learning.
LINK
Large groups in society lack the necessary skills to be sufficiently self-reliant and are in need of personal assistance. These groups could be supported by information and information technology (ICT), but only if this technology is designed to fit their (cognitive) abilities. Inclusive design theory and methods have already been developed in research contexts, but there is still a gap between theory and practice. There is a need for a practical aid, that helps to create awareness of inclusive design among ICT developers, and offers easy-to-use information and tools to actually apply the methods for diverse target groups. This paper describes the first steps taken towards an inclusive design toolbox for developing ICT applications that offer cognitive support for selfreliance. Dutch ICT companies were interviewed and participated in a co-design workshop, leading to a number of initial needs, user requirements, and an on-line community, that form input for further development of the toolbox.
DOCUMENT
