The assessment of workplace learning by educators at the workplace is a complex and inherently social process, as the workplace is a participatory learning environment. We therefore propose seeing assessment as a process of judgment embedded in a community of practice and to this purpose use the philosophy of inferentialism to unravel the judgment process of workplace educators by seeing it as an interrelated system of judgments, actions and reasons. Focussing on the unfolding of a process, we applied a longitudinal holistic case study design. Results show that educators are engaged in a constant judgment process during which they use multiple and adaptive frames of reference when forming their judgment about students. They construct an overarching image of students that develops throughout the placement, and their judgments about students go hand in hand with their actions relating to fostering independent practice.
LINK
The aim of the present investigation was to evaluate the effect of visual feedback on rating voice quality severity level and the reliability of voice quality judgment by inexperienced listeners. For this purpose two training programs were created, each lasting 2 hours. In total 37 undergraduate speech–language therapy students participated in the study and were divided into a visual plus auditory-perceptual feedback group (V + AF), an auditory-perceptual feedback group (AF), and a control group with no feedback (NF). All listeners completed two rating sessions judging overall severity labeled as grade (G), roughness (R), and breathiness (B). The judged voice samples contained the concatenation of continuous speech and sustained phonation. No significant rater reliability changes were found in the pre- and posttest between the three groups in every GRB-parameter (all p > 0.05). There was a training effect seen in the significant improvement of rater reliability for roughness within the NF and AF groups (all p < 0.05), and for breathiness within the V + AF group (p < 0.01). The rating of the severity level of roughness changed significantly after the training in the AF and V + AF groups (p < 0.01), and the breathiness severity level changed significantly after the training in the V + AF group (p < 0.01). The training of V + AF and AF may only minimally influence the reliability in the judgment of voice quality but showed significant influence on rating the severity level of GRB parameters. Therefore, the use of both visual and auditory anchors while rating as well as longer training sessions may be required to draw a firm conclusion.
LINK
Purpose: The aim of this study is to measure the concurrent validity of the Athletic Skills Track (AST) by examining whether its outcome score correlates with the holistic judgments of experts about the quality of movement. Method: Video recordings of children performing the AST were shown to physical education teachers who independently gave a holistic rating of the movement quality of each child. Results: Both intra- and interrater reliability of the teachers’ ratings were moderate to good. The holistic judgments on movement quality were significantly correlated with AST time, showing that higher ratings were associated with less time required to complete the track. Next, hierarchical stepwise regression indicated that in addition to the holistic rating, also age, but not gender, explained part of the variance in AST time. Conclusion: The findings show that the AST has good concurrent validity and provides a fast, indirect indication for quality of movement.
DOCUMENT
Research studies and recruitment processes often rely on psychometric instruments to profile respondents with regards to their ethical orientation. Completing such questionnaires can be tedious and is prone to self-presentation bias. Noting how video games often expose players to complex plots, filled with dilemmas and morally dubious options, the opportunity emerges to evaluate player’s moral orientation by analysing their in-game behaviour. In order to explore the feasibility of such an approach, we examine how users’ moral judgment correlates with choices they make in non-linear narratives, frequently present in video games. An interactive narrative presenting several moral dilemmas was created. An initial user study (N = 80) revealed only weak correlations between the users’ choices and their ethical inclinations in all ethical scales. However, by training a genetic algorithm on this data set to quantify the influence of each branch on recognising moral inclination we found a strong positive correlation between choice behaviour and self-reported ethical inclinations on a second independent group of participants (N = 20). The contribution of this work is to demonstrate how genetic algorithms can be applied in interactive stories to profile users’ ethical stance.
LINK
This article focuses on the recent judgment of the Court of Justice, Aranyosi and Caldararu. After conducting a legal analysis on this case, three issues are identified and they are separately discussed in three sections. The aim of this paper is to show the impact of this judgment on public order and public security in Europe on the one hand and on the individual’s fundamental rights, on the other hand. It is going to be argued that even though there are limits to the principle of mutual recognition, this new exception based on fundamental rights establishes a new procedure for non-surrender. Therefore, the Court of Justice creates a non-execution ground which the EU legislator did not intend to include in the Framework Decision on the European arrest warrant. This is explained by looking at the three interconnected notions of Freedom, Security and Justice.
DOCUMENT
A model for programmatic assessment in action is proposed that optimizes assessment for learning as well as decision making on learner progress. It is based on a set of assessment principles that are interpreted from empirical research. The model specifies cycles of training, assessment and learner support activities that are completed by intermediate and final moments of evaluation on aggregated data-points. Essential is that individual data-points are maximized for their learning and feedback value, whereas high stake decisions are based on the aggregation of many data-points. Expert judgment plays an important role in the program. Fundamental is the notion of sampling and bias reduction for dealing with subjectivity. Bias reduction is sought in procedural assessment strategies that are derived from qualitative research criteria. A number of challenges and opportunities are discussed around the proposed model. One of the virtues would be to move beyond the dominating psychometric discourse around individual instruments towards a systems approach of assessment design based on empirically grounded theory.
MULTIFILE
Current research on data in policy has primarily focused on street-level bureaucrats, neglecting the changes in the work of policy advisors. This research fills this gap by presenting an explorative theoretical understanding of the integration of data, local knowledge and professional expertise in the work of policy advisors. The theoretical perspective we develop builds upon Vickers’s (1995, The Art of Judgment: A Study of Policy Making, Centenary Edition, SAGE) judgments in policymaking. Empirically, we present a case study of a Dutch law enforcement network for preventing and reducing organized crime. Based on interviews, observations, and documents collected in a 13-month ethnographic fieldwork period, we study how policy advisors within this network make their judgments. In contrast with the idea of data as a rationalizing force, our study reveals that how data sources are selected and analyzed for judgments is very much shaped by the existing local and expert knowledge of policy advisors. The weight given to data is highly situational: we found that policy advisors welcome data in scoping the policy issue, but for judgments more closely connected to actual policy interventions, data are given limited value.
LINK
The main hypothesis underlying this article is that although arbitrators are not formally part of national justice systems, they have dealt with questions of EU fundamental rights and the European rule of law standards for quite some time, at least formally since the landmark CJEU judgment in Eco Swiss in 1999. In fact, in all forms of arbitration, be it national or international, taking place in or across (Member) States daily and not necessarily concerning the application by arbitrators of EU law stricto sensu, arbitrators can be seen as guardians of many crucial procedural guarantees that increase parties’ access to justice and advance the European rule of law, or so we wish to argue. This article is an exploratory piece. That is, it combines the format of the state-of-the-art review with the format of conference proceedings through which we present the main activities of the DG Justice TRIIAL project concerning arbitration. Our main goal is three-fold: (1) to advance the discussion on the relationship between the European rule of law and arbitration, (2) to present the main findings stemming from research and training activities within the TRIIAL training workshops on arbitration, and (3) to formulate future research and practical questions on the topic at hand.
MULTIFILE
Detecting practical problems of persons with dementia (PwD) experience at home, and advising them on solutions to facilitate aging in place are complex and challenging tasks for nurses and case managers. In this two group randomized, controlled laboratory experiment, the efficacy of a decision support application aiming to increase nurses' and case managers' confidence in clinical judgment and decision-making was tested. The participants (N = 67) assessed a case of a PwD within the problem domains: self-reliance, safety and informal care, and provided suggestions for possible solutions. Participants used either their regular procedure with (intervention group) or without the App (control group) to conduct these tasks. No statistically significant difference was found on the primary outcome measure, the overall level of confidence. However, nurses and case managers highly recommended use of the App in practice. To explain these results, more research on the potential added value of the App is needed.
DOCUMENT
From the article: Using Roger Crisp’s arguments for well-being as the ultimate source of moral reasoning, this paper argues that there are no ultimate, non-derivative reasons to program robots with moral concepts such as moral obligation, morally wrong or morally right. Although these moral concepts should not be used to program robots, they are not to be abandoned by humans since there are still reasons to keep using them, namely: as an assessment of the agent, to take a stand or to motivate and reinforce behaviour. Because robots are completely rational agents they don’t need these additional motivations, they can suffice with a concept of what promotes well-being. How a robot knows which action promotes well-being to the greatest degree is still up for debate, but a combination of top-down and bottom-up approaches seem to be the best way. The final publication is available at IOS Press through http://dx.doi.org/10.3233/978-1-61499-708-5-184
DOCUMENT
