Academic cheating poses a significant challenge to conducting fair online assessments. One common way is collusion, where students unethically share answers during the assessment. While several researchers proposed solutions, there is lack of clarity regarding the specific types they target among the different types of collusion. Researchers have used statistical techniques to analyze basic attributes collected by the platforms, for collusion detection. Only few works have used machine learning, considering two or three attributes only; the use of limited features leading to reduced accuracy and increased risk of false accusations. In this work, we focus on In-Parallel Collusion, where students simultaneously work together on an assessment. For data collection, a quiz tool is improvised to capture clickstream data at a finer level of granularity. We use feature engineering to derive seven features and create a machine learning model for collusion detection. The results show: 1) Random Forest exhibits the best accuracy (98.8%), and 2) In contrast to less features as used in earlier works, the full feature set provides the best result; showing that considering multiple facets of similarity enhance the model accuracy. The findings provide platform designers and teachers with insights into optimizing quiz platforms and creating cheat-proof assessments.
DOCUMENT
Het doel van dit is boek is om de lezer te wijzen op de gevarieerde en innovatieve methodes om de 'lessen' informatievaardigheden, die reeds geïntegreerd zijn in het curriculum, te beoordelen en na die beoordeling (eventueel) te verbeteren.
DOCUMENT
'Op weg naar assessments...'is deel 2 uit de Bilobareeks. In deze notitie voor Fontysmedewerkers staat de Fontysvisie op toetsing en assessment beschreven. Daarnaast is een stappenplan beschreven om instituten en medewerkers ondersteuning te bieden bij het ontwerpen van assessments.
DOCUMENT
Professionalisering in het Onderwijs door Formatieve Assessments (Proformas) is een virtuele werkomgeving die (beginnende) leraren helpt inzicht te krijgen in de eigen competentieontwikkeling en de stappen die gezet kunnen worden bij de verdere competentieontwikkeling van leraren zoals de pedagogische en de didactische competenties. Proformas geeft de leraar de mogelijkheid om kenmerkende beroepssituaties te bekijken en te analyseren en te reflecteren op eigen vaardigheden. Een evaluatie van Proformas laat zien dat het instrument een bijdrage kan leveren aan het leren van leraren.
DOCUMENT
The overall objective of project OC/EFSA/AMU/2018/01 was to support EFSA to develop in-house capacity to collect, appraise and synthesize evidence coming from literature sources in the context of food and feed scientific assessment. This objective had to be reached by offering 3 different types of training courses to EFSA staff (including Trainees) and Experts (of Panels, Working Groups and Member States). This report summarizes these trainings and their evaluation. Between 15 October 2018 and 24 November 2020, 9 trainings were delivered by a team of trainers from SYRCLE (SYstematic Review Centre for Laboratory animal Experimentation, www.syrcle.nl) and partners. A total number of 160 people participated in these trainings (an average of 18 per training), some of whom participated in more than one training (day). The individual trainings were evaluated using an online evaluation form, which consisted of general questions (e.g. about the training room or course material) and specific questions about the various parts of the training courses. The participants had the option of adding qualitative comments. Moreover, a so-called second level evaluation was used to assess the extent to which the trainings improved the capacity of participants to use the techniques explained in the courses in the context of EFSA assessments. With an average score of 8.23 (out of 10), the trainings were evaluated very positively. Major revisions of the content were only necessary for two of the courses and only after the first editions. Overall, the participants assessed their knowledge and practical skills to be higher after the training compared to before. Moreover, two of the online editions of the courses received an EFSA Golden Globe for the most successful EFSA scientific courses delivered in 2020. Based on the experiences with this series of trainings, recommendations are made for future EFSA trainings in evidence synthesis.
DOCUMENT
De open universiteit heeft de opdracht gekregen om een virtuele leer- en werkomgeving te ontwerpen voor de professionalisering van leraren. Hiervoor zijn meerdere instrumenten ontwikkeld onder andere Proformas een digitale leeromgeving voor formatieve assessments. Doel leraren te helpen om inzicht te krijgen in eigen ontwikkeling. Hiervoor zijn verschillende assessment opdrachten ontwikkeld, inclusief mogelijkheden voor feedback, op drie niveau's (makkelijk-gemiddeld-moeilijk).Leraren kunnen hierbij hun eigen leerpad uitzetten.
DOCUMENT
Empathy is an important competence for communication professionals. This article investigates two aspects of empathy in an educational setting: the validity of self versus other assessments and the manifestation of empathy in communicative behaviors. Communication students were given a mediating role in discussions with two clients and their empathy was measured using self-ratings and client assessments. Videos of highest- and lowest-rated students were analyzed to identify empathy-related behaviors. No correlation was found between self-rated empathy and clients’ assessments. Several verbal and nonverbal behaviors corresponded to empathy: body language, an other-orientation in asking questions, paraphrasing, and a solution orientation.
DOCUMENT
This paper discusses challenges in assessing design students within studio model education. It reflects on the assessment methods used in the M.Sc. Digital Design, Amsterdam University of Applied Sciences, with input from an online survey targeting former students and assessors of the programme. Building on the particularities they see in this assessment process and its perceived advantages and disadvantages; we reflect on the extent to which these methods respond to the intentions for their development. Lastly, we discuss these issues in relation to the literature with the purpose of providing input to others that, like us, are in search of improved assessment tools for studio-based education.
MULTIFILE
Objective: This exploratory study investigated to what extent gait characteristics and clinical physical therapy assessments predict falls in chronic stroke survivors. Design: Prospective study. Subjects: Chronic fall-prone and non-fall-prone stroke survivors. Methods: Steady-state gait characteristics were collected from 40 participants while walking on a treadmill with motion capture of spatio-temporal, variability, and stability measures. An accelerometer was used to collect daily-life gait characteristics during 7 days. Six physical and psychological assessments were administered. Fall events were determined using a “fall calendar” and monthly phone calls over a 6-month period. After data reduction through principal component analysis, the predictive capacity of each method was determined by logistic regression. Results: Thirty-eight percent of the participants were classified as fallers. Laboratory-based and daily-life gait characteristics predicted falls acceptably well, with an area under the curve of, 0.73 and 0.72, respectively, while fall predictions from clinical assessments were limited (0.64). Conclusion: Independent of the type of gait assessment, qualitative gait characteristics are better fall predictors than clinical assessments. Clinicians should therefore consider gait analyses as an alternative for identifying fall-prone stroke survivors.
DOCUMENT
Background: Regular inspection of the oral cavity is required for prevention, early diagnosis and risk reduction of oral- and general health-related problems. Assessments to inspect the oral cavity have been designed for non-dental healthcare professionals, like nurses. The purpose of this systematic review was to evaluate the content and the measurement properties of oral health assessments for use by non-dental healthcare professionals in assessing older peoples’ oral health, in order to provide recommendations for practice, policy, and research. Methods: A systematic search in PubMed, EMBASE.com, and Cinahl (via Ebsco) has been performed. Search terms referring to ‘oral health assessments’, ‘non-dental healthcare professionals’ and ‘older people (60+)’ were used. Two reviewers individually performed title/abstract, and full-text screening for eligibility. The included studies have investigated at least one measurement property (validity/reliability) and were evaluated on their methodological quality using “The Consensus-based Standards for the selection of health Measurement Instruments” (COSMIN) checklist. The measurement properties were then scored using quality criteria (positive/negative/indeterminate). Results: Out of 879 hits, 18 studies were included in this review. Five studies showed good methodological quality on at least one measurement property and 14 studies showed poor methodological quality on some of their measurement properties. None of the studies assessed all measurement properties of the COSMIN. In total eight oral health assessments were found: the Revised Oral Assessment Guide (ROAG); the Minimum Data Set (MDS), with oral health component; the Oral Health Assessment Tool (OHAT); The Holistic Reliable Oral Assessment Tool (THROAT); Dental Hygiene Registration (DHR); Mucosal Plaque Score (MPS); The Brief Oral Health Screening Examination (BOHSE) and the Oral Assessment Sheet (OAS). Most frequently assessed items were: lips, mucosa membrane, tongue, gums, teeth, denture, saliva, and oral hygiene. Conclusion: Taken into account the scarce evidence of the proposed assessments, the OHAT and ROAG are most complete in their included oral health items and are of best methodological quality in combination with positive quality criteria on their measurement properties. Non-dental healthcare professionals, policymakers and researchers should be aware of the methodological limitations of the available oral health assessments and realize that the quality of the measurement properties remains uncertain.
DOCUMENT
