The main purpose of the research was the development and testing of an assessment tool for the grading of Dutch students' performance in information problem solving during their study tasks. Scholarly literature suggests that an analytical scoring rubric would be a good tool for this.Described in this article are the construction process of such a scoring rubric and the evaluation of the prototype based on the assessment of its usefulness in educational practice, the efficiency in use and the reliability of the rubric. To test this last point, the rubric was used by two professors when they graded the same set of student products. 'Interrater reliability' for the professors' gradings was estimated by calculating absolute agreement of the scores, adjacent agreement and decision consistency. An English version of the scoring rubric has been added to this journal article as an appendix. This rubric can be used in various discipline-based courses in Higher Education in which information problem solving is one of the learning activities. After evaluating the prototype it was concluded that the rubric is particularly useful to graders as it keeps them focussed on relevant aspects during the grading process. If the rubric is used for summative evaluation of credit bearing student work, it is strongly recommended to use the scoring scheme as a whole and to let the grading work be done by at least two different markers. [Jos van Helvoort & the Chartered Institute of Library and Information Professionals-Information Literacy Group]
DOCUMENT
Purpose: The main purpose of the research was to measure reliability and validity of the Scoring Rubric for Information Literacy (Van Helvoort, 2010). Design/methodology/approach: Percentages of agreement and Intraclass Correlation were used to describe interrater reliability. For the determination of construct validity, factor analysis and reliability analysis were used. Criterion validity was calculated with Pearson correlations. Findings: In the described case, the Scoring Rubric for Information Literacy appears to be a reliable and valid instrument for the assessment of information literate performance. Originality/value: Reliability and validity are prerequisites to recommend a rubric for application. The results confirm that this Scoring Rubric for Information Literacy can be used in courses in higher education, not only for assessment purposes but also to foster learning. Oorspronkelijke artikel bij Emerald te vinden bij http://dx.doi.org/10.1108/JD-05-2016-0066
MULTIFILE
The purpose of this article is to expand on a previous study on the development of a scoring rubric for information literacy1. The present paper examines how students at the Department of Information Services and Information Management, The Hague University, use the scoring rubric for their school work and/or in their regular jobs and social life. The research presented here focuses on a group of adult students who follow a part time evening variant of the Bachelor curriculum. The methods employed in this study consisted of an online survey to select students who had used the scoring rubric at least once after the workshop in which it was introduced. Following on from this, a focus group with respondents who had answered positively to the invitation at the end of the survey was organised and chaired by a neutral moderator. Samples that could be used in this research were very small. The findings may therefore not be generalized to all other groups of students. However, the results appear to be of relevance to the IL community. The students who participated in the focus group reported that they used it for self-assessment throughout the course, in subsequent courses, and to become more critical of their own writings and those of other people. The research also makes clear that adult students appreciate the feedback generated by completing the scoring rubric form but that this is not a substitute for the face-to-face feedback they receive from their teachers. [Dit is de auteursversie waarvoor Elsevier toestemming heeft gegeven.]
DOCUMENT
