Abstract Teaching project management is becoming a standard part of curricula in higher education. Assessing the added value of the teaching efforts needs pre- and post assessments. Given the wide variety of skills and knowledge project management embraces a proper assessment of project management is difficult. A method of assessing added value has been designed and tested on the first part of a professional Master in Project and Process Management. The design is based on students assessment of learning gains (SALG) with several extra criteria. The design was evaluated, updated and tested again. The third test with a tweaked design is being performed. The results do not convince that this SALG-based instrument can be used to measure added value. Presented at ICEE2015 : International conference on engineering education, 20th - 24th July 2015, Zagreb, Zadar (Croatia).
DOCUMENT
Formative assessment (FA) is an effective educational approach for optimising student learning and is considered as a promising avenue for assessment within physical education (PE). Nevertheless, implementing FA is a complex and demanding task for in-service PE teachers who often lack formal training on this topic. To better support PE teachers in implementing FA into their practice, we need better insight into teachers’ experiences while designing and implementing formative strategies. However, knowledge on this topic is limited, especially within PE. Therefore, this study examined the experiences of 15 PE teachers who participated in an 18-month professional development programme. Teachers designed and implemented various formative activities within their PE lessons, while experiences were investigated through logbook entries and focus groups. Findings indicated various positive experiences, such as increased transparency in learning outcomes and success criteria for students as well as increased student involvement, but also revealed complexities, such as shifting teacher roles and insufficient feedback literacy among students. Overall, the findings of this study underscore the importance of a sustained, collaborative, and supported approach to implementing FA.
DOCUMENT
Learning by Design (LBD) is a project-based inquiry approach for interdisciplinary teaching that uses design contexts to learn skills and conceptual knowledge. Research around the year 2000 showed that LBD students achieved high skill performances but disappointing conceptual learning gains. A series of exploratory studies, previous to the study in this paper, indicated how to enhance concept learning. Small-scale tested modifications, based on explicit teaching and scaffolding, were promising and revealed improved conceptual learning gains. The pretest-posttest design study discussed in this paper confirms this improvement quantitatively by comparing the conceptual learning gains for students exposed to the modified approach (n = 110) and traditional approach (n = 77). Further modifications, which resulted in a remodified approach tested with 127 students, show a further improvement through reduced fragmentation of the task and addressed science. Overall, the remodified approach (FITS model: Focus - Investigation - Technological design - Synergy) enriches technology education by stimulating an empirical and conceptual way of creating design solutions.
DOCUMENT
The purpose of this study was to provide insight into the interplay between student perceptions of competence-based assessment and student self-efficacy, and how this influences student learning outcomes. Results reveal that student perceptions of the form authenticity aspect and the quality feedback aspect of assessment do predict student self-efficacy, confirming the role of mastery experiences and social persuasions in enhancing student self-efficacy as stated by social cognitive theory. Findings do not confirm mastery experiences as being a stronger source of self-efficacy information than social persuasions. Study results confirm the predictive role of students’ self-efficacy on their competence outcomes. Mediation analysis results indicate that student’s perceptions of assessment have an indirect effect on student’s competence evaluation outcomes through student’s self-efficacy. Study findings highlight which assessment characteristics, positively influencing students’ learning, contribute to the effectiveness of competence-based education. Limitations of the study and directions for future research are indicated.
DOCUMENT
The advantages and drawbacks of components of flexible assessment have been studied mostly from the standpoint of students and, to a lesser extent, teachers. A gap persists in understanding the collective perspectives of teachers and students concerning flexible assessment. This study aimed to explore experiences and perspectives of students and teachers regarding flexible assessment within the specific context of nursing education. Seven focus groups comprised four sessions with teachers and three with students, each involving 5-8 participants. Results showed that students and teachers have a predominantly positive perspective towards flexible assessment. They acknowledge the opportunities that flexible assessment provides for diverse forms to present evidence. However, concerns were raised regarding the design of flexible assessments, issues of fairness in rating evidence, and the understanding among teachers and students regarding the assessment processes. Additionally, discussions focused on the perceived benefit of flexible assessments, particularly concerning the time investment required for their implementation and evaluation. In conclusion, the success of flexible assessments is contingent on the careful consideration of its design, ensuring equitable evaluation of evidence, and fostering comprehensive understanding among both teachers and students. Recognizing potential disparities in views of students and teachers offers valuable insights into the effectiveness of flexible assessment. Achieving a balance between the flexibility of assessment formats, aligned forms of evidence, and an appropriate rating methodology is crucial for effective implementation.
DOCUMENT
In honours programmes, teachers face the task of designing courses in which students feel challenged and learn from accomplishing demanding assignments. The aim of this study was to investigate students’ and teachers’ perceptions of challenge and learning in an honours programme. From 2016 to 2019, students and teachers rated the learning activities during the programme and explained their ratings. The results showed that in the first two years, teachers estimated challenge and learning significantly higher than the students did. However, both students and teachers viewed the tasks as the factor with the strongest impact on challenge and learning. In the first year, students also identified group dynamics as challenging and a source for learning. Enhancing task complexity and supporting group dynamics are the main factors to adjust the level of challenge in an honours programme. Monitoring students’ and teachers’ perceptions can help to adapt the programme to improve students’ learning.
MULTIFILE
From the article: "Various programs in higher education feel a need to teach project management skills to students. Measuring the effect of education is a challenge especially when focused on behavioral skills. Research on learning gains usually turns to the method of Students Assessment of Learning Gains (SALG), which can be questioned on reliability. This article constructs five design criteria for an improved Students Assessment of Learning Gains (SALG): measure satisfaction, use pre- and posttests, use perceived ability, account for learning stage one and account for attrition. A first test on a semester of a professional master in project management yields ambiguous results. The second test with a 360 degrees measurement is performed on the same semester with different students. The post test is scheduled for June 2014, results will be reported at the World Congress."
MULTIFILE
Background: The importance of clarifying goals and providing process feedback for student learning has been widely acknowledged. From a Self-Determination Theory perspective, it is suggested that motivational and learning gains will be obtained because in well-structured learning environments, when goals and process feedback are provided, students will feel more effective (need for competence), more in charge over their own learning (need for autonomy) and experience a more positive classroom atmosphere (need for relatedness). Yet, in spite of the growing theoretical interest in goal clarification and process feedback in the context of physical education (PE), little experimental research is available about this topic. Purpose: The present study quasi-experimentally investigated whether the presence of goal clarification and process feedback positively affects students’ need satisfaction and frustration. Method: Twenty classes from five schools with 492 seventh grade PE students participated in this quasi-experimental study. Within each school, four classes were randomly assigned to one of the four experimental conditions (n = 121, n = 117, n = 126 and n = 128) in a 2 × 2 factorial design, in which goal clarification (absence vs. presence) and process feedback (absence vs. presence) were experimentally manipulated. The experimental lesson consisted of a PE lesson on handstand (a relatively new skill for seventh grade students), taught by one and the same teacher who went to the school of the students to teach the lesson. Depending on the experimental condition, the teacher either started the lesson explaining the goals, or refrained from explaining the goals. Throughout the lesson the teacher either provided process feedback, or refrained from providing process feedback. All other instructions were similar across conditions, with videos of exercises of differential levels of difficulty provided to the students. All experimental lessons were observed by a research-assistant to discern whether manipulations were provided according to a condition-specific script. One week prior to participating in the experimental lesson, data on students’ need-based experiences (i.e. quantitatively) were gathered. Directly after students’ participation in the experimental lesson, data on students’ perceptions of goal clarification and process feedback, need-based experiences (i.e. quantitatively) and experiences in general (i.e. qualitatively) were gathered. Results and discussion: The questionnaire data and observations revealed that manipulations were provided according to the lesson-scripts. Rejecting our hypothesis, quantitative analyses indicated no differences in need satisfaction across conditions, as students were equally satisfied in their need for competence, autonomy and relatedness regardless of whether the teacher provided goal clarification and process feedback, only goal clarification, only process feedback or none. Similar results were found for need frustration. Qualitative analyses indicated that, in all four conditions, aspects of the experimental lesson made students feel more effective, more in charge over their own learning and experience a more positive classroom atmosphere. Our results suggest that under certain conditions, lessons can be perceived as highly need-satisfying by students, even if the teacher does not verbally and explicitly clarify the goals and/ or provides process feedback. Perhaps, students were able to self-generate goals and feedback based on the instructional videos.
DOCUMENT
Communication plays an important role in manyprofessional contexts. This is especially truefor students in the field of social work. Theaim of this study was to develop formative,self-regulated multimedia self-assessment ofsocial-communicative competencies for socialwork students. First, a pilot study wasconducted to gain insight into the students'specific characteristics. This insight was usedto design guidelines for the development of theassessment instrument in order to tune these tothe students' perceptions, instructionalpreferences, and personalities and thusenhancing the students' enthusiasm to use theself-assessment instrument. This might increasethe chance for successful implementation ofthis new form of assessment. A first version of a multimedia test wasdeveloped. A quality expert meeting wasorganised to gain insight into expertjudgements on the quality of the test and toobtain indications for improvement of theassessment. A second version of the test wasconstructed and put on the Internet. Nearly 400students completed the assessment and expressedtheir opinions on this new way of communicationassessment. We found it was possible to testsocial-communicative competence by means ofmultimedia, with the help of digital video. Theuse of Internet makes assessments available atany time to fit curriculum needs and alsoresolves time and space constraints. Ourconclusion was that the multimedia test isreasonably valid. All students reported havingliked the multimedia assessment.
LINK
This chapter explores qualitative career assessment as an identity learning process where meaning-oriented learning is essential and distinguished from conditioned or semantic types of learning. In order to construct a career identity in the form of a future-oriented narrative, it is essential that learners are helped through cognitive learning stages with the help of a dialogue about concrete experiences which aims to pay attention to emotions and broadens and deepens what is expressed.
DOCUMENT
