Serious games foster the acquisition of complex problem-solving skills. Assessment of such skills should be in line with instruction, and within a serious game environment its content validity should equal face-to-face assessment. Research on assessment in serious gaming has remained rather scarce. This article shows how assessment can be implemented in serious gaming in a way that assures content validity. The core of the authors’ validation method entails mapping learning activities (as contained in the game scenario) on performance indicators and outputs (as derived from formal attainment levels). They present how they have elaborated and applied the method for an assessment game for ICT managers in secondary vocational education. They describe the procedure and extent to which this assessment is content-valid compared to face-to-face assessment.
LINK
This technical report describes "validation of the 'Target system definition"
DOCUMENT
Abstract: Clinicians find it challenging to engage with patients who engage in self-harm. Improving the self-efficacy of professionals who treat self-harm patients may be an important step toward accomplishing better treatment of self-harm. However, there is no instrument available that assesses the self-efficacy of clinicians dealing with self-harm. The aim of this study is to describe the development and validation of the Self-Efficacy in Dealing with Self-Harm Questionnaire (SEDSHQ). This study tests the questionnaire’s feasibility, test-retest reliability, internal consistency, content validity, construct validity (factor analysis and convergent validity) and sensitivity to change. The Self-Efficacy in Dealing with Self-Harm Questionnaire is a 27-item instrument which has a 3-factor structure, as found in confirmatory factor analysis. Testing revealed high content validity, significant correlation with a subscale of the Attitude Towards Deliberate Self-Harm Questionnaire (ADSHQ), satisfactory test-retest correlation and a Cronbach’s alpha of 0.95. Additionally, the questionnaire was able to measure significant changes after an intervention took place, indicating sensitivity to change. We conclude that the present study indicates that the Self-Efficacy in Dealing with Self-Harm Questionnaire is a valid and reliable instrument for assessing the level of self-efficacy in response to self-harm.
DOCUMENT
Within rehabilitation, there is a great need for a simple method to monitor wheelchair use, especially whether it is active or passive. For this purpose, an existing measurement technique was extended with a method for detecting self- or attendant-pushed wheelchair propulsion. The aim of this study was to validate this new detection method by comparison with manual annotation of wheelchair use. Twenty-four amputation and stroke patients completed a semi-structured course of active and passive wheelchair use. Based on a machine learning approach, a method was developed that detected the type of movement. The machine learning method was trained based on the data of a single-wheel sensor as well as a setup using an additional sensor on the frame. The method showed high accuracy (F1 = 0.886, frame and wheel sensor) even if only a single wheel sensor was used (F1 = 0.827). The developed and validated measurement method is ideally suited to easily determine wheelchair use and the corresponding activity level of patients in rehabilitation.
DOCUMENT
ObjectiveTo identify malnutrition assessment methods in cancer patients and assess their content validity based on internationally accepted definitions for malnutrition.Study Design and SettingSystematic review of studies in cancer patients that operationalized malnutrition as a variable, published since 1998. Eleven key concepts, within the three domains reflected by the malnutrition definitions acknowledged by European Society for Clinical Nutrition and Metabolism (ESPEN) and the American Society for Parenteral and Enteral Nutrition (ASPEN): A: nutrient balance; B: changes in body shape, body area and body composition; and C: function, were used to classify content validity of methods to assess malnutrition. Content validity indices (M-CVIA–C) were calculated per assessment method. Acceptable content validity was defined as M-CVIA–C ≥ 0.80.
DOCUMENT
PCK is seen as the transformation of content knowledge and pedagogical knowledge into a different type of knowledge that is used to develop and carry out teaching strategies. To gain more insight into the extent to which PCK is content specific, the PCK about more topics or concepts should be compared. However, researchers have rarely compared teachers’ concrete PCK about more than one topic. To examine the content dependency of PCK, we captured the PCK of sixteen experienced Dutch history teachers about two historical contexts (i.e. topics) using interviews and Content Representation questionnaires. Analysis reveals that all history teachers’ PCK about the two contexts overlaps, although the degree of overlap differs. Teachers with relatively more overlap are driven by their overarching subject related goals and less by the historical context they teach. We discuss the significance of these outcomes for the role of teaching orientation as a part of PCK.
DOCUMENT
Pedagogical content knowledge is found to be a crucial part of the knowledge base for teaching. Studies in the field of primary technology education showed that this domain of teacher knowledge is related to pupils' increased learning, motivation,and interest. The common methods to investigate teachers' pedagogical content knowledge are often complicated, and time and labour consuming. Hence, a challenge in measuring teachers' pedagogical content knowledge is to construct an instrument that is time and labour-efficient, and makes it possible to investigate large sample sizes. This paper illustrates how a multiple-choice test to measure teachers' pedagogical content knowledge in primary technology education was designed and validated. The procedure of test construction and the first results are presented. It is concluded that the systematic procedure that was followed is effective for the construction of a valid test. In addition, statistical analyses showed that test/re-test reliability is moderate. Data collection with larger samples is needed in order to find more statistical support for the psychometric properties of the test.
DOCUMENT
BackgroundFor families with adolescent children, the transition to adulthood is usually challenging. This period may be extra demanding for families with a child with profound intellectual and multiple disabilities due to the child's strong and persistent support needs. To support these families during this phase and to facilitate the transition process of these adolescents, we adapted the Canadian skills for growing up (SGU) into the skills for growing up-profound intellectual and multiple disabilities (SGU-PIMD). The aim of this study is to determine its content validity.MethodA Delphi study with family members and healthcare professionals was conducted.ResultsResults showed good content validity. However, the Delphi panel suggested minor adjustments to improve relevance, comprehensibility and comprehensiveness.ConclusionsThe current SGU-PIMD can be used in practice for supporting adolescents with profound intellectual and multiple disabilities. However, there are also recommendations for research into the feasibility and acceptability of the instrument.
DOCUMENT
This report describes "a framework that delivers insight into the tangible and intangible effects of a mobile (IT) system, before it is being implemented".
DOCUMENT
Communicative participation is the most important outcome of speech and language therapy, but there are no measurement instruments for children, adolescents, and young adults. This paper describes the development of MyCommunication-Youth: an item bank to measure self-reported communicative participation in children, adolescents and young adults with various communication disorders.
MULTIFILE