AIM: This paper is a report of the development and testing of the psychometric properties of an instrument to measure the accuracy of nursing documentation in general hospitals.BACKGROUND: Little information is available about the accuracy of nursing documentation. None of the existing instruments that quantify accuracy of nursing diagnoses, interventions, and progress and outcome evaluations are suitable to measure documentation in general hospital environments, nor were they intended for this purpose.METHOD: The D-Catch instrument, based on the Cat-ch-Ing instrument and the Scale for Degrees of Accuracy in Nursing Diagnoses, was developed in 2007-2008. Content validity of the D-Catch instrument was assessed by two Delphi panels, in which pairs of independent reviewers assessed 245 patient records in seven hospitals in the Netherlands. Construct validity was assessed by explorative factor analysis with principal components and varimax rotation. Internal consistency was measured by Cronbach's alpha. The inter-rater reliability of the D-Catch instrument was tested by calculating Cohen's weighted kappa (K(w)) for each pair of reviewers. Results. Quantity and quality variables were used to assess the accuracy of nursing documentation. Three constructs were identified in the factor analysis. 'Accuracy of the nursing diagnosis' was the only variable with substantial loading on component two (0.907) and a modest loading on component one (0.230). Internal consistency (Cronbach's alpha) was 0.722. The inter-rater reliability (K(w)) varied between 0.742 and 0.896.CONCLUSION: The D-Catch instrument is a valid and reliable measurement instrument to assess nursing documentation in general hospital settings.
DOCUMENT
This paper proposes and showcases a methodology to develop an observational behavior assessment instrument to assess psychological competencies of police officers. We outline a step-by-step methodology for police organizations to measure and evaluate behavior in a meaningful way to assess these competencies. We illustrate the proposed methodology with a practical example. We posit that direct behavioral observation can be key in measuring the expression of psychological competence in practice, and that psychological competence in practice is what police organizations should care about. We hope this paper offers police organizations a methodology to perform scientifically informed observational behavior assessment of their police officers’ psychological competencies and inspires additional research efforts into this important area.
MULTIFILE
This paper presents the development and construct validation of an instrument for identification of resilient and less-resilient middle adolescents in high school. Purpose of this identification is a qualitative in-depth interview study of perceptions of resilient and less resilient middle-adolescents on their school environment. The qualitative study will function as examination of contentvalidity of the presented instrument. A 33-item Resilient Behavior Questionnaire (VVL) and a 105-item personality questionnaire NPV-J (Dutch Personality Questionnaire- Youngsters) were administered to a sample of 400 middle adolescent high school students (age range 14-16). It was hypothesized that scores on specific components in the VVL would correlate highly with relevant factors of personality in the NPV-J. Principal Component Analysis and Correlation Analysis served as methods of investigation. Results of the quantitative study reveal three components in the VVL and a high correlation between the scores on these components and the resilient personality factor perseverance and non-resilient factor inadequacy in the NPV-J. Discussion focuses on explanation of the results and implications for further development of the VVL.
DOCUMENT
The quality of teaching has a clear impact on student success, but how can good teaching be defined? The European QualiTePE research project, funded by the Erasmus+ programme and involving ten European countries, seeks to adress this question specifically for Physical Education (PE). The QualiTePE instrument was designed for use in teacher training and further training to enable criteria-based observation and assessment of the quality of Physical Education lessons. The instrument is designed for diverse PE teaching and learning scenarios, alongside teacher resources, facilitating the practical assessment of teaching quality in PE. The QualiTePE instrument quantifies teaching quality by assessing specific, observable teaching characteristics via questionnaire items. Each assessment is conducted by three different population groups: 1) the students 2) the PE teacher 3) an observer. The comparative analysis of the data collected from these three perspectives enables systematic and criteria‐based feedback for (prospective) teachers, identifies areas of improvement, and informs content development for PE across Europe. The QualiTePE digital web-based evaluation tool for assessing the “Quality of Teaching in Physical Education” is now available in English, German, French, Italian, Spanish, Dutch, Swedish, Slovenian, Czech and Greek.
DOCUMENT
This PhD research project is about how Dutch development NGOs use social media for their development projects. For this, the following research question has been investigated: how do Dutch development NGOs use social media to further the development activities of their organisations? The purpose of this study is to understand how development NGOs are trying to get to grips with social media. Given the exploratory nature of this research, a qualitative research approach was adopted. Both case studies and the grounded theory method were used for this study. This combination is ideal because with a case study one tries to understand, or explore a phenomenon, whereas, in grounded theory studies, one tries to build theory. Given that this study is concerned with how Dutch development NGOs perceive social media for their development projects, an interpretive paradigm seems appropriate. The grounded theory methodology for this research is consistent with the epistemology of interpretivism. The combination of case study research and grounded theory works well for theory building and has been applied in Information Systems and ICT for Development studies before. As the use of theory before data collection is in opposition to the principle idea of the grounded theory methodology, in which theory emerges from the data, this needs to be addressed when combining case studies and grounded theory. This issue was resolved by using an initial highlevel conceptual framework as a guiding instrument for both the noncommittal literature research and for the conceptualisation of the research problem, whilst not distorting the emergence of theory from the data. This study focuses on formally organised development NGOs who receive funding from the Dutch Ministry of Foreign Affairs for their development projects. From the approximately 100 organisations, fourteen NGOs were selected for this study. The choice of fourteen NGOs was driven by a theoretical sampling strategy. Data was collected via semi-structured interviews with 18 respondents and field-notes of meetings or events of 14 development NGOs. The data was analysed using the Glaserian coding procedure of grounded theory, starting with open coding, followed by selective coding, and ending with theoretical coding. Three major themes (or core categories as they are called in the grounded theory method), were identified. This study's first contribution is captured in the theme ‘NGO Enacting Values in Development’. This is about how an organisation’s values are enacted in the context of international development. The organisational mixture of development mind-sets influences organisational activities in development. The ideological trends that are stimulated by societal and technological changes have an impact on the organisation’s development strategy and the strategic collaboration network of development NGOs. The second contribution of this study is captured in the theme ‘NGO’s Views on Social Media Use’. This core category discusses the organisation’s view on the meaning of social media and includes the four following categories: technological, individual, collective and contextual views attributed to organisational social media. The four categories empirically demonstrate the concept of affordance clusters and the connections between them. The study’s third contribution is captured in the theme ‘NGO’s Use of Social Media in Development’, encompassing the social media activities of the studied development NGOs in their development projects. This has led to an assessment framework of organisational social media use by development NGOs, constructed by cross-referencing the organisational goals of development NGOs to the social media activity areas in the context of development. These themes represented by three core categories are inter-related. Feedback loops between NGO’s values in development, views on social media, and the actual uses of social media for development purposes have been discerned. This grounded theory study aims to build an initial theory of how NGOs might approach the use of social media in a development context. This qualitative study has produced some new concepts. This study has led to a substantive theory in the context of international development. Furthermore, this substantive theory is compared with three theory lenses, when applied on the data collected for this PhD research, in their ability to identify similar concepts as reached with the substantive theory following the grounded theory method. Finally, the thesis presents some avenues for future research that may help expand the substantive theory that has been developed under this research to formal theory
LINK
Existing observation instruments to measure differentiated instruction often lack insight into the degree to which teachers’ decisions match the actual needs of their students, and neglect the importance of preparation and evaluation. This article describes the psychometric evaluation of a comprehensive instrument (Assessing Differentiation in All Phases of Teaching; ADAPT) that does not suffer from these shortcomings. To assess its quality, 41 raters used it to score videos of lessons and interviews of 86 primary school teachers. A 5-dimensional item-response model showed good fit and high internal consistency, and a decision study was conducted to determine the reliability and agreement coefficients for different numbers of raters. For the intended low-stakes use, a single rater would be enough to provide a reliable estimate of a teacher’s overall score. Finally, rater experiences showed that ADAPT has high practical value due to the comprehensive manual and detailed score descriptions and examples. The instrument can therefore not only be used for research purposes, but can also serve as a valuable resource for teachers and teacher educators in practice.
LINK
Hoe vindt praktijkverandering plaats? Wat is ervoor nodig? Wie is ervoor nodig? Op deze en andere vragen hebben talloze veranderkundigen al hun hoofd gebogen. De praktijk is immers weerbarstig, zo zegt men. Een verandering in de praktijk heeft vaak een tijdelijk karakter en veel veranderingen beklijven niet. Dat is jammer. In dit boek worden de methodiek van Practice Development uiteengezet. Zowel de achtergronden, de systematiek als concrete praktijkvoorbeelden passeren daarbij de revue. Practice Development wordt in dit boek beschreven als een cyclische methodiek (met als acroniem PDDOEN) waarmee gezondheids- en onderwijsmedewerkers direct aan de slag kunnen om personen en praktijken duurzaam te veranderen. Dus geen tijdelijke verandering, maar verandering die gedragen wordt door en verankerd is in mensen. Zowel voorbeelden uit de zorg als het onderwijs illustreren de methodiek die tot deze veranderingen leidt. Het boek bevat codes (QR-codes) die verwijzen naar relevante informatie en instrumenten op een website die hiervoor is ontwikkeld. Doelgroep Practice Development is bestemd voor studenten in de gezondheidszorg en aan lerarenopleidingen.
DOCUMENT
Author supplied: Based on the Enterprise Architecture Value Framework (EAVF) - a generic framework to classify benefits of Enterprise Architecture (EA) - a measurement instrument for EA benefits has been developed and tested in a survey with 287 respondents. In this paper we present the results of this survey in which stakeholders of EA were questioned about the kind of benefits they experience from EA in their organization. We use the results of the survey to evaluate the framework and develop a foundation for the measurement instrument. The results of the survey show a moderate support for the assumptions underlying the framework. Applying ordinal regression, we derived sets of questions for ten out of the twelve classes in the framework. These sets constitute the first step in defining a final EA measurement instrument for establishing actual benefits in the classes of the framework.
LINK
Communication plays an important role in manyprofessional contexts. This is especially truefor students in the field of social work. Theaim of this study was to develop formative,self-regulated multimedia self-assessment ofsocial-communicative competencies for socialwork students. First, a pilot study wasconducted to gain insight into the students'specific characteristics. This insight was usedto design guidelines for the development of theassessment instrument in order to tune these tothe students' perceptions, instructionalpreferences, and personalities and thusenhancing the students' enthusiasm to use theself-assessment instrument. This might increasethe chance for successful implementation ofthis new form of assessment. A first version of a multimedia test wasdeveloped. A quality expert meeting wasorganised to gain insight into expertjudgements on the quality of the test and toobtain indications for improvement of theassessment. A second version of the test wasconstructed and put on the Internet. Nearly 400students completed the assessment and expressedtheir opinions on this new way of communicationassessment. We found it was possible to testsocial-communicative competence by means ofmultimedia, with the help of digital video. Theuse of Internet makes assessments available atany time to fit curriculum needs and alsoresolves time and space constraints. Ourconclusion was that the multimedia test isreasonably valid. All students reported havingliked the multimedia assessment.
LINK
This paper proposes and showcases a methodology to develop an observational behavior assessment instrument to assess psychological competencies of police officers. We outline a step-by-step methodology for police organizations to measure and evaluate behavior in a meaningful way to assess these competencies. We illustrate the proposed methodology with a practical example. We posit that direct behavioral observation can be key in measuring the expression of psychological competence in practice, and that psychological competence in practice is what police organizations should care about. We hope this paper offers police organizations a methodology to perform scientifically informed observational behavior assessment of their police officers’ psychological competencies and inspires additional research efforts into this important area.
MULTIFILE
