AIM: This paper is a report of the development and testing of the psychometric properties of an instrument to measure the accuracy of nursing documentation in general hospitals.BACKGROUND: Little information is available about the accuracy of nursing documentation. None of the existing instruments that quantify accuracy of nursing diagnoses, interventions, and progress and outcome evaluations are suitable to measure documentation in general hospital environments, nor were they intended for this purpose.METHOD: The D-Catch instrument, based on the Cat-ch-Ing instrument and the Scale for Degrees of Accuracy in Nursing Diagnoses, was developed in 2007-2008. Content validity of the D-Catch instrument was assessed by two Delphi panels, in which pairs of independent reviewers assessed 245 patient records in seven hospitals in the Netherlands. Construct validity was assessed by explorative factor analysis with principal components and varimax rotation. Internal consistency was measured by Cronbach's alpha. The inter-rater reliability of the D-Catch instrument was tested by calculating Cohen's weighted kappa (K(w)) for each pair of reviewers. Results. Quantity and quality variables were used to assess the accuracy of nursing documentation. Three constructs were identified in the factor analysis. 'Accuracy of the nursing diagnosis' was the only variable with substantial loading on component two (0.907) and a modest loading on component one (0.230). Internal consistency (Cronbach's alpha) was 0.722. The inter-rater reliability (K(w)) varied between 0.742 and 0.896.CONCLUSION: The D-Catch instrument is a valid and reliable measurement instrument to assess nursing documentation in general hospital settings.
DOCUMENT
This paper presents the development and construct validation of an instrument for identification of resilient and less-resilient middle adolescents in high school. Purpose of this identification is a qualitative in-depth interview study of perceptions of resilient and less resilient middle-adolescents on their school environment. The qualitative study will function as examination of contentvalidity of the presented instrument. A 33-item Resilient Behavior Questionnaire (VVL) and a 105-item personality questionnaire NPV-J (Dutch Personality Questionnaire- Youngsters) were administered to a sample of 400 middle adolescent high school students (age range 14-16). It was hypothesized that scores on specific components in the VVL would correlate highly with relevant factors of personality in the NPV-J. Principal Component Analysis and Correlation Analysis served as methods of investigation. Results of the quantitative study reveal three components in the VVL and a high correlation between the scores on these components and the resilient personality factor perseverance and non-resilient factor inadequacy in the NPV-J. Discussion focuses on explanation of the results and implications for further development of the VVL.
DOCUMENT
This paper proposes and showcases a methodology to develop an observational behavior assessment instrument to assess psychological competencies of police officers. We outline a step-by-step methodology for police organizations to measure and evaluate behavior in a meaningful way to assess these competencies. We illustrate the proposed methodology with a practical example. We posit that direct behavioral observation can be key in measuring the expression of psychological competence in practice, and that psychological competence in practice is what police organizations should care about. We hope this paper offers police organizations a methodology to perform scientifically informed observational behavior assessment of their police officers’ psychological competencies and inspires additional research efforts into this important area.
MULTIFILE
The quality of teaching has a clear impact on student success, but how can good teaching be defined? The European QualiTePE research project, funded by the Erasmus+ programme and involving ten European countries, seeks to adress this question specifically for Physical Education (PE). The QualiTePE instrument was designed for use in teacher training and further training to enable criteria-based observation and assessment of the quality of Physical Education lessons. The instrument is designed for diverse PE teaching and learning scenarios, alongside teacher resources, facilitating the practical assessment of teaching quality in PE. The QualiTePE instrument quantifies teaching quality by assessing specific, observable teaching characteristics via questionnaire items. Each assessment is conducted by three different population groups: 1) the students 2) the PE teacher 3) an observer. The comparative analysis of the data collected from these three perspectives enables systematic and criteria‐based feedback for (prospective) teachers, identifies areas of improvement, and informs content development for PE across Europe. The QualiTePE digital web-based evaluation tool for assessing the “Quality of Teaching in Physical Education” is now available in English, German, French, Italian, Spanish, Dutch, Swedish, Slovenian, Czech and Greek.
DOCUMENT
Hoe vindt praktijkverandering plaats? Wat is ervoor nodig? Wie is ervoor nodig? Op deze en andere vragen hebben talloze veranderkundigen al hun hoofd gebogen. De praktijk is immers weerbarstig, zo zegt men. Een verandering in de praktijk heeft vaak een tijdelijk karakter en veel veranderingen beklijven niet. Dat is jammer. In dit boek worden de methodiek van Practice Development uiteengezet. Zowel de achtergronden, de systematiek als concrete praktijkvoorbeelden passeren daarbij de revue. Practice Development wordt in dit boek beschreven als een cyclische methodiek (met als acroniem PDDOEN) waarmee gezondheids- en onderwijsmedewerkers direct aan de slag kunnen om personen en praktijken duurzaam te veranderen. Dus geen tijdelijke verandering, maar verandering die gedragen wordt door en verankerd is in mensen. Zowel voorbeelden uit de zorg als het onderwijs illustreren de methodiek die tot deze veranderingen leidt. Het boek bevat codes (QR-codes) die verwijzen naar relevante informatie en instrumenten op een website die hiervoor is ontwikkeld. Doelgroep Practice Development is bestemd voor studenten in de gezondheidszorg en aan lerarenopleidingen.
DOCUMENT
This PhD research project is about how Dutch development NGOs use social media for their development projects. For this, the following research question has been investigated: how do Dutch development NGOs use social media to further the development activities of their organisations? The purpose of this study is to understand how development NGOs are trying to get to grips with social media. Given the exploratory nature of this research, a qualitative research approach was adopted. Both case studies and the grounded theory method were used for this study. This combination is ideal because with a case study one tries to understand, or explore a phenomenon, whereas, in grounded theory studies, one tries to build theory. Given that this study is concerned with how Dutch development NGOs perceive social media for their development projects, an interpretive paradigm seems appropriate. The grounded theory methodology for this research is consistent with the epistemology of interpretivism. The combination of case study research and grounded theory works well for theory building and has been applied in Information Systems and ICT for Development studies before. As the use of theory before data collection is in opposition to the principle idea of the grounded theory methodology, in which theory emerges from the data, this needs to be addressed when combining case studies and grounded theory. This issue was resolved by using an initial highlevel conceptual framework as a guiding instrument for both the noncommittal literature research and for the conceptualisation of the research problem, whilst not distorting the emergence of theory from the data. This study focuses on formally organised development NGOs who receive funding from the Dutch Ministry of Foreign Affairs for their development projects. From the approximately 100 organisations, fourteen NGOs were selected for this study. The choice of fourteen NGOs was driven by a theoretical sampling strategy. Data was collected via semi-structured interviews with 18 respondents and field-notes of meetings or events of 14 development NGOs. The data was analysed using the Glaserian coding procedure of grounded theory, starting with open coding, followed by selective coding, and ending with theoretical coding. Three major themes (or core categories as they are called in the grounded theory method), were identified. This study's first contribution is captured in the theme ‘NGO Enacting Values in Development’. This is about how an organisation’s values are enacted in the context of international development. The organisational mixture of development mind-sets influences organisational activities in development. The ideological trends that are stimulated by societal and technological changes have an impact on the organisation’s development strategy and the strategic collaboration network of development NGOs. The second contribution of this study is captured in the theme ‘NGO’s Views on Social Media Use’. This core category discusses the organisation’s view on the meaning of social media and includes the four following categories: technological, individual, collective and contextual views attributed to organisational social media. The four categories empirically demonstrate the concept of affordance clusters and the connections between them. The study’s third contribution is captured in the theme ‘NGO’s Use of Social Media in Development’, encompassing the social media activities of the studied development NGOs in their development projects. This has led to an assessment framework of organisational social media use by development NGOs, constructed by cross-referencing the organisational goals of development NGOs to the social media activity areas in the context of development. These themes represented by three core categories are inter-related. Feedback loops between NGO’s values in development, views on social media, and the actual uses of social media for development purposes have been discerned. This grounded theory study aims to build an initial theory of how NGOs might approach the use of social media in a development context. This qualitative study has produced some new concepts. This study has led to a substantive theory in the context of international development. Furthermore, this substantive theory is compared with three theory lenses, when applied on the data collected for this PhD research, in their ability to identify similar concepts as reached with the substantive theory following the grounded theory method. Finally, the thesis presents some avenues for future research that may help expand the substantive theory that has been developed under this research to formal theory
LINK
DOCUMENT
Existing observation instruments to measure differentiated instruction often lack insight into the degree to which teachers’ decisions match the actual needs of their students, and neglect the importance of preparation and evaluation. This article describes the psychometric evaluation of a comprehensive instrument (Assessing Differentiation in All Phases of Teaching; ADAPT) that does not suffer from these shortcomings. To assess its quality, 41 raters used it to score videos of lessons and interviews of 86 primary school teachers. A 5-dimensional item-response model showed good fit and high internal consistency, and a decision study was conducted to determine the reliability and agreement coefficients for different numbers of raters. For the intended low-stakes use, a single rater would be enough to provide a reliable estimate of a teacher’s overall score. Finally, rater experiences showed that ADAPT has high practical value due to the comprehensive manual and detailed score descriptions and examples. The instrument can therefore not only be used for research purposes, but can also serve as a valuable resource for teachers and teacher educators in practice.
LINK
Author supplied: Based on the Enterprise Architecture Value Framework (EAVF) - a generic framework to classify benefits of Enterprise Architecture (EA) - a measurement instrument for EA benefits has been developed and tested in a survey with 287 respondents. In this paper we present the results of this survey in which stakeholders of EA were questioned about the kind of benefits they experience from EA in their organization. We use the results of the survey to evaluate the framework and develop a foundation for the measurement instrument. The results of the survey show a moderate support for the assumptions underlying the framework. Applying ordinal regression, we derived sets of questions for ten out of the twelve classes in the framework. These sets constitute the first step in defining a final EA measurement instrument for establishing actual benefits in the classes of the framework.
LINK
BACKGROUND: Limited research has examined what is actually done in the process of care by nursing staff in long-term institutional care. The applied instruments employed different terminologies, and psychometric properties were inadequately described. This study aimed to develop and test an observational instrument to identify and examine the amount of time spent on nursing interventions in long-term institutional care using a standardized language.METHODS: The Groningen Observational instrument for Long-Term Institutional Care (GO-LTIC) is based on the conceptual framework of the Nursing Interventions Classification. Developmental, validation, and reliability stages of the GO-LTIC included: 1) item generation to identify potential setting-specific interventions; 2) examining content validity with a Delphi panel resulting in relevant interventions by calculating the item content validity index; 3) testing feasibility with trained observers observing nursing assistants; and 4) calculating inter-rater reliability using (non) agreement and Cohen's kappa for the identification of interventions and an intraclass correlation coefficient for the amount of time spent on interventions. Bland-Altman plots were applied to visualize the agreement between observers. A one-sample student T-test verified if the difference between observers differed significantly from zero.RESULTS: The final version of the GO-LTIC comprised 116 nursing interventions categorized into six domains. Substantial to almost perfect kappa's were found for interventions in the domains basic (0.67-0.92) and complex (0.70-0.94) physiological care. For the domains of behavioral, family, and health system interventions, the kappa's ranged from fair to almost perfect (0.30-1.00). Intraclass correlation coefficients for the amount of time spent on interventions ranged from fair to excellent for the physiological domains (0.48-0.99) and poor to excellent for the other domains (0.00-1.00). Bland Altman plots indicated that the clinical magnitude of differences in minutes was small. No statistical significant differences between observers (p > 0.05) were found.CONCLUSIONS: The GO-LTIC shows good content validity and acceptable inter-rater reliability to examine the amount of time spent on nursing interventions by nursing staff. This may provide managers with valuable information to make decisions about resource allocation, task allocation of nursing staff, and the examination of the costs of nursing services.
DOCUMENT
