Although Item Response Theory (IRT) has been recommended for helping advance interprofessional education (IPE) research, its use remains limited. This may be partly explained by potential misconceptions regarding IRT`s “limitation” to cross-sectional data. The aim of this study is to demonstrate how Item Response Theory (IRT) can be applied effectively in before-and-after designs in IPE research. Specifically, a two-week before-after design with survey methodology using the Extended Professional Identity Scale (EPIS), an interprofessional identity measure, was conducted among n = 146 mixed health-science students. Results indicated that EPIS increased significantly before-after intervention by.74 standardised mean differences, t146 = 7.73, p
DOCUMENT
Objective The first objective was to assess the psychometric properties of the 92-item Dutch Naming Test (DNT-92), developed to assess word finding difficulties in people with aphasia, using Item Response Theory (IRT). The second objective was to select suitable items for a short version with a discriminative purpose. Method This study has a retrospective, psychometric research design, in which 510 DNT-92-forms of people with aphasia and 192 DNT-forms of healthy participants were used for analyses. An IRT analysis was performed and information on the item- and person parameters was obtained. Item selection for the short version was based on a combination of the discriminative ability of the items and their estimated theta or difficulty. Items with the highest information load, and a difficulty parameter in the range of overlap between the sample of people with aphasia and healthy participants were selected. Results A 2-PL IRT analysis showed best fit to the data. Assumptions of unidimensionality, local independence, and monotonicity were met. Items were removed incrementally, whilst checking sensitivity and specificity of the remaining short form. A selection of six items proved optimal in terms of sensitivity and specificity, with an area under the curve value of 0.85. Differences were found between participants younger than 70 and older. Conclusions The IRT assumptions for the DNT-92 were met, indicating that the test has good psychometric properties. A reduction of items to just six items proved possible, leading to a reliable six item short form with a discriminatory purpose.
LINK
Background: The proportion of frail older adults is increasing and is expected to further increase in the coming years, both globally and in the Dutch population. This poses a great challenge to public health. To determine the prevalence of frailty in a population, a frailty index (FI) is recommended. A FI is an accumulation model encompassing health deficits in multiple domains. Previous research has shown that a FI can be created out of existing health surveys, since it is a flexible instrument, fairly insensitive to the use of specific items. However, this is based on scale development using Classical Test Theory, while few studies have investigated the psychometric properties of their FI using Item Response Theory (IRT). The aim of this study was to create a FI using the Dutch Health Monitor 2016, and to investigate its psychometric properties using Item Response Theory (IRT). Methods: Forty-two deficits were selected in three health domains, i.e., physical, psychological, and social. Psychometric properties were investigated by using an IRT model for polytomous response categories: the Graded Response Model (GRM). Items were evaluated by Cronbach’s Alpha, Factor Analysis, Point Polyserial Correlations, and GRM. Results: The analyses showed that all items demonstrated a positive association with the scale. However, five items did not fit well to the FI scale. From the physical domain these were body mass index and three items about adherence to physical activity guidelines: moderate activity per week; bone and muscle strengthening activities; balance exercises. From the psychological domain this was an item about a sense of control over one’s own future. Conclusions: By using IRT, we showed that while 37 items were adequate and fitted the scale well, five items in our FI were redundant, indicating that it does matter which items are selected for a FI. IRT is a strong method for item selection and thus for creating a more concise Frailty Index. Key messages: Creating a solid and more concise Frailty Index with IRT is promising for epidemiological research and public health. For creating a Frailty Index, item selection needs careful consideration. [ABSTRACT FROM AUTHOR]
DOCUMENT
Objectives To assess the content validity and psychometric characteristics of the Knowledge about Older Patients Quiz (KOP‐Q), which measures nurses' knowledge regarding older hospitalized adults and their certainty regarding this knowledge. Design Cross‐sectional. Setting Content validity: general hospitals. Psychometric characteristics: nursing school and general hospitals in the Netherlands. Participants Content validity: 12 nurse specialists in geriatrics. Psychometric characteristics: 107 first‐year and 78 final‐year bachelor of nursing students, 148 registered nurses, and 20 nurse specialists in geriatrics. Measurements Content validity: The nurse specialists rated each item of the initial KOP‐Q (52 items) on relevance. Ratings were used to calculate Item‐Content Validity Index and average Scale‐Content Validity Index (S‐CVI/ave) scores. Items with insufficient content validity were removed. Psychometric characteristics: Ratings of students, nurses, and nurse specialists were used to test for different item functioning (DIF) and unidimensionality before item characteristics (discrimination and difficulty) were examined using Item Response Theory. Finally, norm references were calculated and nomological validity was assessed. Results Content validity: Forty‐three items remained after assessing content validity (S‐CVI/ave = 0.90). Psychometric characteristics: Of the 43 items, two demonstrating ceiling effects and 11 distorting ability estimates (DIF) were subsequently excluded. Item characteristics were assessed for the remaining 30 items, all of which demonstrated good discrimination and difficulty parameters. Knowledge was positively correlated with certainty about this knowledge. Conclusion The final 30‐item KOP‐Q is a valid, psychometrically sound, comprehensive instrument that can be used to assess the knowledge of nursing students, hospital nurses, and nurse specialists in geriatrics regarding older hospitalized adults. It can identify knowledge and certainty deficits for research purposes or serve as a tool in educational or quality improvement programs.
LINK
BACKGROUND AND OBJECTIVES: Loneliness is prevalent among older adults and known to be detrimental to mental health. The objective of this study was to determine the psychometric properties of the Chinese 6-item De Jong Gierveld Loneliness Scale (DJGLS) in the older native and diasporic Chinese community. RESEARCH DESIGN AND METHODS: Participants were recruited from a local community in urban Tianjin, China and urban Chinese communities of older adults in the Netherlands. Scale properties, including reliability, were calculated with Cronbach's alpha and multiple-group confirmatory factor analysis to examine the two-dimensional structure of the scale and the cross-cultural equivalence between both countries. Item response analysis was employed to plot the relationships between the item response and expected total scale score. RESULTS: A total of 193 older adults from China and 135 older adults from the Netherlands were included. The Cronbach's alphas were and 0.68 (China) and 0.71 (the Netherlands). The DJGLS's two-dimensional structure was validated by the goodness of fit and the factor loadings. Cross-cultural equivalence was demonstrated with the multiple-group confirmatory analysis. In addition, sufficient discriminative power of the individual items was demonstrated by item response analysis in both countries. DISCUSSION AND IMPLICATIONS: This study is the first to provide a detailed item behavior analysis with an item response analysis of the DJGLS. In conclusion, the findings of this study suggest that the DJGLS has adequate and similar item and scalar equivalence for use in Chinese populations.;BACKGROUND AND OBJECTIVESLoneliness is prevalent among older adults and known to be detrimental to mental health. The objective of this study was to determine the psychometric properties of the Chinese 6-item De Jong Gierveld Loneliness Scale (DJGLS) in the older native and diasporic Chinese community. RESEARCH DESIGN AND METHODSParticipants were recruited from a local community in urban Tianjin, China and urban Chinese communities of older adults in the Netherlands. Scale properties, including reliability, were calculated with Cronbach's alpha and multiple-group confirmatory factor analysis to examine the two-dimensional structure of the scale and the cross-cultural equivalence between both countries. Item response analysis was employed to plot the relationships between the item response and expected total scale score. RESULTSA total of 193 older adults from China and 135 older adults from the Netherlands were included. The Cronbach's alphas were and 0.68 (China) and 0.71 (the Netherlands). The DJGLS's two-dimensional structure was validated by the goodness of fit and the factor loadings. Cross-cultural equivalence was demonstrated with the multiple-group confirmatory analysis. In addition, sufficient discriminative power of the individual items was demonstrated by item response analysis in both countries. DISCUSSION AND IMPLICATIONSThis study is the first to provide a detailed item behavior analysis with an item response analysis of the DJGLS. In conclusion, the findings of this study suggest that the DJGLS has adequate and similar item and scalar equivalence for use in Chinese populations.;
DOCUMENT
We show how to estimate a Cronbach's alpha reliability coefficient in Stata after running a principal component or factor analysis. Alpha evaluates to what extent items measure the same underlying content when the items are combined into a scale or used for latent variable. Stata allows for testing the reliability coefficient (alpha) of a scale only when all items receive homogenous weights. We present a user-written program that computes reliability coefficients when implementation of principal component or factor analysis shows heterogeneous item loadings. We use data on management practices from Bloom and Van Reenen (2010) to explain how to implement and interpret the adjusted internal consistency measure using afa.
DOCUMENT
Entrepreneurs are likely to be victims of ransomware. Previous studies have found that entrepreneurs tend to adopt few preventive measures, thereby increasing their chances of victimization. Due to a lack of research, however, not much is known about why entrepreneurs lack self-protective behaviors and how they can be encouraged to change said behaviors. Therefore, the purpose of this study is to explain, by means of an extended model of the Protection Motivation Theory (PMT), the motivation for entrepreneurs using protective measures against ransomware in the future. The data for our study were collected thanks to a questionnaire that was answered by 1,020 Dutch entrepreneurs with up to 250 employees. Our Structural Equation Modelling (SEM) analysis revealed that entrepreneurs are more likely to take preventive measures against ransomware if they perceive the risk of ransomware as severe (perceived severity), if they perceive their company as being vulnerable (perceived vulnerability), if they are concerned about the risks (affective response), and if they think that the people and companies around them expect them to apply preventive measures (subjective norms). However, if entrepreneurs think that they are capable of handling the risk (self-efficacy) and are convinced that their adopted preventive measures are effective (response efficacy), they are less likely to take preventive measures. Furthermore, for entrepreneurs that outsource IT security, the significant effect of perceived vulnerability and subjective norms disappears. The likelihood of entrepreneurs protecting their business against ransomware is thus influenced by a complex interplay of various motivational factors and is partly dependent on the business’ characteristics. Based on these findings, we will discuss security professionals’ prospects for increasing the cyber resilience of entrepreneurs, thus preventing cybercrime victimization.
DOCUMENT
Emotions are a key component of tourism experiences, as emotions make experiences more valued and more memorable. Peak-and-end-theory states that overall experience evaluations are best predicted by the emotions at the most intense and final moments of an experience. Peak-and-end-theory has mostly been studied for relatively simple experiences. Recent insights suggest that peak-and-end-theory does not necessarily hold for tourism experiences, which tend to be more heterogeneous and multi-episodic in nature. Through the novel approach of using electrophysiological measures in combination with experience reconstruction, the applicability of the peak-and-end-theory to the field of tourism is addressed by studying a musical theatre show in a theme park resort. Findings indicate that for a multi-episodic tourism experience, hypotheses from the peak-and-end-theory are rejected for the experience as a whole, but supported for individual episodes within the experience. Furthermore, it is shown that electrophysiology sheds a new light on the temporal dynamics of experience
MULTIFILE
To improve people’s lives, human-computer interaction researchers are increasingly designing technological solutions based on behavior change theory, such as social comparison theory (SCT). However, how researchers operationalize such a theory as a design remains largely unclear. One way to clarify this methodological step is to clearly state which functional elements of a design are aimed at operationalizing a specific behavior change theory construct to evaluate if such aims were successful. In this article, we investigate how the operationalization of functional elements of theories and designs can be more easily conveyed. First, we present a scoping review of the literature to determine the state of operationalizations of SCT as behavior change designs. Second, we introduce a new tool to facilitate the operationalization process. We term the tool blueprints. A blueprint explicates essential functional elements of a behavior change theory by describing it in relation to necessary and sufficient building blocks incorporated in a design. We describe the process of developing a blueprint for SCT. Last, we illustrate how the blueprint can be used during the design refinement and reflection process.
DOCUMENT
Frailty in older adults is an increasing burden for public health, both globally as well as in The Netherlands. To focus on frailty prevention from a public health perspective, a clear understanding of frailty prevalence is needed.
DOCUMENT