In this contribution, we evaluate the degree of measurement equivalence between countries and over time for a measure of experienced holiday quality that has repeatedly been included in a public opinion survey series of high policy relevance: the Flash Eurobarometer survey series (2014–2016). The results indicate that using the measurement instrument for cross-national comparisons between 35 countries may be quite problematic, as neither metric nor scalar measurement equivalence was established. The longitudinal analyses show that for 19 out of 28 countries, scalar measurement equivalence holds between the waves. For the countries for which longitudinal scalar measurement equivalence was established, the comparison of the mean overall score of satisfaction with the holiday shows a very high level of stability. In general, the findings underscore the importance of assessing measurement equivalence of empirical tourism and leisure-related constructs when making systematic comparisons between groups or over time.