Over reliance on model fit indices in confirmatory factor analyses may lead to incorrect inferences about bifactor models: A cautionary note

Abstract

This brief article attempts to describe the importance of relying not just on model fit indices, but also on bifactor, confirmatory factor analysis to examine the factor structure of instruments presumed to be multidimensional. Three ancillary bifactor indices (explained common variance, omega hierarchical and percentage uncontaminated correlations) were calculated for three instruments that have been described as multidimensional in published research. One of these instruments, the Normative Beliefs about Aggression Scale (NOBAGS) demonstrated strong evidence of multidimensionality. The second instrument, Problem-Solving Inventory demonstrated some evidence of multidimensionality, but must be considered essentially unidimensional because of lack of sufficient evidence. The third instrument, Cyberchondria Severity Scale demonstrated essential unidimensionality with little evidence of multidimensionality. These findings support the argument that using only model fit statistics may lead researchers to draw incorrect conclusions about the dimensionality of an instrument.