Psychological Science ›› 2016, Vol. 39 ›› Issue (4): 1005-1010.

Previous Articles     Next Articles

Random Intercept Factor Analysis Model for Statistical Control of the Method Effect Associated with Item Wording

  

  • Received:2015-10-08 Revised:2016-03-19 Online:2016-07-20 Published:2016-07-20

随机截距因子分析模型在控制条目表述效应中的应用

韦嘉1,2,张春雨3,赵永萍2,张进辅2   

  1. 1. 四川师范大学
    2. 西南大学心理学部
    3. 陕西师范大学
  • 通讯作者: 张进辅

Abstract: Balanced scale is designed to measure a bipolar underlying construct. The item content of balanced scale is positively or negatively polarized. The purpose of mixing two kinds of items in a scale is to control the method effect associated with item wording. Such method effect is thought of as a major resource of common method variance and potentially threatens to the construct validity of balanced scale. In the framework of confirmatory factor analysis , various of models have been proposed to make a psychometric explanation of underlying construct of balanced scale as a single psychological construct plus method effect associated with item wording. The common models are the correlated trait-correlated method model (CTCM), correlated trait-correlated method minus one model (CTC(m-1)), bi-factor model (BIF). When fitting data, the models that has excellent fit indices are always chosen as the optimal models by researchers. Besides the fit indices, the correlation coefficients of items measured same construct using different methods should be greater than items measured different constructs using same method to support the construct validity. Unfortunately, this criterion is always ignored by some previous researchers. In their studies, the optimal model, such as CTCM, BIF, the factor loadings showed that some of items were strongly influenced by method effect rather than trait. To remedy the limitations of the extant models, a new model named random intercept factor analysis model was proposed to control the method effect associated with item wording. In such model, item is loaded on two latent variables, one represented the latent target trait and the other represented the response bias that is irrelevant with the latent target trait. Taking the Chinese version of Rosenberg Self-Esteem Scale-Revised (RSES-R) as an example, the current study aimed to test the applicability of the random intercept model in statistical control of the method effect associated with item wording. The results showed that the fit indices of random intercept model were only inferior to BIF. But given that (1) the ratio of the trait variance and method effect variance was reasonable; (2) the trait factor loading was significantly greater than the method factor loading; (3) extremely high correlation between the self-esteem factor score estimated by such model and the total score of the RSES-R; the random intercept model showed more reasonable and explicable than any other models. Additionally, based on the Over-Claiming Questionnaire, the indices of knowledge accuracy (d') and response bias (criterion location, c) were calculated. The correlation between the method factor score estimated by random intercept model and the d' was no-significant at 5% level, suggesting that such systematic error was not associated with a person's general cognitive ability. The correlation between the method factor score estimated by random intercept model and the c was positive, significant at 5% level, suggesting that the method effect associated with item wording shared common components with social desirability. In short, the evidences mentioned above support the validation of the random intercept facto analysis model for statistical control of the method effect associated with item wording.

Key words: method effect associated with item wording, RSES-R, random intercept factor analysis model, OCQ, social desirability

摘要: 本研究用中文修订版罗森博格自尊量表(RSES-R)考察随机截距因子分析模型在控制条目表述效应时的表现。用RSES-R和过分宣称问卷组成的量表调查621名中学生。结果表明,随机截距模型在建模时,拟合指数良好、因子方差与负荷合理,自尊因子分与RSES-R总分有极高相关,表明该模型能有效分离RSES-R得分的特质与表述效应。分离的表述效应因子分与受测者的自我提升水平具有显著但较弱的相关,表明表述效应与自受测者的社会赞许性有共同的成分。

关键词: 条目表述效应, 中文版RSES-R, 随机截距因子分析模型, 中文版OCQ, 社会赞许性