Abstract: Cognitive diagnostic computerized adaptive testing (CD-CAT) combines the advantages of both cognitive diagnosis and CAT, which can make adaptive diagnosis for different individuals and provide more detailed diagnostic information on the knowledge competence of the examinees. Currently, CD-CAT has been a promising research area and gained more and more attention. The first step in the implementation of CD-CAT is to build a high quality item bank, and one difficulty that practitioners face is that of how to select the most appropriate cognitive diagnostic model (CDM) from such a large number of models. A wide array of CDMs have been developed based on different assumptions, for example, some reduced CDMs include the Deterministic Inputs, Noisy And Gate (DINA) model, the Deterministic Inputs, Noisy “Or” Gate (DINO; Templin & Henson, 2006) model, the Additive Cognitive Diagnostic Model (ACDM; de la Torre, 2011), the Linear Logistic Model (LLM) and the Reduced Reparametrized Unified Model (RRUM; Hartz, 2002). Apart from these reduced CDMs, some generalized models have also been developed, including the generalized DINA (G-DINA; de la Torre, 2011) model, the general diagnostic model (GDM; von Davier, 2005), and the log-linear CDM (LCDM; Henson, Templin, & Willse, 2009). Compared with the reduced CDMs, generalized CDMs are more complex and require a larger sample size to yield accurate estimates. In addition, compared with the complex generalized CDMs model, using reduced models can improve the accuracy of diagnostic test and may lead to more straightforward and meaningful interpretations. However, almost of all the research and application of CD-CAT has been conducted with the using only one CDM to estimate the item parameters. Analysis of real test data indicated that no single reduced model can be expected to satisfactorily fit all the items. The Wald test was developed as an item-level statistical test to examine whether the G-DINA model can be replaced by a reduced CDM without losing model data fit significantly in order to select an appropriate CDM for each item. The study developed a new selecting model method, namely, mixed models method, to the construction of item bank in CD-CAT. To explore the effectiveness of the mixed model method, three simulation experiments were conducted. The study 1 was aimed to investigate the efficiency of the mixed model method in CD-CAT considering a variety of factors, namely, item selection strategy (SHE and MPWKL), the test length (10, 15, 20 and 25). The number of attributes was fixed to K = 7. An item bank of 360 items was simulated with the highest and lowest probabilities of success, P(1) and P(0), were generated from uniform distributions with U(0.7,0.95) and U (0.05,0.3), respectively. The purpose of study 2 was to compare the efficiency of CD-CAT with the use of G-DINA, DINA, DINO, ACDM, LLM and RRUM model to analyze data generated from mixed model. The last study was to apply the mixed model method to an empirical data. Simulations results showed that the mixed CDMs can be used in the construction of CD-CAT and can improve both the validity and reliability of the test scores from a CD-CAT program.

Key words: CD-CAT, Item bank, CDMs, Mixed-CDMs

摘要： 传统CD-CAT通常选择一个认知诊断模型（cognitive diagnosis model, CDM）标定题库参数，但在实际应用中一个CDM很难完全拟合题库中所有的题目。G-DINA模型是一般化的饱和模型，可以通过Wald统计量检验在题目水平上，比较简约模型（DINA、DINO、ACDM、LLM和RRUM）是否能够代替饱和模型（G-DINA），并为每个题目选择一个相对最优的CDM，从而充分发挥各个CDM的优势，从而在一个题库中有的题目采用简约CDM，而有的题目采用饱和CDM，本文把这种思路称为混合模型（Mixed-CDMs）思路。基于此，本文探讨了基于混合模型的CD-CAT，并通过两个模拟研究及其应用研究验证了该方法的效果。研究结果表明基于混合模型建立的CD-CAT具有理想的效果，从而为CD-CAT在实际使用中提供了新思路和新方法。

关键词: CD-CAT, 建立题库, 认知诊断模型, 混合模型