Psychological Science ›› 2013, Vol. 36 ›› Issue (1): 210-215.

Previous Articles     Next Articles

The development of cognitive diagnosis test based on automated item generation

Tu Dong-Bo1, 2,   

  • Received:2011-07-30 Revised:2012-04-17 Online:2013-01-20 Published:2013-02-26
  • Contact: Tu Dong-Bo

基于项目自动生成的认知诊断测验开发

涂冬波1,蔡艳1,戴海琦2   

  1. 1. 江西师范大学
    2. 江西南昌市紫阳大道99号江西师范大学心理学院
  • 通讯作者: 涂冬波
  • 基金资助:
    教育部人文社科一般项目青年基金;高等院校博士点基金项目;江西省教育厅高校人文社科项目青年基金;江西省教育厅科技项目青年基金;国家自然科学基金

Abstract: Cognitive diagnosis (CD) and automated item generation were important developing directions in modern psychology measurement. To combining with both areas was a major topic to explore. Illustrated with ordinary mathematic problem solving, this paper investigated the methodology and algorithm of automated item generation in CD. Findings showed: (1) Item parameters generated by computer were highly consistent with the parameters in mode; (2) The testing characteristics of different items generated by the same item mode were almost the same; (3) The abilities consequences obtained by two different auto-generated test were highly correlated (r=0.811), and cognitive diagnosis obtained by the same tests were highly consistent. All these verified that the methods and algorithm of automated item generation in CD were feasible, and they could work efficiently, which provided a mechanic reference and support of the automated item generation in CD area.

Key words: cognitive diagnosis, cognitive diagnosis test, automated item generation, math problem solving

摘要: 认知诊断、项目自动生成是现代心理测量领域的重要发展领域,二者的结合更是心理测量领域亟待开展的重要课题。本研究以小学数学问题解决认知诊断项目自动生成为例,探讨认知诊断领域的项目生成技术及算法。研究发现:(1)计算机自生成的项目参数与原模板参数具有较高的一致性。(2)同一项目模板下生成的不同试题的测量学特征基本不变。(3)同一批被试在自动生成的两份试卷的前、后测的能力( )值高度相关(r=0.811),前、后两次对被试诊断结果的一致性高达86.5%。这表明本文所设计的认知诊断测验项目的自动生成技术及其算法基本可行,小学数学问题解决认知诊断项目的自动生成效果较好。这也为其它认知诊断领域的项目自动生成提供了技术借鉴和支持。

关键词: 认知诊断, 认知诊断测验, 项目自动生成, 数学问题解决