Evaluation of the method to predict the difficulty of the test questions in a national dental board examination

doi:10.19439/j.sjos.2022.03.021

Abstract

Abstract: PURPOSE: To explore a possible method of improving prediction by analyzing the effect and influencial factors of difficulty prediction of a national board dental examinations. METHODS: The correlation between the predicted value and the measured value, and related influential factors were analyzed with SPSS 16.0 software package. RESULTS: The correlation between the predicted difficulty and the tested difficulty increased after the improvement of the method (P<0.05). The correlation was mainly reflected in the median score group of candidates. CONCLUSIONS: Improving the method of difficulty prediction can increase the prediction effect, and it is helpful to improve the forecasting ability of the test paper and to evaluate the candidates accurately.

Key words: Item difficulty, Difficulty prediction, Paired comparison, Dental board examination

CLC Number:

WANG Ning, HUANG Rong, ZHANG Quan-hui. Evaluation of the method to predict the difficulty of the test questions in a national dental board examination[J]. Shanghai Journal of Stomatology, 2022, 31(3): 327-329.

References

[1] 柳博. 预估难度一种自学考试的试题难度确定方法[J]. 中国考试, 2007(7): 29-34.
[2] Quereshi MY, Fisher TL.Logical versus empirical estimates of item difficulty[J]. Edu Psychol Meas, 1977, 37(1): 91-100.
[3] 东晓华, 赵凤敏. 高等教育自学考试命题预估难度准确性研究[J]. 中国高等教育, 2010(13): 68-69.
[4] 田霖, 王桥影. 自学考试的试题难度赋值方法评述[J]. 中国考试, 2010(4): 24-30.
[5] 杨涛, 辛涛, 杨婷婷. 试题难度的主观预估方法[J]. 中国考试, 2014(2): 3-9.
[6] Embretson SE.Generating abstract reasoning item with theory[C]//Irvine SH, Kyllonen PC. Item generation for test development[M]. Mahwah, NJ: Lawrence Erlbaum Associates Publishers, 2002.
[7] 任子朝, 佟威, 赵轩, 等. 高考试题难度预估研究[J]. 数学教育学报, 2018, 27(5): 17-20.
[8] 柳博. 预估难度的理论模型及应用探析[J]. 中国考试, 2009(4): 3-7.
[9] 罗志卿. 高中学业水平合格性考试命题难度控制技术的探究—以信息技术学科为例[J]. 考试研究, 2021(2): 66-72.
[10] 任子朝,佟威,赵轩. 高考试题难度预估的校准与改进研究[J]. 数学教育学报, 2019, 28(6): 1-4.
[11] 杨芳丽, 何佳. 医师资格考试医学综合笔试试题难度影响因素的分析[J]. 中华医学教育杂志, 2017, 37(2): 312-316.
[12] 赵娟. 提高中考试题难度预估准确性的有效途径[J]. 大连教育学院学报, 2017, 33(1): 25-26.
[13] Beinborn L, Zesch T, Gurevych I.Predicting the difficulty of language proficiency tests[J]. Trans Assoc Comput Linguist, 2014, 2: 517-530.
[14] 李洪福, 李振来. 试题难度预估方法的探索与实践[J]. 生物学通报, 2006, 41(7): 43-45.
[15] 程力, 柳博. 自学考试预估难度评定操作规范研究[J]. 成人教育, 2012, 32(12): 15-17.