An Analysis on the Characteristics of the Items in Paper Based Test (PBT) and Smart Device Based Test (SBT) - Focused on the Optician National Board Examination
AUTHORS
Eun Joo Kim,Professor Kim Eun Joo, Faculty of Liberal Arts, South Korea
Jung Un Jang,Professor Jung Un Jang, Department of Optometry, Eulji University, South Korea
ABSTRACT
This study is aimed to analyze the characteristics of the items in the optician national board examination according to item response theory and to find if the test items are adequate or need to be modified for the evaluation of learners’ ability level. Through the item analysis based on item response theory, it is possible to estimate an error of measurement accurately according to individual learner’s ability level. In a design step, paper-based and smart device-based trial tests for the optician national board examination were planned to show multimedia type, data-suggestion type, and text type items to test takers. As a result, item difficulty and item discrimination were not greatly different between the paper-based and smart device-based trial tests for the optician national board examination. In particular, to collect opinions of the persons concerned for the introduction of smart device-based tests and to stabilize the introduction of the smart device-based national board examination perfectly, it is necessary to conduct various pilot projects to support experiences of the smart device-based test. To develop multimedia items to encourage the problem-solving ability of people with different kinds of occupations, it is necessary to establish information use guidelines that help to access the object and standardized data which do not infringe an information use policy, among internet-sharable video needed to develop items.
KEYWORDS
Paper-Based Test (PBT), Smart device-based test (SBT), National board examination, Item response theory
REFERENCES
[1] Yoou S. K., Won J. S., Lee K.J., Han D.K., Sung H. Jm Lee H. S., Lim H. C., Kim E. J., Choi H. Y., “Study on validity of the national examination based on smart device-based test (SBT) by 7 types of healthcare occupation,” The Korean Journal of Emergency Medical Services, vol.23, no.3, pp.7-34, (2018)
[2] Kim D. P., Lakshimi A. S., Lee C. N., Shehzad N., Debbie F. S., “Analysis of contact lens education in Korea on the base of IACLE students trial exam (STE),” The Korean Society of Vision Science, vol.13, no.2, pp.149-155, (2011)
[3] Ye K. H., Cho S. A., “A study on the scales of life of ophthalmic optics students,” The Korean Society of Vision Science, vol.22, no.1, pp.41-49, (2020)
[4] Donal E. M., Gerard F. D., David B. S., “Medical licensing examinations in the United States,” Journal of dental education, vol.66, no.5, pp.610-611, (2002)
[5] Steven A. H., Peter J. K., Gerard F. D., “The evolution of the united states medical licensing examination (USMLE): Enhancing assessment of practice-related competencies,” The Journal of the American Medical Association, vol.310, no.21, pp.2245-2246, (2013)
[6] Josef G. T., Renee F. M., Salvatore S., Linda P., “Do United States medical licensing examination (USMLE) scores predict in-training test performance for emergency medicine residents?” J Emerg Med, vol.38, no.1, pp. 65-69, (2010)
[7] Kathleen E. K., Dawn Y., Kevien R. W., Gavin C. R., Terrence E. G., Shawn M. Q., Charles C. W., Andre J. B., Adam L. L., Isamu E. Y., Stephen E. D., Bryan G. K., “Correlation between United States medical licensing examination and comprehensive osteopathic medical licensing examination scores for applicants to a dually approved emergency medicine residency,” J Emerg Med, vol.52, no.2, pp.216-222, (2016)
[8] Hasty R. T., Snyder S., Suciu G.P., Moskow J.M., “Graduating osteopathic medical students’ perceptions and recommendations on the decisionto take the United States medical licensing examination,” J Am Osteopath Assoc, vol.112, pp.83-89, (2012)
[9] Weizberg M., Kass D., Husain A., Cohen J., Hahn B., “Should osteopathic students applying to allopathic emergency medicine programs take the USMLE exam?” Department of Emergency Medicine (UCI), vol.7, no.1, pp.101-106, (2014)
[10] Gimpel J. R., “New COMLEX-USA-to-USMLE conversion formula needed,” J Am Osteopath Assoc, vol. no.10, pp.577-578, (2010)
[11] McMahon G. T., Tallia A. F., “Perspective: Anticipating the challenges of reforming the United States medical licensing examination,” Acad Med., vol.85, no.3, pp.453-456, (2010)
[12] https://www.korea.kr/archive/expDocView.do?docId=33027 (2012)
[13] Kim Y. R., Chung M. H., Kim J. H., “A study on the actual condition and utilization plan of smart devices for educational purpose,” J Korean Society for Internet Information, vol.14, no.3, pp.47-55, (2013)
[14] Huh S., “Can computerized tests be introduced to the Korean medical licensing examination,” J Korean Med. Assoc., vol.55, no.2, pp.124-130, (2012)
[15] Brian K. F., Louedes F., Richard T., “Student performance and attitudes during the transition from paper to computer-based examinations,” The Journal of the Association of Schools and Colleges of Optometry, vol.15, no.1, pp.1-10, (2019)
[16] Jeong H., “A comparative study of scores on computer-based tests and paper-based tests,” Beh Inform Technol, vol.33, no.4, pp.410-422, (2014)
[17] Karay Y., Schauber S. K., Stosch C., Schuttpelz B. K., “Computer versus paper—does it make any difference in test performance?” Teach Learn Med., vol.27, no.1, pp.57-62, (2015)
[18] Boevé A. J., Meijer R. R., Albers C. J., Beetsma Y., Bosker R. J., “Introducing computer-based testing in high-stakes exams in higher education: Results of a field experiment,” PLoS ONE, vol.10, no.12, (2015)
[19] https://www.korea.kr/archive/expDocView.do?docId=33027 (2012)
[20] Seol M. G., Sohn C. I., “A survey on teacher's perceptions about the current state of using smart learning in elementary schools,” Journal of The Korean Association of Information Education, vol.16, no.3, pp.309-318, (2012)