Text Difficulty of English Textbooks for Senior High School and the College Scholastic Ability Test in South Korea
AUTHORS
Hyun-Young Lee,Department of English Education, Kongju National University, South Korea
Mun-Koo Kang*,Department of English Education, Kongju National University, South Korea
ABSTRACT
The present study investigated the text difficulty of English textbooks for senior high school and the College Scholastic Ability Test. By comparing the degree of their text difficulty, this study aimed to predict how effectively public education can prepare for the CSAT. To build a corpus, five types of high school English reading and writing textbooks reflecting the revised 2015 curriculum and 2019-2020 CSAT were selected. With Coh-Metrix, the web-based automated language analysis tool, the text difficulty level was measured in linguistic features: descriptive indices, word information, lexical diversity, syntactic complexity, standard readability, and cohesion. To compare the measurements and find out if there are any statistically significant differences, an independent t-test is used. In conclusion, most features, except for syntactic complexity and semantic cohesion, showed statistically significant differences between textbooks and the CSAT. This finding suggests that the students who follow the curriculum focusing on the textbooks would find it challenging to accomplish what they expect from the CSAT. To meet the purpose of the CSAT, normalizing public education and easing the burden of excessive learning, a balance between the difficulty of textbooks and the CSAT should be achieved.
KEYWORDS
English textbooks, CSAT, Text difficulty, Coh-Metrix
REFERENCES
[1] Statistics Korea, “Private education expenditures survey of elementary, middle and high school students in 2019,” (2020)
[2] Ministry of Education, “Adaptation of the CSAT English criterion-referenced testing,” (2014)
[3] Korean Institute for Curriculum and Evaluation, “Masterplan for the 2017 College Scholastic Ability Test,” (2017)
[4] M. Kim and C. Shin, “An analysis of the difficulty of the reading materials in middle and high school English textbooks and the CSAT with coh-metrix,” The Mirae English Language and Literature Association, vol.2016, no.6, pp.209-228, (2016)
[5] J. Kim and I. Choi, “A corpus-based comparative analysis of linguistic difficulty among high school English textbooks, EBS-CSAT prep books, and College Scholastic Ability Test,” Multimedia-Assisted Language Learning, vol.18, no.1, pp.59-92, (2015)
[6] J. Moon and H. Kim, “An analysis of the linguistic elements of the text in the English reading section of the College Scholastic Ability Test,” The Modern English Education Society, vol.18, no.1, pp.193-211, (2017)
[7] M. Jeon and I. Lim, “A corpus-based analysis of middle school English 1 textbooks with Coh-Metrix,” English Language Teaching, vol.21, no.4, pp.265-292, (2009)
[8] A. C. Graesser, D. S. McNamara, M. M. Louwerse, and Z. Cai, “Coh-Metrix: Analysis of text on cohesion and language,” Behavior Research Methods, Instruments, and Computers, vol.36, no.2, pp.193-202, (2004) DOI:10.3758/bf03195564(CrossRef)(Google Scholar)
[9] M. Jeon, “An analysis of the continuity of the reading materials in high school English textbooks,” Journal of the Korean Data Analysis Society, vol.16, no.2, pp.925-938, (2014)
[10] M. Jeon, “A corpus-based analysis of the continuity of the reading materials in middle school English 1 and 2 textbooks with Coh-Metrix,” The Journal of Linguistics Science, vol.56, pp. 201-218, (2011)
[11] S. E. Haviland and H. H. Clark, “What's new? Acquiring new information as a process in comprehension,” Journal of Verbal Learning and Verbal Behavior, vol.13, pp.512-521, (1974) DOI:10.1016/s0022-5371(74)80003-4(CrossRef)(Google Scholar)