Integrating AI into Student-Centered Speaking Assessment Design for Large EFL Classes
DOI: 10.23977/curtm.2026.090520 | Downloads: 0 | Views: 113
Author(s)
Fengjunzi Wang 1
Affiliation(s)
1 Department of Foreign Languages, Hubei Business College, Xiongchu Avenue No. 632, Hongshan District, Wuhan, 430079, Hubei Province, China
Corresponding Author
Fengjunzi WangABSTRACT
Speaking remains the least-assessed skill in Chinese College English: large classes and the absence of an oral component in high-stakes examinations leave most non-English majors without routine speaking evaluation. Drawing on design research methodology, this paper develops an AI-integrated, student-centered speaking assessment in which Doubao, ByteDance's conversational AI, serves as scenario interlocutor, simulated rater against the four IELTS criteria, and immediate feedback generator, complemented by a teacher analytic checklist within a dual-track feedback system. A one-semester pilot quasi-experimental questionnaire study (experimental n = 127, control n = 128) examined whether the system could operate in routine teaching: the experimental class completed weekly AI-mediated assessment sessions, and students responded positively across all seven perceived speaking-gain dimensions (all p < .001, d = 0.50–0.67), with high dialogue-extension and feedback-revision rates, indicating that the assessment process was operable at scale and accepted by students. The study offers application-oriented universities a low-cost, replicable pathway for embedding speaking assessment into College English curricula.
KEYWORDS
Artificial intelligence; Speaking assessment; Learning-oriented assessment; College English; Formative feedbackCITE THIS PAPER
Fengjunzi Wang. Integrating AI into Student-Centered Speaking Assessment Design for Large EFL Classes. Curriculum and Teaching Methodology (2026). Vol. 9, No. 5, 152-164. DOI: http://dx.doi.org/10.23977/curtm.2026.090520.
REFERENCES
[1] Turner, C. E., & Purpura, J. E. (2016). Learning-oriented assessment in second and foreign language classrooms. In D. Tsagari & J. Banerjee (Eds.), Handbook of second language assessment (pp. 255–272). De Gruyter Mouton.
[2] Xu, J., Jones, E., Laxton, V., & Galaczi, E. (2021). Assessing L2 English speaking using automated scoring technology: Examining automarker reliability. Assessment in Education: Principles, Policy & Practice, 28(4), 411–436. https://doi.org/10.1080/0969594X.2021.1979467
[3] Du, J., & Daniel, B. K. (2024). Transforming language education: A systematic review of AI-powered chatbots for English as a foreign language speaking practice. Computers and Education: Artificial Intelligence, 6, Article 100230. https://doi.org/10.1016/j.caeai.2024.100230
[4] Fathi, J., Rahimi, M., & Derakhshan, A. (2024). Improving EFL learners’ speaking skills and willingness to communicate via artificial intelligence-mediated interactions. System, 121, Article 103254. https://doi.org/10.1016/j.system.2024.103254
[5] Yang, H., Kim, H., Lee, J. H., & Shin, D. (2022). Implementation of an AI chatbot as an English conversation partner in EFL speaking classes. ReCALL, 34(3), 327–343. https://doi.org/10.1017/S0958344022000039
[6] Zhang, C., Meng, Y., & Ma, X. (2024). Artificial intelligence in EFL speaking: Impact on enjoyment, anxiety, and willingness to communicate. System, 121, Article 103259. https://doi.org/10.1016/j.system.2024.103259
[7] Carless, D. (2007). Learning-oriented assessment: Conceptual bases and practical implications. Innovations in Education and Teaching International, 44(1), 57–66. https://doi.org/10.1080/14703290601081332
[8] Yan, Q. (2024). Exploring Chinese university EFL students’ perceptions of formative assessment: A qualitative study. System, 125, Article 103391. https://doi.org/10.1016/j.system.2024.103391
[9] Luoma, S. (2004). Assessing speaking. Cambridge University Press.
[10] Wu, X., Zhang, L. J., & Liu, Q. (2021). Using assessment for learning: Multi-case studies of three Chinese university English as a foreign language (EFL) teachers engaging students in learning and assessment. Frontiers in Psychology, 12, Article 725132. https://doi.org/10.3389/fpsyg.2021.725132
[11] Cetin Koroglu, Z. (2021). Using digital formative assessment to evaluate EFL learners’ English speaking skills. GIST Education and Learning Research Journal, 22, 103–123. https://files.eric.ed.gov/fulltext/EJ1308042.pdf
[12] Chapelle, C. A., & Douglas, D. (2006). Assessing language through computer technology. Cambridge University Press.
[13] Koraishi, O. (2024). The intersection of AI and language assessment: A study on the reliability of ChatGPT in grading IELTS writing task 2. Language Teaching Research Quarterly, 43, 22–42. https://doi.org/10.32038/ltrq.2024.43.02
[14] Susoy, Z. (2026). Reducing anxiety and enhancing performance: The impact of AI chatbots versus human facilitation on EFL speaking assessment outcomes. Frontiers in Psychology, 16, Article 1745942. https://doi.org/10.3389/fpsyg.2025.1745942
[15] Xi, X. (2023). Advancing language assessment with AI and ML—Leaning into AI is inevitable, but can theory keep up? Language Assessment Quarterly, 20(4–5), 357–376. https://doi.org/10.1080/15434303.2023.2291488
[16] Koenecke, A., Nam, A., Lake, E., Nudell, J., Quartey, M., Mengesha, Z., Toups, C., Rickford, J. R., Jurafsky, D., & Goel, S. (2020). Racial disparities in automated speech recognition. Proceedings of the National Academy of Sciences, 117(14), 7684–7689. https://doi.org/10.1073/pnas.1915768117
[17] Wang, C., Zou, B., Du, Y., & Wang, Z. (2024). The impact of different conversational generative AI chatbots on EFL learners: An analysis of willingness to communicate, foreign language speaking anxiety, and self-perceived communicative competence. System, 127, Article 103533. https://doi.org/10.1016/j.system.2024.103533
[18] Zou, B., Du, Y., Wang, Z., Chen, J., & Zhang, W. (2023). An investigation into artificial intelligence speech evaluation programs with automatic feedback for developing EFL learners’ speaking skills. SAGE Open, 13(3). https://doi.org/10.1177/21582440231193818
[19] Guo, K., & Wang, D. (2024). To resist it or to embrace it? Examining ChatGPT's potential to support teacher feedback in EFL writing. Education and Information Technologies, 29(7), 8435–8463. https://doi.org/10.1007/s10639-023-12146-0
[20] McNamara, T. (2000). Language testing. Oxford University Press.
[21] Modern Languages Division. (2001). Common European framework of reference for languages: Learning, teaching, assessment. Cambridge University Press.
[22] National Education Examinations Authority, & British Council. (2019, January 15). Success in linking IELTS and Aptis to China's Standards of English Language Ability. https://cse.neea.edu.cn/html1/report/19011/9306-1.htm
[23] Zheng, S. (Ed.). (2023). New horizon college English: Reading and writing 1 (4th ed.). Foreign Language Teaching and Research Press.
[24] Zheng, S. (Ed.). (2024). New horizon college English: Viewing, listening and speaking 1 (4th ed.). Foreign Language Teaching and Research Press.
[25] Wen, Q. (2018). The production-oriented approach to teaching university students English in China. Language Teaching, 51(4), 526–540. https://doi.org/10.1017/S026144481600001X
[26] Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice: Designing and developing useful language tests. Oxford University Press.
[27] Wan, Y., & Moorhouse, B. L. (2024). Using Call Annie as a generative artificial intelligence speaking partner for language learners. RELC Journal, 56(2), 489–498. https://doi.org/10.1177/00336882231224813
[28] IELTS. (2007). IELTS speaking band descriptors (public version). https://ielts.org/cdn/ielts-guides/ielts-speaking-band-descriptors.pdf
[29] Escalante, J., Pack, A., & Barrett, A. (2023). AI-generated feedback on writing: Insights into efficacy and ENL student preference. International Journal of Educational Technology in Higher Education, 20, Article 57. https://doi.org/10.1186/s41239-023-00425-2
[30] Zou, B., Liviero, S., Ma, Q., Zhang, W., Du, Y., & Xing, P. (2024). Exploring EFL learners’ perceived promise and limitations of using an artificial intelligence speech evaluation system for speaking practice. System, 126, Article 103497. https://doi.org/10.1016/j.system.2024.103497
[31] Choi, S. (2025). Ethical issues of using AI in language education: A critical perspective. English Teaching, 80(5), 229–248. https://files.eric.ed.gov/fulltext/EJ1494237.pdf
[32] Cotton, D. R. E., Cotton, P. A., & Shipway, J. R. (2024). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in Education and Teaching International, 61(2), 228–239. https://doi.org/10.1080/14703297.2023.2190148
[33] Ngo, T.-N., Chen, H.-J., & Lai, K.-W. (2024). The effectiveness of automatic speech recognition in ESL/EFL pronunciation: A meta-analysis. ReCALL, 36(1), 4–21. https://doi.org/10.1017/S0958344023000113
[34] Holmes, W., Porayska-Pomsta, K., Holstein, K., Sutherland, E., Baker, T., Buckingham Shum, S., Santos, O. C., Rodrigo, M. M. T., Cukurova, M., Bittencourt, I. I., & Koedinger, K. R. (2022). Ethics of AI in education: Towards a community-wide framework. International Journal of Artificial Intelligence in Education, 32(3), 504–526. https://doi.org/10.1007/s40593-021-00239-1
[35] Ma, M., Noordin, N., & Razali, A. B. (2025). Improving EFL speaking performance among undergraduate students with an AI-powered mobile app in after-class assignments: An empirical investigation. Humanities and Social Sciences Communications, 12, Article 468. https://doi.org/10.1057/s41599-025-04688-0
| Downloads: | 48571 |
|---|---|
| Visits: | 2972597 |

Download as PDF



