An Exploration of the Impact of Generative Artificial Intelligence on College Students' Higher-Order Thinking Skills: A Teaching Practice Study

Gao Juan

doi:10.23977/jaip.2025.080214

An Exploration of the Impact of Generative Artificial Intelligence on College Students' Higher-Order Thinking Skills: A Teaching Practice Study

Download as PDF

DOI: 10.23977/jaip.2025.080214 | Downloads: 18 | Views: 424

Author(s)

Gao Juan ¹

Affiliation(s)

¹ School of Educational Science, Zhaoqing University, Zhaoqing, Guangdong, China

Corresponding Author

Gao Juan

ABSTRACT

This study aims to explore the impact of generative artificial intelligence (abbreviated as GAI) in higher education on students' learning experience, learning outcomes, and higher-order thinking skills (abbreviated as HOTS). By comparing GAI-assisted learning with traditional internet search-based learning, as well as collaborative learning with independent learning under GAI assistance, this research adopts methods such as questionnaire surveys, informal interviews, teaching observations, and work analysis to examine performance differences under different learning modes. The results show that, compared with traditional internet search learning, GAI-assisted learning can promote the development of students’ critical and creative thinking abilities to a certain extent, and that collaborative learning under GAI is more effective than independent learning. The effectiveness of GAI applications is influenced by multiple interdependent factors, including:(1) technical infrastructure (hardware/software availability and network stability), (2) learner capabilities (foundational GAI operational proficiency and digital literacy), (3) pedagogical support (teacher guidance quality and feedback mechanisms), and (4) cognitive readiness levels, which collectively determine the efficacy of GAI applications in educational contexts.

KEYWORDS

Generative Artificial Intelligence; Higher-Order Thinking Skills; Learning Experience; Learning Outcomes

CITE THIS PAPER

Gao Juan, An Exploration of the Impact of Generative Artificial Intelligence on College Students' Higher-Order Thinking Skills: A Teaching Practice Study. Journal of Artificial Intelligence Practice (2025) Vol. 8: 101-111. DOI: http://dx.doi.org/10.23977/jaip.2025.080214.

REFERENCES

[1] Lu Guoqing, Yang Qin, He Xiangchun. The value, challenges, and pathways of generative AI empowering formative assessment in higher education [J]. E-education Research, 2024, 45(11): 84–91.
[2] Wang Xuenan, Li Yongzhi. Artificial intelligence and educational reform [J]. E-education Research, 2024, 45(08): 13–21. DOI:10.13811/j.cnki.eer.2024.08.002.
[3] Miao F. C., Wayne H. Guidance for Generative AI in Education and Research [M]. Paris: UNESCO, 2023: 1–38.
[4] Shen Shusheng. Adaptation and transformation: How AIGC products change the educational process — Opportunities brought by artificial intelligence [J]. Educational Research and Review, 2023, (3): 15–21.
[5] Zhou Ling, Wang Feng. Educational enlightenment of generative AI: Let everyone become himself [J]. China Educational Technology, 2023, 30(5): 9–14.
[6] Chen Yukun. Educational transformation in the era of ChatGPT/generative AI [J]. Journal of East China Normal University (Educational Sciences Edition), 2023, 41(7): 103–116.
[7] Wu Lü, Yang Lei. How ChatGPT empowers learning [J]. E-education Research, 2023, 44(12): 28–34.
[8] Putra F. W., Rangka I. B., Aminah S., Aditama M. H. R. ChatGPT in the higher education environment: Perspectives from the theory of higher-order thinking skills [J]. Journal of Public Health, 2023, 45(4): 840–841.
[9] Elsen-Rooney, M. (2023, Jan 4). NYC education department blocks ChatGPT on school devices, networks. Chalkbeat. https://ny.chalkbeat.org/2023/1/3/23537987/nyc-schools-ban-chatgpt-writing-artificial-intelligence
[10] Elvira Pollina, Supantha Mukherjee. Italy curbs ChatGPT, starts probe over privacy concerns [N]. REUTERS, 2023-04-01.
[11] Cassidy, C. (2023, Jan 23). Queensland public schools to join NSW in banning students from ChatGPT. The Guardian.https://www.theguardian.com/australia-news/2023/jan/23/queensland-public-schools-to-join-nsw-in-banning-students-from-chatgpt
[12] Yau, C. & Chan, K. (2023, Feb 17). University of Hong Kong in China temporarily bans students from using ChatGPT, other AI-based tools for coursework. SCMP. https://www.scmp.com/news/hong-kong/education/article /3210650/university-hong-kong-temporarily-bans-students-using-chatgpt-other-ai-based-tools-coursework ?module=live&pgtype=homepage
[13] Wu Hejiang, Wu Di. Application of generative AI in education: Development history, international trends, and future outlook [J]. Comparative Education Research, 2024, 46(06): 13–23. DOI:10.20013/j.cnki.ICE.2024.06.02.
[14] Liu Jun, Lei Liang. Strategies for managing artificial intelligence in higher education — Interpretation and insights from “ChatGPT and Artificial Intelligence in Higher Education: A Quick Start Guide” [J]. Modern Education Science, 2024(06): 18–28. DOI:10.13980/j.cnki.xdjykx.2024.06.003.
[15] Garcia-Penalvo, F. J. (2023). The perception of artificial intelligence in educational contexts after the launch of ChatGPT: Disruption or panic? Education in the Knowledge Society (EKS), 24, e31279.
[16] Cyberspace Administration of China. Interim Measures for the Management of Generative Artificial Intelligence Services [EB/OL]. (2023-07-13) [2024-12-01]. https://www.cac.gov.cn/2023-07/13/c_1690898327029107.htm
[17] Editorial Board, Zhang Rong. The impact of generative AI technology on education — An interview on ChatGPT [J]. E-education Research, 2023, 44(02): 5–14. DOI:10.13811/j.cnki.eer.2023.02.001.
[18] Miao Fengchun. Principles of generative AI technology and its educational applicability [J]. Modern Educational Technology, 2023, 33(11): 5–18.
[19] Du Hua, Sun Yanchao. Rethinking epistemology in the wave of generative AI — A contemporary response to two classical knowledge questions [J]. Modern Educational Technology, 2024, 34(01): 96–106.
[20] Yan Yifeng, Ding Jie, Gao Ying, et al. Generative AI empowers education transformation in the digital era [J]. Open Education Research, 2024, 30(02): 42–48. DOI:10.13966/j.cnki.kfjyyj.2024.02.005.
[21] Lan Guoshuai, Du Shuilian, Song Fan, et al. Generative AI in education: Key debates, promotion methods, and future topics — Key points and reflections on the UNESCO report [J]. Open Education Research, 2023, 29(06): 15–26. DOI:10.13966/j.cnki.kfjyyj.2023.06.002.
[22] Zheng Yonghe, Zhou Danhua, Zhang Yonghe, et al. ChatGPT from a computational education perspective: Connotation, themes, reflection, and challenges [J]. Journal of East China Normal University (Educational Sciences Edition), 2023, 41(07): 91–102. DOI:10.16382/j.cnki.1000-5560.2023.07.009.
[23] Jing Zhou, Yang Qiguang. Generative AI empowers a paradigm shift in educational research: Mechanisms, risks, and strategies [J]. China Educational Technology, 2024(03): 68–75.
[24] Li Haifeng, Wang Wei, Li Guangxin, et al. Smart midwifery teaching method — A teaching practice example of "Socratic AI Chatbot" [J]. Open Education Research, 2024, 30(02): 89–99. DOI:10.13966/j.cnki.kfjyyj.2024.02.010.
[25] Li Yan, Xu Jie, Sun Dan. Practice and effect of human-AI collaborative instructional design for postgraduates [J]. Modern Distance Education, 2024(05): 59–69. DOI:10.13927/j.cnki.yuan.20241106.002.
[26] Zheng Lanqin, Gao Lei, Huang Zichen. Can dialogue robots based on generative AI promote performance in online collaborative learning? [J]. E-education Research, 2024, 45(03): 70–76+84. DOI:10.13811/j.cnki.eer.2024.03.010.
[27] Coffey L. Harvard taps AI to help teach computer science course [EB/OL]. (2024-12-01). https: //www.insidehighered.com/news/tech-innovation/artificial-intelligence/2023/06/30/harvard-rolls-out-ai-help-free-tas-time
[28] Yan Lirong, Chu Jiewang, Li Zhenyan, et al. Integrating generative AI into information resource management courses: A path exploration [J/OL]. Library Journal, 1–15 [2024-12-06]. http: //kns. cnki. net/kcms/detail/31.1108.G2.20241105.1004.002.html
[29] Wang Chunli, Chen Yanyan, Gu Xiaoqing, et al. Mechanism of generative AI promoting creative potential in collaborative learning [J]. E-education Research, 2024, 45(11): 76–83. DOI:10.13811/j.cnki.eer.2024.11.011.
[30] Li Qing, Wang Jiankun. From "Future World" to "Visual Scientific Inquiry" — Interpretation of the UK Open University’s Innovative Teaching Report (2024 edition) [J]. Distance Education Journal, 2024, 42(05): 3–11+34. DOI:10.15881/j.cnki.cn33-1304/g4.2024.05.001.
[31] Zhang Jing. Constructing a teaching model for high-order thinking in translation under the background of generative AI [J]. Chinese Translators Journal, 2024, 45(03): 71–80.
[32] Zhao Lihong, Zuo Min, Huang Xiankai. The reform direction of higher education teaching in the AI era: Cultivating higher-order thinking [J]. Journal of Beijing Normal University (Social Sciences Edition), 2023(04): 40–48.
[33] Dai Ling, Zhao Xiaowei, Zhu Zhitin. Smart Inquiry: A new model of dialogic learning based on ChatGPT [J]. Open Education Research, 2023, 29(06): 42–51+111. DOI:10.13966/j.cnki.kfjyyj.2023.06.005.
[34] Wang Zuhao, Tian Yan. Higher-order thinking ability in the digital information age: Elements, relationships, assessment, and cultivation [J]. Educational Science Research, 2024(02): 5–12.
[35] Wang Huanjing, Wei Jiangming, Fei Jianxiang. Deep problem-solving ability: Conceptual features, theoretical framework, and cultivation path — From the perspective of AIGC technology empowerment [J]. China Educational Technology, 2024(05): 97–104.
[36] Li Haifeng, Wang Wei. Human-machine debating inquiry method: A model for cultivating students' higher-order thinking skills supported by dialogic AI [J]. E-education Research, 2024, 45(03): 106–112+128. DOI:10.13811/j.cnki.eer.2024.03.015.
[37] Li Haifeng, Li Guangxin, Tang Yunfeng. A collaborative teaching model supported by intelligent multi-perception AI: Case study of the "Confucius" LLM chatbot [J]. Modern Distance Education, 2024(04): 48–59. DOI:10.13927/j.cnki.yuan.20240729.001.
[38] L. W. Anderson et al. Taxonomy for Learning, Teaching and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives [M]. Translated by Pi Liansheng. Shanghai: East China Normal University Press, 2008.
[39] Tian Luping. Teaching strategies in information technology based on the cultivation of higher-order thinking [J]. Theory and Practice of Education, 2020, 40(35): 57–59.

Subscription

E-Mail Alert

Downloads:	15023
Visits:	473663

An Exploration of the Impact of Generative Artificial Intelligence on College Students' Higher-Order Thinking Skills: A Teaching Practice Study

Author(s)

Affiliation(s)

Corresponding Author

ABSTRACT

KEYWORDS

CITE THIS PAPER

REFERENCES

RESOURCES

JOIN US

PUBLICATION SERVICES

CONTACT US