Develop effective learning environments and approaches to student support and guidance
The use and value of appropriate learning technologies
Artificial Intelligence in education (AIEd) includes tools like chatbots, tutoring systems, and generative AI (like ChatGPT). These systems can provide real-time feedback, automate explanations, and help students practice skills. In higher education, AI is used in everything from essay writing to STEM tutoring. The evidence suggests AI can boost learning, especially when used in short-term tasks or when well integrated with curriculum goals.
Overall, AI in education has a very large effect on learning achievement ➕➕➕➕ (Tlili et al., 2025). Chatbots alone have a large effect ➕➕➕➕ (Wu & Yu, 2023), particularly for higher education students and short-term interventions. Generative AI shows a medium effect ➕➕➕ for college students, especially when used for writing or independent learning (Sun & Zhou, 2024). Zhu et al. (2025) found smaller but significant effects of generative AI (g = 0.39), with stronger outcomes in primary education and in the humanities. Moderator factors include duration of use (shorter is better), education level (higher ed benefits more from chatbots), and type of content generated.
This summary is based on five high-quality meta-analyses. Tlili et al. (2025) analysed 85 studies and found very large effects for AI overall. Wu and Yu (2023) focused on 24 chatbot studies and showed strong outcomes for higher education. Sun and Zhou (2024) reviewed 28 studies on generative AI and found medium-sized gains. Zhu et al. (2025) examined 26 Gen-AI studies across all education levels, and found small to medium effects depending on learning outcomes.
Sun, J., & Zhou, M. (2024). Does generative artificial intelligence improve the academic achievement of college students? A meta-analysis. Educational Technology Research and Development. https://doi.org/10.1007/s11423-024-10386-0
Tlili, A., Yang, J., Ai, B., Wang, X., & Burgos, D. (2025). Investigating the effect of artificial intelligence in education (AIED) on learning achievement: A meta-analysis. Educational Technology Research and Development. https://doi.org/10.1007/s11423-025-10379-0
Wu, L., & Yu, B. (2023). Do AI chatbots improve students’ learning outcomes? Evidence from a meta-analysis. British Journal of Educational Technology, 54(6), 1310–1328. https://doi.org/10.1111/bjet.13374
Zhu, Y., Huang, L., & Cheng, G. (2025). A meta-analysis of the effects of generative artificial intelligence on student learning. Education and Information Technologies. https://doi.org/10.1007/s10639-025-13420-z
