HyPAM-ITS: a Hybrid Pedagogically-Align Intelligent Tutoring System Multi-Verifier
Abstract
In the modern educational environment, the issue of delivering quality and individualized education to the ever increasing student population around the world has become an issue of critical proportions. The old-fashioned classroom model will not be able to scale, but the recent breakout of Artificial Intelligence (AI) and Machine Learning (ML) presents an opportunity. Nevertheless, the implementation of AI in education is also frequently negated by the problems of accuracy, hallucination, and the lack of pedagogical disturbances. We introduce HyPAM-ITS, a new, AI-based intelligent tutoring platform that reinvents the online learning process. HyPAM-ITS uses a complex, multi-level Large Language Model (LLM) pipeline, that is, a combination of Gemini 1.5, Gemini 1.5 Pro and Gemini Pro in a scaled MERN-stack architecture, in contrast to a typical chatbot, or a rule-based, fixed system. The system is not only created to answer questions, but is expected to teach, and thus, using Retrieval-Augmented Generation (RAG) to base its answers on validated course materials, factual integrity is maintained. Moreover, it has an effective feedback loop that is real-time and enables the system to change the teaching approach depending on the level of understanding and emotion of the student. The result of our comprehensive tests that have tested hundreds of complicated academic queries in the areas of Science, Technology, Engineering, and Mathematics (STEMs) shows that this multi-model fallback model has a total accuracy of about 95%. Importantly, the system minimizes the occurrence of harmful AI hallucinations to only 3.2 percent, which is a credible, emotionally conscious, and safe environment to the contemporary learner. This study confirms this hypothesis: a human-in-the-loop architecture with tiered AI verification is the secret to sustainable and equitable education technology.
References
H. Bekkar and Y. Chtouki, Chatbots in Education: A Systematic Literature Review, Education and Information Technologies, vol. 28, no. 4, pp. 4971-4992, 2023. doi: 10.1007/s10639 -023- 11693-8.
L. Meng and H. Yang, "Improving Automated Feedback in Intelligent Tutoring Systems through Large Language Models and Data Distillation arXiv preprint, 2024.
R. Rekha, M. Balakrishnan, and K. Ramesh, "Design of an AI-Powered Personalized Learning System Design: Student Engagement and Performance Tracking System," Int. J. of Scientific Research in Computer Science, Engineering and Information Technology, vol. 9, no. 2, pp. 45-52, 2023.
S. Rudolph, D. Clarke, and C. Wang, "Automated Feedback Generation in an Intelligent Tutoring System on Counselor Education," Frontiers in Education, vol. 8, pp. 1-12, 2023. doi: 10.3389/feduc.2023.1256749.
Graesser, N. Nye, and X. Hu, Intelligent Tutoring Systems: A 2022 Review of Models, Architectures, and Learning Outcomes, International Journal of Artificial Intelligence in Education, vol. 32 no. 3 pp. 621-655, 2022. doi: 10.1007/s40593-021-00258-1.
Y. Wang, M. Liang, and J. Li, Large Language Models in Education: Opportunities, Challenges, and Future Directions, Computers and Education: Artificial Intelligence, vol. 5, pp. 1-18, 2023. doi: 10.1016/j.caeai.2023.100152.
T. Roll and R. Winne, “AI-Based Personalized Learning Systems: A Review of Student Modeling and Predictive Analytics,” Journal of Educational Data Mining, vol. 14, no. 1, pp. 45-67, 2022.
M. Holmes and K. Porayska-Pomsta, Ethics in AI Tutors: ensuring fairness, transparency, and safety in intelligent learning environments, British Journal of Educational Technology, vol. 54, no. 1, pp. 112-135, 2023. doi: 10.1111/bjet.13251 38
Singh and K. Gupta, Multimodal AI to Adaptive Learning: Text, Vision and Speech in the ITS Systems of the Modern Era, IEEE Transactions on Learning Technologies, vol. 16, no. 2, pp. 145- 158, 2024. doi:
1109/TLT.2024.3356723 10. N. Shrestha and F. Alam, "Explainability and Trust in Educational LLMs: Evaluation," Computers & Education, vol. 208, pp. 104870, 2024. doi: 10.1016/j.compedu.2023.104870.
Refbacks
- There are currently no refbacks.