Higher Education Category Submission

440 – Metaverse and AI Integration: Building an On-Campus and Off-Campus Unified Learning Ecosystem

During long holidays such as winter and summer vacations, primary and secondary school students lack effective guidance and supervision from the school, so teachers cannot grasp the students' learning status in time, resulting in poor connection between teaching and learning in the new semester and difficulty in implementing personalized guidance. To solve this problem, this project integrates the metaverse and generative artificial intelligence to build an integrated on-campus and off-campus after-school learning ecosystem, aiming to achieve effective supervision and support for after-school learning.
On the technical level, the project uses Virtual Reality (VR) and Augmented Reality (AR) technologies to create an immersive learning environment, integrate all after-school learning activities, and enhance the connection and experience of teaching and learning. At the same time, the chatbot provides instant Q&A services, and analyzes students' learning data and interaction data through natural language processing (NLP) to generate personalized learning paths. In addition, machine learning algorithms dynamically generate exercises and evaluation tools to test learning effects in real time and provide data support for teachers, thereby significantly improving the quality and personalized experience of after-school learning.
Through the combination of these technologies, this project aims to significantly improve the quality and continuity of after-school learning and help teachers and students better achieve learning connection.

(1) Problem Identification
According to feedback from parents and teachers, students showed problems such as lack of motivation and forgetfulness after returning to school after the holidays. At the same time, it is difficult for teachers to understand students' learning status in time during the holidays. In the new semester, they need to spend more time and energy to re-understand students' actual learning situation, resulting in reduced teaching efficiency. These problems make us realize that an innovative way is needed to solve the problem of supervision and guidance of holiday learning.
In recent years, Metaverse and Generative AI technologies have developed rapidly. The immersive experience of Metaverse and the personalized support of Generative AI make us realize that they can be used to solve the problem of holiday learning supervision and personalized guidance.
(2) Project Hypothesis
Hypothesis 1: The integration of Metaverse and AI will effectively fill the gap in holiday learning supervision
Hypothesis 2: Learning data and feedback will help teachers quickly adjust teaching strategies in the new teaching stage
Hypothesis 3: Dynamic adjustment of learning content and difficulty will help students personalized learning
(3) Prospect
Technologies such as VR, AR, Generative AI and machine learning are relatively mature and their applications in the field of education are gradually increasing. By integrating these technologies, the project has the feasibility of technical implementation. At the same time, holiday study supervision and personalized tutoring are common pain points in the education field and have broad application prospects.

(1) Solution
By analyzing the needs of parents, teachers, and students, and evaluating existing educational products, we identify unique advantages. A dedicated team of VR/AR engineers, AI algorithm specialists, UI/UX designers, and education experts is assembled to develop a Metaverse platform using Unity 3D. VR/AR technology creates immersive virtual classrooms and learning environments, supporting multi-user interaction and optimized by cloud rendering. Generative AI and NLP power intelligent chatbots for multi-round dialogue and learning data analysis, generating personalized learning paths and visual reports. Machine learning algorithms dynamically produce tailored content and assessments, integrated with knowledge graphs for logical coherence, enabling real-time learning evaluation and strategy optimization. This results in a highly integrated, immersive, and intelligent after-school learning ecosystem, addressing supervision and personalized guidance challenges to enhance learning and teaching efficiency.
(2) Core functions
Immersive Learning Environment
Create a virtual classroom for multi-user interaction with customizable layouts, collaborative whiteboards, and diverse scenarios like virtual labs and historical reconstructions.
Instant Q&A & Personalized Learning Paths
Develop intelligent chatbots for natural language questions, multi-round dialogues, and voice interactions. Analyze student data to generate personalized learning paths and visual reports.
Dynamic Exercises & Assessment Tools
Generate diverse question types and adjust difficulty based on student performance for comprehensive knowledge coverage. Evaluate learning in real time, providing scores, error analysis, and weak point reports. Enable handwritten answer recognition and automatic correction for instant feedback.
Teacher Data Support
Offer detailed visual reports with personalized teaching suggestions, resource recommendations, and tailored strategies. Use real-time monitoring to provide behavior alerts and intervention tips, helping teachers track student progress effectively.
(3) Performance evaluation
Conduct a one-month pilot in select schools, measuring system impact through student performance, knowledge mastery, and engagement, while gathering teacher feedback on data support, strategy optimization, and usability.

Sorry, we chose Stream 1 and did not involve this part.

By integrating the metaverse and generative artificial intelligence, the project provides effective ideas for solving the key problems of poor supervision and disconnected learning during the long vacations for primary and secondary school students. It is in sharp contrast with traditional learning platforms in terms of innovation and effectiveness, especially in the combination of technology and education.
First, at the technical level, the project uses VR and AR technology to create an immersive learning environment, combined with multimodal interaction and real-time data analysis, which significantly improves the learning experience and participation, far exceeding the one-way teaching and interaction limitations of traditional platforms.
Secondly, at the educational level, the project effectively fills the problem of lack of supervision during winter and summer vacations. Compared with the inefficient learning without systematic guidance in the past, through real-time feedback and personalized guidance, it ensures that teachers can instantly grasp the learning status of students, thereby promoting the smooth connection between teaching and learning. This comprehensive innovation of technology and education not only improves learning effects, but also greatly enhances students' learning motivation and teamwork ability.

(1) Technology and expansion maintenance
Use microservice architecture and Kubernetes containerization technology to build an elastic and scalable education cloud platform to achieve dynamic resource scheduling. Optimize VR/AR teaching experience through edge computing, and develop lightweight models to adapt to various terminals. Introduce federated learning to ensure data privacy and provide inclusive hardware rental services. The platform uses green data centers and AI model compression technology to reduce energy consumption, implement equipment recycling plans, and create a sustainable smart education ecosystem.
(2) Function update
Establish a user-driven iteration mechanism: The platform has a built-in "function voting" system, combined with A/B testing for grayscale release; use NLP to analyze student-student interaction data in real time, automatically identify high-frequency demand points, and drive the teaching and research team to quickly develop targeted modules. Update the national new curriculum knowledge map every year to ensure the timeliness of teaching content and form an agile closed loop of "demand discovery-development verification-comprehensive promotion".
(3) Cooperation with schools and government departments
Three measures to promote government-school cooperation: ① Jointly build smart education demonstration schools to obtain policy support; ② Connect with national education platforms to achieve data interoperability; ③ Apply for special subsidies to lower the threshold for grassroots use. Use blockchain encryption and third-party audits as dual guarantees to ensure data compliance and establish a cooperative trust mechanism.
(4) Training of teachers and students
Build a three-dimensional training system of "teachers-students-parents": teachers improve digital teaching capabilities through AR interactive courses and offline certification; students use gamification guidance and points incentives; parents receive customized micro-courses. Form an "education technology counselor" alliance composed of technical teams, education experts and key teachers, provide 24-hour support through the community, and establish a UGC best practice library.

(1) Social problems solved and beneficiary groups
This project targets the three core pain points of academic connection gap, uneven educational resources and lack of personalized education. It fills the gap in winter and summer vacation supervision through innovative technical means, allowing students in remote areas to share high-quality educational resources and providing customized learning support for students with special needs. Beneficiaries include: students improve learning participation, teachers reduce teaching burden, parents reduce education costs, and pay special attention to the education needs of disadvantaged families.
(2) Fair and inclusive practice
Education is universal through technological innovation, ensuring equal access rights for areas with poor network conditions and special students. At the same time, it is closely integrated with policies, and special support is used to reduce the use threshold in resource-poor areas, ensure that technology applications meet accessibility standards, and promote the real implementation of educational equity.
(3) Social impact assessment and continuous improvement
Establish a complete multi-dimensional evaluation system to comprehensively measure the effectiveness of the project from the aspects of educational equity, learning effects, inclusiveness and sustainability. Through intelligent analysis tools and user feedback mechanisms, we continuously track usage and respond to changes in educational needs in a timely manner to ensure that the project always remains closely aligned with actual needs.

Personal Information Collection Statement (PICS):
1. The personal data collected in this form will be used for activity-organizing, record keeping and reporting only. The collected personal data will be purged within 6 years after the event.
2. Please note that it is obligatory to provide the personal data required.
3. Your personal data collected will be kept by the LTTC and will not be transferred to outside parties.
4. You have the right to request access to and correction of information held by us about you. If you wish to access or correct your personal data, please contact our staff at lttc@eduhk.hk.
5. The University’s Privacy Policy Statement can be access at https://www.eduhk.hk/en/privacy-policy.

• I have read and agree to the competition rules and privacy policy.