Open Category Submission

451 – Beyond Limits: Eye-Tracking Solutions for Personalized Learning Growth

This innovative project leverages eye-tracking technology to assess the cognitive processes of Primary One students (ages 5.5 to 6.5) facing learning challenges such as ADHD, Autism Spectrum Disorder, selective mutism, and low IQ. Traditional assessments often fall short for these young learners, making eye tracking a valuable alternative. By analyzing fixation duration and time to first fixation, we gain insights into students' interactions with educational materials, informing the development of customized learning resources aimed at enhancing engagement and comprehension in English.
Key Innovations
The project introduces a novel assessment method that transcends conventional written and oral tests. Eye-tracking allows for a nuanced understanding of how students process language and engage with learning materials. This method not only captures cognitive performance but also aids in tailoring instructional strategies to meet individual learning needs effectively.
Design Concepts
We implement individualized instruction, incorporating visual aids and multisensory activities that cater to diverse learning styles. Structured lesson timings, with focused work bursts followed by breaks, are designed to maintain concentration and enhance learning outcomes. Regular parent-teacher meetings foster collaboration, ensuring parents are informed about their children's learning processes and strategies.
Technical Principles
Conducted at The Hong Kong Polytechnic University, the eye-tracking experiment utilized a Tobii eye tracker, allowing for comfortable and accurate data collection. Children acclimated to the device and environment, minimizing anxiety and ensuring reliable results.
Potential Impact
This project aims to redefine personalized education by promoting an inclusive environment that supports academic growth for students with Special Educational Needs (SEN). By showcasing the transformative potential of innovative assessment methods, we seek to enhance engagement, comprehension, and overall success in English language learning, paving the way for future advancements in educational practices.

• Eye-tracking_Edu-Competition_Submitted.pptx
• Eye-tracking_Edu-Competition_Submitted.pdf

Thought Process and Inspiration
The inspiration for this project stems from the unique educational challenges faced by kindergarteners in Hong Kong, where English is the primary medium of instruction. Many students, particularly those with lower English proficiency, struggle with English-only teaching methods. Research indicates that leveraging learners' first language (Chinese) can significantly enhance vocabulary acquisition and comprehension. This realization prompted me to explore innovative approaches that integrate both Chinese explanations and visual aids—specifically 2D and 3D pictures—into English language instruction.
Given the emphasis on high English proficiency in Hong Kong, I was motivated to investigate how these methods could create a more inclusive learning environment that addresses diverse needs. The combination of bilingual support and visual stimuli aims to foster deeper engagement and understanding, ultimately facilitating better language learning outcomes for young learners.

Hypothesis
The underlying hypothesis of this study posits that incorporating both Chinese language support and visual aids will significantly enhance English vocabulary acquisition and reading comprehension among kindergarteners. By analyzing eye-tracking data alongside pre- and post-test results, I believe we will uncover valuable insights into how these instructional methods affect cognitive processing and attention patterns during language learning.
This hypothesis is grounded in established research that highlights the benefits of using learners' first language to support second language acquisition. The integration of 2D and 3D visuals is also expected to provide multisensory engagement, further solidifying understanding. Despite critiques regarding the effectiveness of visual aids, my study aims to address existing gaps in research by comparing these methods specifically within the Hong Kong kindergarten context. The anticipated findings will not only contribute to educational literature but also inform practical teaching strategies that enhance English language proficiency among young learners.

Technology & Implementation
We will leverage eye-tracking technology (both specialized hardware and cost-effective webcam/VR alternatives) to assess learning challenges like dyslexia and ADHD. Machine learning algorithms will analyze gaze patterns to provide personalized interventions. Development requires eye-tracking datasets, AI training tools, and partnerships with schools for pilot testing. Market demand will be validated through teacher surveys, pilot programs, and cost-benefit analyses comparing our solution to traditional SEN diagnostics.

Core Functionalities & User Experience
Key features include real-time gaze analysis, adaptive learning recommendations, and bilingual (English/Cantonese) interfaces. To ensure a smooth UX, we will conduct usability testing with teachers and students, refining based on feedback. Performance will be measured via:

Learning improvements (pre/post literacy scores)

Engagement metrics (session duration, gaze-pattern consistency)

Adoption rates (school uptake, teacher training completion)

Social Impact & Equity
Our solution reduces bias in SEN assessments and lowers costs for underfunded schools through subsidized tech. Multilingual support ensures accessibility for Hong Kong’s diverse learners. Impact will be tracked via student progress, cost savings, and community feedback, with iterative updates (e.g., gamification, Cantonese voice prompts) to sustain engagement.

By combining cutting-edge tech with inclusive design, we democratize special education support, helping every child thrive.

Functional Architecture and Technical Workflow
The project utilizes eye-tracking technology to assess and enhance English vocabulary acquisition among kindergarteners. The functional architecture consists of three main components: participant assessment, data collection, and instructional intervention.
1. Participant Assessment: The study involves two phases, spanning from 2020 to 2024, with a diverse group of 44 Primary One students. Participants are divided into control and experimental groups, allowing for tailored instruction based on their learning profiles.
2. Data Collection: Eye movements are recorded using a Tobii eye tracker in the Speech and Language Sciences Laboratory. The data includes gaze locations, fixation durations, and saccades, which provide insights into cognitive engagement during vocabulary tasks.
3. Instructional Intervention: The teaching program integrates 2D visual aids and Chinese explanations.

Implementation Process
• Preparation Phase (6 months): Develop a tailor-made curriculum that incorporates visual aids and Chinese explanations.
• Pilot Testing (6 months): Conduct preliminary tests to refine the intervention based on initial feedback.
• Full Implementation (2 years): Roll out the program, collecting data through pre- and post-tests to measure vocabulary acquisition and eye-tracking results.
Performance Metrics
Effectiveness will be evaluated using the following metrics:
• Vocabulary Acquisition: Pre- and post-test scores to assess improvement in English vocabulary levels.
• Eye-Tracking Data: Analyze fixation durations and patterns to understand cognitive engagement and attention allocation.
Relationship Between Functions and Technologies
The integration of eye-tracking technology provides a data-driven approach to understanding cognitive processes in young learners. By correlating eye movement patterns with instructional strategies, we can identify which methods are most effective for enhancing language acquisition. Progress will be monitored through regular data collection and analysis, ensuring continuous improvement in educational practices. This project aims to bridge the gap in research regarding effective language learning strategies in the Hong Kong kindergarten context, ultimately contributing to enhanced English proficiency among young learners.

The project represents an innovative and creative solution to the challenges faced by kindergarteners in Hong Kong learning English, particularly those with lower proficiency and diverse learning needs. Traditional methods often fail to engage these young learners effectively, leading to gaps in vocabulary acquisition and comprehension. By integrating eye-tracking technology with a dual-language instructional approach—utilizing both 2D visual aids and Chinese explanations—this project redefines how language learning is approached in early education.
Firstly, the use of eye-tracking technology allows for a detailed analysis of cognitive processes, providing insights into how children interact with visual stimuli during language tasks. This data-driven approach not only enhances our understanding of learning behaviors but also informs the customization of instructional strategies to better meet individual needs.

Secondly, the incorporation of Chinese explanations alongside English vocabulary aligns with research indicating that leveraging a learner's first language can significantly enhance comprehension. This innovative bilingual strategy helps bridge the gap for students who struggle with English-only instruction, enabling them to access and engage with the material more effectively.
Moreover, the use of 2D visual aids fosters multisensory learning experiences, capturing attention and aiding memory retention. This creative combination of visual and verbal input caters to different learning styles, ensuring that all students have the opportunity to thrive.
Overall, the project’s innovative elements—eye-tracking analysis, bilingual instruction, and engaging visual aids—collectively enhance its effectiveness in addressing the challenges faced by young language learners. By providing a tailored, evidence-based approach to vocabulary acquisition, the project not only supports academic growth but also promotes an inclusive learning environment that empowers all students to succeed.

Affordable Eye-Tracking Solutions for SEN Assessment
To make eye-tracking viable for SEN assessment in schools, we focus on cost reduction, accessibility, and teacher adoption:
1. Lower-Cost Hardware Options
- Webcam & mobile-based tracking: Use AI-powered solutions (e.g., OpenGaze) or tablet apps to avoid expensive devices.
- VR/AR partnerships: Collaborate with Meta (Quest) or VR Technology Producers to provide schools with subsidized headsets featuring built-in eye-tracking.
- Open-source alternatives: Develop DIY kits using Raspberry Pi and 3D-printed mounts for budget-conscious schools.

2. Simplified SEN-Friendly Setup
- Gamified calibration: Replace technical calibration with interactive games (e.g., popping bubbles) for better engagement with neurodiverse students.
- AI-assisted adjustments: Automatically compensate for head movements, which is crucial for students with ADHD or motor challenges.
- One-click teacher mode: Streamline operation with minimal setup steps.

3. Driving Teacher Adoption
- Free VR/in-person workshops: Partner with universities and tech firms to train educators on eye-tracking’s SEN applications (e.g., detecting dyslexia via gaze patterns).
- Case studies & funding: Share real-world success stories and secure grants (e.g., Hong Kong’s SEN Support Fund) to subsidize devices.

4. Sustainable Scaling
- Cloud analytics: Process data online to reduce hardware costs.
- Modular upgrades: Let schools start with webcam tracking and transition to advanced devices as needed.

By combining affordable tech, teacher training, and SEN-focused design, eye-tracking can become a scalable, impactful tool for personalized learning.

Social Impact & Equity Alignment
Our solution tackles critical social issues in education by:
1. Bridging Learning Gaps for SEN Students: We utilize personalized, eye-tracking-enabled assessments to identify traits of dyslexia, ADHD, and autism spectrum disorders early on. This approach overcomes biases often present in traditional testing methods, ensuring that all students receive the support they need.
2. Promoting Equity: By offering low-cost alternatives, such as webcam and VR-based tracking, along with subsidized devices, we ensure that underfunded schools can access advanced assistive technology. This democratizes access to essential educational resources.
3. Supporting Multilingual Learners: Our dual-language interfaces align with Hong Kong’s bilingual education goals, providing vital support for non-native English speakers and fostering inclusivity in the classroom.
Impact Metrics
• Learning Outcomes: We will measure improvements in pre- and post-intervention literacy rates and gaze-pattern enhancements among SEN students.
• Adoption Rates: Tracking the number of schools and teachers trained and actively using the system will help gauge our reach and influence.
• Cost Efficiency: We will evaluate reductions in per-student assessment costs compared to traditional SEN diagnostics, highlighting the financial benefits of our approach.

Community Responsiveness
• Feedback Loops: We will implement regular surveys for teachers and focus groups with parents to adapt content and features, such as integrating Cantonese voice prompts if needed.
• Iterative Design: Annual updates will be based on trends observed from eye-tracking data, allowing us to introduce new elements, like gamification, if engagement levels drop.

Our solution promotes social equity by removing barriers to special education assessment. By providing affordable eye-tracking technology, we empower schools to support students with special educational needs effectively. Our non-invasive, objective assessments minimize biases, while a bilingual interface ensures accessibility for Hong Kong's diverse learners, helping every child succeed.

Personal Information Collection Statement (PICS):
1. The personal data collected in this form will be used for activity-organizing, record keeping and reporting only. The collected personal data will be purged within 6 years after the event.
2. Please note that it is obligatory to provide the personal data required.
3. Your personal data collected will be kept by the LTTC and will not be transferred to outside parties.
4. You have the right to request access to and correction of information held by us about you. If you wish to access or correct your personal data, please contact our staff at lttc@eduhk.hk.
5. The University’s Privacy Policy Statement can be access at https://www.eduhk.hk/en/privacy-policy.

• I have read and agree to the competition rules and privacy policy.