Study With Us": An Immersive Learning Platform Integrating Emotion-Based Feedback And Attention Detection For Self-Directed Learning

Abstract

Background: The widespread adoption of remote learning environments has resulted in emotional isolation, reduced concentration, and weakened learning persistence among learners.​

Aim: This study aims to address these issues by designing and implementing an immersive learning platform called "Study With Us."

Material & Methods: "Study With Us" integrates emotion-based feedback, attention detection technology, and real-time video communication. The system monitors on-screen movements in real time through OpenCV-based attention detection and analyses emotional states in learning journals using a LoRA-based large language model (LLM), offering personalized empathetic feedback and progress recommendations. A pilot test was conducted with 10 users to evaluate subjective satisfaction and perceived engagement for each function, using a 5-point Likert scale.

Result: Results from the pilot test showed a high overall system satisfaction score (average 4.8), with positive feedback particularly regarding learning immersion and emotional support. Features such as Video Study Room Engagement, Accuracy of Attention Detection, Empathy of Emotional Feedback, Usefulness of Progress Recommendation, Interaction via Chat Function, and Overall User Experience (UX) all received average satisfaction scores above 4.5.

Conclusion: This study successfully designed and implemented "Study With Us," demonstrating the feasibility of an immersive learning platform that enhances learner engagement, emotional stability, and the continuity of self-directed learning through emotion-analysis-based feedback, attention detection, real-time interaction, and progress recommendations.