Description

XR technologies (AR/MR/VR) have brought human-computer interaction (HCI) to a new era, which has also led to giant strides in the realm of education. Particularly, virtual classrooms have shown great potential to enhance conventional education methods and provide valuable feedback for both learners and teachers. We attempt to further explore the possible applications of virtual classrooms and investigate HCI strategies in this context with our ongoing VR Classroom project. 

The VR classroom project aims at an immersive virtual learning environment that allows data tracking in multiple modalities such as eye tracking and hand tracking with the help of corresponding devices and sensors, especially Head Mounted Display (HMD). The collected data provides valuable insights into learners’ and instructors’ behaviors in the virtual environment and enables further analysis. We aim to help both learners and instructors to improve learning and teaching output with our research.  

 

Tags: VR Classroom, Large Language Models, Eye-Tracking