Assisting the remote video learner with self-regulation support: A study on the responsible use of machine learning approaches in education
Online video learning is becoming increasingly important in educational contexts. However, remote video learning challenges not only students’ self-regulation, but also teachers‘ abilities to detect these self-regulation problems. The project addresses this problem at the interface of psychology, educational science, and computer science. To this end, potential problems of self-regulation will be automatically detected and measures to support them, for example by optimizing instructional videos, shall be developed. The focus of the project is on the use of instructional videos in the subject of mathematics with different age groups and levels of difficulty.
For the automatic detection of problems with self-regulation, such as mind wandering and disinterest, the data coming from the students’ webcam and microphone is sensitive. We develop personalized federated learning algorithms to train securely on the private data distributed on the learner’s computers.
Institute: Leibniz-Institut für Wissensmedien (IWM)
Cooperating partners: Eberhard Karls Universität Tübingen; Technische Universität München (TUM); TIB – Leibniz-Informationszentrum Technik und Naturwissenschaften; Leibniz-Institut für die Pädagogik der Naturwissenschaften und Mathematik an der Universität Kiel (IPN)
Do you have questions? Write me an e-mail: firstname.lastname@example.org (Anna Bodonhelyi)
- Bosch, N., & D'mello, S. K. (2019). Automatic detection of mind wandering from video in the lab and in the classroom. IEEE Transactions on Affective Computing, 12(4), 974-988. https://ieeexplore.ieee.org/abstract/document/8680698
- Lee, T., Kim, D., Park, S., Kim, D., & Lee, S. J. (2022). Predicting Mind-Wandering with Facial Videos in Online Lectures. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 2104-2113). https://openaccess.thecvf.com/content/CVPR2022W/CVPM/html/Lee_Predicting_Mind-Wandering_With_Facial_Videos_in_Online_Lectures_CVPRW_2022_paper.html