基于深度学习的学生课堂学习状态监测系统设计
DOI:
作者:
作者单位:

1.辽宁石油化工大学信息与控制工程学院抚顺113001;2.沈阳航空航天大学自动化学院沈阳110136

作者简介:

通讯作者:

中图分类号:

TP391.41

基金项目:

国家自然科学基金(61673199)、辽宁省科技公益研究基金(2016002006)项目资助


Design of classroom learning state monitoring system for students based on deep learning
Author:
Affiliation:

1.School of Information and Control Engineering, Liaoning Petrochemical University, Fushun 113001, China; 2.School of Automation, Shenyang Aerospace University, Shenyang, Liaoning 110136, China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    现阶段,学生课堂学习状态的研究大多集中在单人的在线监测,对于多人且环境复杂的线下课堂的监测还处于探索阶段。该研究针对线下教育设计了学生课堂学习状态监测系统,对学生课堂出勤情况及学生面部出现的疲劳状态进行实时监测。首先,使用DSFD人脸检测算法结合ResNet深度残差网络对学生进行人脸识别,记录学生出勤情况;然后,使用ERT回归树集合算法结合头部姿态估计对打哈欠和低头瞌睡的疲劳行为进行检测;再使用加入CBAM模块改进的YOLOv5目标检测算法对学生闭眼行为进行检测;最后,形成一套完整的集合出勤、疲劳检测的学生课堂学习状态监测系统。该系统在实际课堂的测试环境下,可以准确的对学生的出勤进行统计,并且可以实时的监测学生面部出现的打哈欠、低头瞌睡、闭眼的疲劳状态,检测的准确率均超过90%,检测速度约为14.1 fps,证明该系统具有重要的使用价值。

    Abstract:

    At present, most of the research on students’ classroom learning status focus on single-person online monitoring, and the monitoring of offline classroom with multiple students and complex environment is still in the exploratory stage. A monitoring system for students’ classroom learning status was designed for offline education to monitor students’ classroom attendance and fatigue state of students’ faces in real time. First, DSFD face detection algorithm combined with ResNet deep residual network was used to recognize students’ faces and record students’ attendance. Then, ERT regression tree set algorithm combined with head pose estimation was used to detect the fatigue behavior of yawning and drowsiness. Then, the improved YOLOv5 object detection algorithm added CBAM module was used to detect students’ closed eyes behavior. Finally, a complete set of integrated attendance, fatigue detection of student classroom learning state monitoring system is formed. In the actual classroom test environment, the system can accurately calculate the students’ attendance, and can real-time monitor the fatigue state of yawning, lower head and closed eyes on the face of the students. The detection accuracy rate is more than 90%, and the detection speed is about 14.1 fps, which proves that the system has important use value.

    参考文献
    相似文献
    引证文献
引用本文

张立军,曹江涛,姬晓飞,王天昊.基于深度学习的学生课堂学习状态监测系统设计[J].电子测量与仪器学报,2024,38(4):37-45

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2024-07-02
  • 出版日期: