王 欣,邓章俊,秦 斌.基于轻量化网络和知识蒸馏的回转窑工况识别[J].电子测量与仪器学报,2023,37(9):149-159
基于轻量化网络和知识蒸馏的回转窑工况识别
Working condition recognition based on lightweight network and knowledge distillation for rotary kilns
  
DOI:
中文关键词:  回转窑  火焰图像  工况识别  卷积神经网络  轻量化网络  知识蒸馏
英文关键词:rotary kiln  flame image  working condition recognition  convolutional neural network  lightweight network  knowledge distillation
基金项目:国家自然科学基金(62373142,62033014,61673166)、湖南省自然科学基金(2021JJ50006,2022JJ50074)项目资助
作者单位
王 欣 1.湖南工业大学电气与信息工程学院 
邓章俊 1.湖南工业大学电气与信息工程学院 
秦 斌 1.湖南工业大学电气与信息工程学院 
AuthorInstitution
Wang Xin 1.College of Electrical and Information Engineering, Hunan University of Technology 
Deng Zhangjun 1.College of Electrical and Information Engineering, Hunan University of Technology 
Qin Bin 1.College of Electrical and Information Engineering, Hunan University of Technology 
摘要点击次数: 546
全文下载次数: 481
中文摘要:
      回转窑烧成带图像蕴含丰富火焰信息,准确识别燃烧状态是回转窑优化控制的前提,基于卷积神经网络的方法可以快 速识别回转窑工况,提高回转窑自动化水平,但存在网络规模大,所需计算资源多的问题,为此提出了一种基于轻量化网络和知 识蒸馏的回转窑工况识别方法,在网络卷积层后引入协方差池化层改进教师模型和学生模型,以改进的轻量化网络 MobilenetV2 作为学生模型的主干网络,以改进的 Resnet50 作为教师模型的主干网络,通过构建混合蒸馏损失函数,将教师模型 蕴含的丰富分类标签信息迁移到学生模型中,并将蒸馏训练得到的学生模型作为回转窑工况识别模型,以提高网络对高相似火 焰图像的识别精度。 实验结果表明,经蒸馏后的学生模型总体识别准确率相较于原始模型提高了 3. 33%,对测试集中 3 种工况 的识别率分别达到了 93%、99%、90%,准确率和模型规模均优于目前其他主流网络模型,满足实际生产中实时、低成本要求。
英文摘要:
      The firing zone images of rotary kilns contain rich flame information and accurate combustion state recognition are the premise of optimal control for the rotary kilns. The working conditions can be quickly recognized, and the automation level of the rotary kilns can be improved through the convolutional neural network-based methods, but there are problems with large network size and high computational resources required. Therefore, a working condition recognition method based on lightweight network and knowledge distillation was proposed in this paper. The teacher model and the student model were improved by introducing the collaborator differential layer after the convolutional layer of the network. The improved lightweight network MobilenetV2 was used as the backbone network of the student model while the improved Resnet50 was used as the backbone network of the teacher model. The rich classification label information contained in the teacher model was transferred to the student model by constructing the mixed distillation loss function and the student model obtained by distillation training was used as the working condition recognition model to improve the recognition accuracy of the high similar rotary kiln flame images. The experimental results show that the overall recognition accuracy of the improved student model is increased by 3. 33% compared with the original model, and the recognition accuracy of the three working conditions in the test set reaches 93%, 99%, 90% respectively. The accuracy and network size are better than those of other mainstream networks, and the requirements of real time and low cost in actual production process are met.
查看全文  查看/发表评论  下载PDF阅读器