陈 瑶,张云伟,雷金辉,田泽薇,黎 丽.基于视觉的四足动物骨架及行走步态特征提取方法[J].电子测量与仪器学报,2022,36(2):68-77
基于视觉的四足动物骨架及行走步态特征提取方法
Method for skeleton and gait parameters extraction ofquadrupeds walking based on vision
  
DOI:
中文关键词:  计算机视觉  深度学习  骨架提取  运动特征
英文关键词:computer vision  deep learning  skeleton extraction  motion features
基金项目:国家自然科学基金(51365019)项目资助
作者单位
陈 瑶 1. 昆明理工大学信息工程与自动化学院 
张云伟 1. 昆明理工大学信息工程与自动化学院,2. 昆明理工大学云南省人工智能重点实验室,3. 昆明理工大学云南省计算机技术应用重点实验室 
雷金辉 1. 昆明理工大学信息工程与自动化学院,3. 昆明理工大学云南省计算机技术应用重点实验室 
田泽薇 1. 昆明理工大学信息工程与自动化学院 
黎 丽 1. 昆明理工大学信息工程与自动化学院 
AuthorInstitution
Chen Yao 1. College of Information Engineering and Automation, Kunming University of Science and Technology 
Zhang Yunwei 1. College of Information Engineering and Automation, Kunming University of Science and Technology,2. Yunnan Key Laboratory of Artificial Intelligence, Kunming University of Science and Technology,3. Yunnan Key Laboratory of Computer Technology Application, Kunming University of Science and Technology 
Lei Jinhui 1. College of Information Engineering and Automation, Kunming University of Science and Technology,3. Yunnan Key Laboratory of Computer Technology Application, Kunming University of Science and Technology 
Tian Zewei 1. College of Information Engineering and Automation, Kunming University of Science and Technology 
Li Li 1. College of Information Engineering and Automation, Kunming University of Science and Technology 
摘要点击次数: 1005
全文下载次数: 1209
中文摘要:
      为解决四足动物行走期间的骨架信息及步态特征提取问题,基于 HRnet 深度神经网络,通过上下文信息增强与多尺度 信息融合构建了四足动物骨架的提取模型。 在此基础上,建立了基于骨架信息对步态特征进行定量分析的方法。 通过在测试 数据集上对该模型的有效性进行验证,实验结果表明,该模型具有较好的精度,对四足动物关键点估计的平均相似度为 81. 04%,准确率为 92. 77%,召回率为 92. 75%。 基于骨架提取模型,以水牛、羊驼为实验对象,对其行走时的步频特征进行分析 计算,实验结果与人工统计结果相比,最大相对误差为 2. 73%。 通过对一个完整步态周期中水牛和羊驼的髋关节和膝关节角度 变化规律进行分析,提取了四足动物行走过程中的关节运动逻辑以及步态顺序。 最后,以犀牛为实验对象,验证了方法对拍摄 角度的变化具有一定适应性。 研究结果可为四足动物运动信息的智能感知提供参考。
英文摘要:
      Due to the need of extracting skeleton information and gait parameters for walking quadruped, a skeleton extraction model of quadruped is proposed by using context information enhancement and multi-scale information fusion based on HRnet, and a quantitative analysis method for gait parameters is established. The validity of the model is verified on the test data set of images. Experiments show that, in the key point estimation of quadruped, the model achieves good performance with the mean similarity of 81. 04%, the accuracy of 92. 77%, and the recall rate of 92. 75%. Based on the skeleton extraction model, the frequency of buffalo and alpaca were analyzed and calculated. Compared with the manual statistical results, the maximum relative error was 2. 73%. Through analyzing the angle variations of buffalo’ s and alpaca’ s hip and knee joints during a complete gait cycle respectively, the joint motion logic and gait sequence of walking quadruped can be extracted automatically. Finally, taking the rhinoceros as a sample, it is demonstrated that the proposed method can work adaptively in a range of different shooting angle of images. The results can provide a reference for intelligent perception of quadruped motion information.
查看全文  查看/发表评论  下载PDF阅读器