杨睿,刘瑞军,师于茜,李善玺.面向智能交互的视觉问答研究综述[J].电子测量与仪器学报,2019,33(2):117-124 |
面向智能交互的视觉问答研究综述 |
Survey of visual question answering for intelligent interaction |
|
DOI: |
中文关键词: 视觉问答 图像理解 计算机视觉 自然语言处理 |
英文关键词:visual question answering image comprehension computer vision natural language processing |
基金项目:2018年研究生科研能力提升计划资助项目 |
|
|
摘要点击次数: 351 |
全文下载次数: 2 |
中文摘要: |
随着深度学习方法被不断应用于图像处理相关工作,图像相关的智能交互技术也获得了快速发展。面向智能交互的视觉问答技术通过向图像的内容提出相关问题以收集图像信息,最终达到丰富图像理解的目的。通过对近年来视觉问答相关方法进行了综合分析与对比,建设性地将视觉问答方法按照模型结构划分为基本模型、注意力机制模型、模块化模型、基于外部知识库的模型4种类型。同时,还从3个方面针对视觉问答中的视觉和语义信息处理以及未来的视觉推理研究指出了一些方向。 |
英文摘要: |
With the application of deep learning method in the field of image processing, the image related intelligent interaction technology has also been rapidly developed. Visual question answering (VQA) collects the image information by asking questions related to the image and ultimately achieves the purpose for enriching the image understanding. Through comprehensive analysis and comparison of related methods of VQA in recent years, the method can be constructively divided into four types according to the model structure: basic model, attention mechanism related model, modular model and external knowledge base model. At the same time, it also points out directions for visual and semantic information processing and future research on visual reasoning in VQA from three aspects. |
查看全文 查看/发表评论 下载PDF阅读器 |