上海交通大学学报

上海交通大学学报（自然版） ›› 2018, Vol. 52 ›› Issue (1): 83-89.doi: 10.16183/j.cnki.jsjtu.2018.01.013

• 学报（中文） • 上一篇    下一篇

基于模型的增强现实无标识三维注册追踪方法

王月，张树生，何卫平，白晓亮   

  1. 西北工业大学 现代设计与集成制造技术教育部重点实验室， 西安 710072
  • 出版日期:2018-01-01 发布日期:2018-01-01
  • 基金资助:
    中央高校基本科研业务费专项资金项目 (3102015BJ(II)MYZ21)

Model-Based Marker-Less 3D Tracking Approach for Augmented Reality

WANG Yue,ZHANG Shusheng,HE Weiping,BAI Xiaoliang   

  1. Key Laboratory of Contemporary Designing and Integrated Manufacturing Technology of Ministry of Education, Northwestern Polytechnical University, Xi’an 710072, China
  • Online:2018-01-01 Published:2018-01-01

摘要： 为了克服物体表面缺少足够的纹理特征且算法搜索空间太大的缺陷，提出了一种基于模型与自然特征点相融合的三维注册追踪方法.采用保持旋转和尺度不变性的线性并行多模态(LINE-MOD)模板匹配方法快速识别目标物体、获取与当前视角接近的参考视图而完成相机位姿的粗略估计，并缩小算法的搜索空间；采用基于自然特征点的方法完成相机位姿的精确计算；为了避免因特征点较少而引起的位姿抖动或扰动，引入了有效的非迭代透视n点问题(RPnP)算法以提高注册追踪的精度和速度.结果表明，所提出的注册追踪方法能够进行快速三维注册，具有良好的实时性和鲁棒性，其运算速度可达30帧/s.

关键词: 增强现实, 三维注册追踪, 无标识

Abstract: To tackle the huge searching space and few texture feature points on the object surface problem, we propose a novel method that combines model-based tracking and natural feature tracking for fast and robust camera pose calculation. The proposed method first adapts the state-of-the-art template matching method LINE-MOD into a scale invariant descriptor to recognize the target object and obtain the key-frame that is similar to the current viewpoint. Therefore, it greatly reduces the search space for pose refinement method and improves the searching speed. After that, the keyframe obtained from template matching stage is exploited to refine the tracking accuracy. In order to avoid tracking jitter and improve tracking accuracy and speed, RPnP algorithm is incorporated into our system. The experimental results and performance evaluations demonstrate that our method is fast, accurate and robust for 3D registration and tracking even under partial occlusion, and the tracking speed can reach 30 frame/s.

Key words: augmented reality, 3D registration and tracking, marker-less

中图分类号: