光轴外扩式布置的双目相机图像立体校正

摘要/Abstract

摘要：

摘要：针对宽视野光轴外扩式布置双目图像采集和显示系统的图像立体校正问题，利用三维重建误差，提出了一种基于双目图像视差特性的立体校正方法.在分析光轴外扩式布置双目相机图像视差特性的基础上，针对相机光心与显示投影中心间的位置误差和相机光轴与显示视轴间的角度误差，建立图像仿射变换、水平视差畸变和垂直视差的校正函数，利用一组空间采样点的三维重投影误差作为目标函数通过优化方法求解校正参数.仿真实验表明：在视轴外扩夹角为30°时，本方法可以有效地消除光心位置误差和光轴角度误差对图像视差造成的影响.真实图像校正实验表明：校正后的图像水平畸变小，在显示宽视野双目图像时，能保持正确的三维立体感.
关键词：中图分类号：文献标志码： A

关键词: , 立体视觉, 图像校正, 宽视野头戴式显示器, 光轴外扩式布置, 垂直视差, 三维重投影误差

Abstract:

Abstract： The traditional stereo correction method based on epipolar geometry is difficult to apply to the binocular imaging and display system with optical axes divergent arrangement for wide field of view. To address this problem, using 3D reconstruction error, a stereo image correction method was proposed based on the disparity characteristics of the binocular images. First, the features of horizontal and vertical disparity of the images captured by binocular imaging system with divergent optical axes was analyzed. Then, based on these characteristics, a pair of affine transformation was proposed for the position error between the optical centers of the binocular cameras and the corresponding projection centers of the wide vision HMD(Head Mounted Display), and two functions of horizontal disparity distortion correction and vertical disparity correction were proposed for the angular deviation between the optical axes of binocular cameras and the corresponding visual axes of the wide vision HMD. Finally, the stereo correction parameters were calculated using the optimization solution with 3D reprojection errors of a set of 3D spatial points. Simulation results show that this method can effectively eliminate the effects on the stereo disparity of the binocular images caused by the position error of optical center and the angular deviation of optical axes when the divergent angle of visual axes is up to 30 °. Real image correction experiment results show that the corrected images have small horizontal distortion, and can provide correct 3D senses with a wide field of view.
Key words：

Key words: stereo vision, image correction, wide vision head mounted display, optical axes divergent arrangement, vertical disparity, 3D re-projection error

中图分类号:

TP 391.9

荆旭1，邱世广1，尹旭悦1，范秀敏1,2，何其昌1,2. 光轴外扩式布置的双目相机图像立体校正[J]. 上海交通大学学报（自然版）, 2015, 49(02): 141-149.

JING Xu1,QIU Shiguang1,YIN Xuyue1,FAN Xiumin1,2,HE Qichang1,2. Stereo Correction of Binocular Images with Optical Axes Divergent Arrangement[J]. Journal of Shanghai Jiaotong University, 2015, 49(02): 141-149.

参考文献

［1］Zou X, Zou H, Lu J. Virtual manipulatorbased binocular stereo vision positioning system and errors modelling［J］. Machine Vision and Applications, 2012, 23(1): 4363.

［2］闫吉辰,安平,李春华,等.多视成像实时校正与立体显示［J］. 上海大学学报, 2014, 10(1): 9298.

YAN Jichen, AN Ping, LI Chunhua, et al. Realtime rectification and stereo display for multiview imaging ［J］. Journal of Shanghai University, 2014, 10(1): 9298.

［3］Paul P, Fleig O, Jannin P. Augmented virtuality based on stereoscopic reconstruction in multimodal imageguided neurosurgery: Methods and performance evaluation［J］. IEEE Transactions on Medical Imaging, 2005, 24(11): 15001511.

［4］李伟,肖谧,王璨,等.一种对平行配置模式多视点采集系统的几何校正方法［J］.天津工业大学学报, 2013, 32(5): 5156.

LI Wei, XIAO Mi, WANG Can, et al. A geometric correction method for multiview 3D system with parallel configuration ［J］. Journal of Tianjin Ploytechnic University, 2013, 32(5): 5156.

［5］陈华华,杜歆,李宏东.平行多基线立体视觉图像校正［J］. 浙江大学学报, 2004, 38(7): 779803.

CHEN Huahua, DU Xin, LI Hongdong, et al. Rectif ication of images for parallel multiplebasel ine stereo vision ［J］. Journal of Zhejiang University, 2004, 38(7): 779803.

［6］Kanbara M, Okuma T, Takemura H, et al. Stereoscopic video seethrough augmented reality system based on realtime visionbased registration［J］. Proceedings of International Conference on Pattern Recognition, 2000, 15(4): 147151

［7］Takagi A, Yamazaki S, Saito Y, et al. Development of a stereo video seethrough HMD for AR systems ［C］∥In IEEE and ACM International Symposium on Augmented Reality(ISAR 2000). Munich Germany： ISAR, 2000: 6877.

［8］Fusiello A, Trucco E, Verri A. A compact algorithm for rectification of stereo pairs［J］. Machine Vision and Applications, 2000, 12(1): 1622.

［9］刘怡光,孙柏林,石勇涛,等.用于3维重建的立体图像校正［J］. 四川大学学报, 2013, 45(3): 7984.

LIU Yiguang, SUN Bolin, SHI Yongtao, et al. Stereo image rectification suitable for 3D reconstruction ［J］. Journal of Sichuan University, 2013, 45(3): 7984.

［10］卢海平,刘伟奇,康玉思,等.全景三维立体头盔显示光学系统设计［J］. 光学学报, 2012, 32(5): 16.

LU Haiping, LIU Weiqi, Kang Yusi, et al. Design of compact optical system in panoramic threedimensional head mounted display［J］. Acta Optica Sinica, 2012, 32(5): 16.

［11］Kang Y S, Ho Y S. An efficient image rectification method for parallel multicamera arrangement［J］. IEEE Transactions on Consumer Electronics, 2011, 57(3): 10411048.

［12］刘佳音,王忠立,贾云得.一种双目立体视觉系统的误差分析方法［J］. 光学技术, 2003, 29(3): 354357.

LIU Jiayin, WANG Zhongli, JIA Yunde. Error analysis of binocular stereo vision system ［J］. Optical Technique, 2003, 29(3): 354357.

［13］杨维,李歧强. 粒子群优化算法综述［J］. 中国工程科学, 2004, 6(5): 8794.

YANG Wei, LI Qiqiang. Survey of particle swarm optimization algorithms ［J］. Engineering Science, 2004, 6(5): 8794.

［14］Motai Y, Kosaka A. Handeye calibration applied to viewpoint selection for robotic vision［J］. IEEE Transactions on Industrial Electronics, 2008, 55(10): 37313741.

[1]	王聚团, 戚晓宁, 黄志明. 水下生产管汇测试技术及其改进研究[J]. 海洋工程装备与技术, 2022, 9(2): 43-49.
[2]	袁振钦, 邹科, 孙亚峰, 刘刚, 屈衍, 李居跃. 基于时域分析法的动态电缆疲劳分析[J]. 海洋工程装备与技术, 2022, 9(2): 50-55.
[3]	王娟, 杨明旺, 郑茂尧, 刘凌云, 赵立君. 高强钢在大型半潜式平台组块建造中的应用[J]. 海洋工程装备与技术, 2022, 9(1): 27-31.
[4]	陈欣, 赵晓磊, 王立坤, 肖德明, 张腾月. 深水大型吸力锚建造技术研究[J]. 海洋工程装备与技术, 2022, 9(1): 32-36.
[5]	尹彦坤, 易涤非. 半潜式生产平台船体结构关键节点工程临界评估[J]. 海洋工程装备与技术, 2022, 9(1): 52-57.
[6]	MA Qunsheng (马群圣), CEN Xingxing (岑星星), YUAN Junyi (袁骏毅), HOU Xumin (侯旭敏). Word Embedding Bootstrapped Deep Active Learning Method to Information Extraction on Chinese Electronic Medical Record[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(4): 494-502.
[7]	ZHANG Shengfa (张胜发), TANG Na (唐纳), SHEN Guofeng (沈国峰), WANG Han (王悍), QIAO Shan (乔杉). Universal Software Architecture of Magnetic Resonance-Guided Focused Ultrasound Surgery System and Experimental Study[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(4): 471-481.
[8]	安庆升, 孙立东, 武秋生. 碳纤维增强复合材料发射筒设计研究[J]. 空天防御, 2021, 4(2): 13-.
[9]	KONG Xiangqiang (孔祥强), MENG Xiangxi (孟祥熙), LI Jianbo (李见波), SHANG Yanping (尚燕平), CUI Fulin (崔福林) . Comparative Study on Two-Stage Absorption Refrigeration Systems with Different Working Pairs[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(2): 155-162.
[10]	ZHUANG Weimin (庄蔚敏), WANG Pengyue (王鹏跃), AO Wenhong (熬文宏), CHEN Gang (陈刚) . Experiment and Simulation of Impact Response of Woven CFRP Laminates with Different Stacking Angles[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(2): 218-230.
[11]	ZHOU Xuhui (周旭辉), ZHANG Wenguang (张文光), XIE Jie (谢颉). Effects of Micro-Milling and Laser Engraving on Processing Quality and Implantation Mechanics of PEG-Dexamethasone Coated Neural Probe[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(1): 1-9.
[12]	HUANG Ningning (黄宁宁), MA Yixin (马艺馨), ZHANG Mingzhu (张明珠), GE Hao (葛浩), WU Huawei (吴华伟). Finite Element Modeling of Human Thorax Based on MRI Images for EIT Image Reconstruction[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(1): 33-39.
[13]	WANG Xianjin, GAO Xu, YU Kuigang . Fixture Locating Modelling and Optimization Research of Aluminum Alloy Sidewall in a High-Speed Train Body[J]. J Shanghai Jiaotong Univ Sci, 2020, 25(6): 706-713.
[14]	QIAO Xing, MA Dan, YAO Xuliang, FENG Baolin. Stability and Numerical Analysis of a Standby System[J]. J Shanghai Jiaotong Univ Sci, 2020, 25(6): 769-778.
[15]	WU Jin, MIN Yu, YANG Xiaodie, MA Simin . Micro-Expression Recognition Algorithm Based on Information Entropy Feature[J]. Journal of Shanghai Jiao Tong University(Science), 2020, 25(5): 589-599.