An Improvement and Verification of Position/Attitude Estimation Algorithm Based on Binocular Vision for Unmanned Aerial Vehicle

Abstract

Abstract:

Abstract： Aimed at the problem of navigation of unmanned aerial vehicle(UAV) in a complex unknown environment, an algorithm of position and attitude estimation based on binocular vision was described and improved in this paper. The feature points in the stereo image pairs were detected and described using the KAZE features in the nonlinear scale space. The feature points were matched with the Knn algorithm. The 3D stereo information of the feature points was calculated in the camera coordinate system. The position and attitude of UAV were estimated with the RANSAC algorithm and the LM iteration algorithm. Some experiments were conducted. The result shows that KAZE features have better accuracy, realtime and repeatability than those of SIFT and SURF. The improved algorithm can meet the requirements of UAV realtime navigation.
Key words：

Key words: unmanned aerial vehicle (UAV), binocular vision, position/attitude estimation

ZHANG Liang1,XU Jinfa1,XIA Qingyuan2,YU Yongjun1. An Improvement and Verification of Position/Attitude Estimation Algorithm Based on Binocular Vision for Unmanned Aerial Vehicle[J]. Journal of Shanghai Jiaotong University, 2015, 49(09): 1387-1393.

References

［1］Nister D, Naroditsky O, Bergen J. Visual odometry［C］∥Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington, DC, USA: IEEE, 2004: 652659.［2］Kitt B, Geiger A, Lategahn H. Visual odometry based on stereo image sequences with RANSACbased outlier rejection scheme［C］∥Intelligent Vehicles Symposium (IV) 2010. San Diego, CA, USA: IEEE, 2010: 486492.

［3］Eynard D, Vasseur P, Demonceaux C, et al. Real time UAV altitude, attitude and motion estimation from hybrid stereovision［J］. Autonomous Robots, 2012, 33(12): 157172.

［4］Garcia Carrillo L R, Dzul Lopez A E, Lozano R, et al. Combining stereo vision and inertial navigation system for a quadrotor uav［J］. Journal of Intelligent & Robotic Systems, 2012, 65(14): 373387.

［5］Caballero F, Merino L, Ferruz J, et al. Visionbased odometry and SLAM for medium and high altitude flying UAVs［M］. Berlin Heidelberg, Germany: Springer, 2009: 137161.

［6］Harris C, Stephens M. A combined corner and edge detector［C］∥Proceedings of the 4th Alvey Vision Conference. Manchester, UK: Alvey Vision Club, 1988: 147152.

［7］Lowe D G. Distinctive image features from scaleinvariant keypoints［J］. International Journal of Computer Vision, 2004, 60(2): 91110.

［8］Bay H, Ess A, Tuytelaars T, et al. Speededup robust features (SURF)［J］. Computer Vision and Image Understanding, 2008, 110(3): 346359.

［9］Alcantarilla P F A N, Bartoli A, Davison A J. KAZE features［C］∥Computer Vision——ECCV 2012. Florence, Italy: Springer, 2012: 214227.

［10］Fischler M A, Bolles R C. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography［J］. Communications of the ACM, 1981, 24(6): 381395.

［11］Perona P, Malik J. Scalespace and edge detection using anisotropic diffusion［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence,1990, 12(7): 629639.

［12］Weickert J, Romeny B H, Viergever M A. Efficient and reliable schemes for nonlinear diffusion filtering［J］. IEEE Transactions on Image Processing, 1998, 7(3): 398410.

［13］Agrawal M, Konolige K, Blas M R. Censure: Center surround extremas for realtime feature detection and matching［C］∥Computer Vision——ECCV 2008. Marseille, France: Springer, 2008: 102115.

［14］Boost C. Libraries［EB/OL］. (20131111) http:∥www.boost.org/

[1]	BAI Wenchao, BAN Mingfei, SONG Meng, XIA Shiwei, LI Zhiyi, SONG Wenlong. Coordinate Scheduling Model of Electric Vehicle-Unmanned Aerial Vehicle Joint Rescue System [J]. Journal of Shanghai Jiao Tong University, 2024, 58(9): 1443-1453.
[2]	LI Xu, DONG Wei, DU Zehong. Research on Flight Path Planning Under Complex Environmental Constraints [J]. Air & Space Defense, 2024, 7(4): 99-105.
[3]	LIU Yuanyuan, ZHOU Leimei, LI Hao, GAO Ziyi. Review of Formation Flight Control Methods for Unmanned Autonomous Air Combat [J]. Air & Space Defense, 2024, 7(4): 47-58.
[4]	WU Xiaojing^∗(武晓晶), CAO Tongyao (曹童瑶), ZHEN Ran (甄然), LI Zhijie (李志杰). AlgoTime-Varying Formation-Containment Tracking Control for Unmanned Aerial Vehicle Swarm Systems with Switching Topologies and a Non-Cooperative Target [J]. J Shanghai Jiaotong Univ Sci, 2024, 29(4): 689-701.
[5]	LIU Zengmin (刘增敏), WANG Shentao(王申涛), YAO Lixiu(姚莉秀), CAI Yunze(蔡云泽). Online Multi-Object Tracking Under Moving Unmanned Aerial Vehicle Platform Based on Object Detection and Feature Extraction Network [J]. J Shanghai Jiaotong Univ Sci, 2024, 29(3): 388-399.
[6]	ZHOU Dongrong, CHEN Shihai, JIANG Zhe, YAN Sainan, YAN Ruihai, GAO Yu. Application of UAV Realistic 3D Modeling in Integral Relocation and Protection of “Yangtze River Estuary II” Ancient Ship [J]. Journal of Shanghai Jiao Tong University, 2023, 57(S1): 20-24.
[7]	HUANG He, HU Kaiyi, LI Zhanyi, WANG Huifeng, RU Feng, WANG Jun. An Image Dehazing Method for UAV Aerial Photography of Buildings Combining MCAP and GRTV Regularization [J]. Journal of Shanghai Jiao Tong University, 2023, 57(3): 366-378.
[8]	HUANG He, GAO Yongbo, RU Feng, YANG Lan, WANG Huifeng. 3D Path Planning of UAV Based on Adaptive Slime Mould Algorithm Optimization [J]. Journal of Shanghai Jiao Tong University, 2023, 57(10): 1282-1291.
[9]	LI Dengpan, REN Xiaoming, YAN Nannan. Real-Time Detection of Insulator Drop String Based on UAV Aerial Photography [J]. Journal of Shanghai Jiao Tong University, 2022, 56(8): 994-1003.
[10]	HUANG Yuhao, HAN Chao, ZHAO Minghui, DU Qiankun, WANG Shigang. Multi-Objective Optimization Strategy of Trajectory Planning for Unmanned Aerial Vehicles Considering Constraints of Safe Flight Corridors [J]. Journal of Shanghai Jiao Tong University, 2022, 56(8): 1024-1033.
[11]	YUAN Dongdong (袁冬冬), WANG Yankai∗ (王彦恺), BAI Jiaqi (白嘉琪). Multi-UAV Route Re-Generation Method Based on Trajectory Data [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(6): 806-816.
[12]	ZHOU Qixian, WANG Yin, SUN Xuean. Control of Unmanned Aerial Vehicle Based on Gain Adaptive Super-Twisting Sliding Mode Theory [J]. Journal of Shanghai Jiao Tong University, 2022, 56(11): 1453-1460.
[13]	GUO Pengjun, ZHANG Rui, GAO Guangen, XU Bin. Cooperative Navigation of UAV Formation Based on Relative Velocity and Position Assistance [J]. Journal of Shanghai Jiao Tong University, 2022, 56(11): 1438-1446.
[14]	JIN Yudong (靳宇栋), FENG Jiabo (冯家波), ZHANG Weijun (张伟军). UAV Task Allocation for Hierarchical Multiobjective Optimization in Complex Conditions Using Modified NSGA-III with Segmented Encoding [J]. J Shanghai Jiaotong Univ Sci, 2021, 26(4): 431-445.
[15]	YAO Tiancheng, ZHAO Yongsheng, WANG Hongyu, HE Yanping, DING Zilong, CHI Zheying, CAI Weikai. Development of a Hybrid Solar and Wind-Powered Long-Range Unmanned Ocean Stereo Exploration Vessel [J]. Journal of Shanghai Jiao Tong University, 2021, 55(2): 215-220.