基于粒子滤波与改进GVF Snake的人手跟踪算法

doi:10.16183/j.cnki.jsjtu.2018.07.007

摘要/Abstract

摘要： 为实现在复杂背景下对人手进行准确、快速的位置跟踪与轮廓跟踪，并针对粒子滤波无法获取人手目标的准确信息与人手深凹区域获取难的问题，提出一种基于肤色自适应梯度矢量流主动轮廓(Gradient Vector Flow Snake, GVF Snake)模型的粒子滤波算法实现人手跟踪.该算法首先对粒子滤波得到的人手区域进行肤色灰度增强，弱化背景梯度信息，然后对该区域利用引入自适应梯度矢量流场和肤色自适应外部引导力的GVF Snake模型，获取人手的真实轮廓以及准确的系统观测和系统状态，减少了粒子退化的可能，完成了更加准确的位置跟踪.实验表明：在复杂、运动背景甚至大范围遮挡的情况下，该改进算法获得了更加准确的人手轮廓，同时对人手跟踪的实时性提升了13%，均方根误差降低了48%.

关键词: 人手跟踪；人手轮廓；梯度矢量流主动轮廓模型；自适应；粒子滤波

Abstract: To implement the hand tracking and contour tracking accurately and quickly in complex background, a novel algorithm for hand tracking with particle filter and skin color adaptive gradient vector flow snake (GVF snake) model is proposed. This algorithm especially applies to the extraction of deep concave region of hand contour, and overcomes the problem that particle filter can not obtain accurate information. Firstly, the hand region obtained by the particle filter is grayscale enhanced by skin color, weakening the background gradient information. And then the GVF snake model, with adaptive gradient vector flow field and adaptive external guidance force improved by skin color, is introduced to extract the real contour and modify the systematic observation and system state of particle filter. In this case, it can reduce the possibility of degradation of particles and realize hand tracking more accurately. The experimental results show that the proposed algorithm extracts more accurate contour of hand and improves real-time performance of human tracking by 13% and the root mean square error is reduced by 48%, under the conditions of complexity, moving background and even a wide range of occlusion.

Key words: hand tracking; hand contour; gradient vector flow snake (GVF snake) model; adaptiveness; particle filter

中图分类号:

TP 391.41

孙一奇，吴爱国，董娜，邵一哲. 基于粒子滤波与改进GVF Snake的人手跟踪算法[J]. 上海交通大学学报, 2018, 52(7): 801-807.

SUN Yiqi,WU Aiguo,DONG Na,SHAO Yizhe. A Novel Algorithm for Hand Tracking with Particle Filter and Improved GVF Snake[J]. Journal of Shanghai Jiao Tong University, 2018, 52(7): 801-807.

参考文献

［1］WANG X, ZHANG X, DAI G. Tracking of deformable human hand in real time as continuous input for gesture-based interaction［C］∥Proceedings of Inter-national Conference on Intelligent User Interfaces. Honolulu, Hawaii, USA: DBLP, 2007: 235-242. ［2］刘法旺, 丁刚毅, 李善青, 等. 基于ICONDENSATION算法的人手跟踪与手势识别算法［J］. 北京理工大学学报, 2007, 27(12): 1069-1072. LIU Fawang, DING Gangyi, LI Shanqing, et al. ICONDENSATION-based hand tracking and gesture recognition with color and depth cues［J］. Transactions of Beijing Institute of Technology, 2007, 27(12): 1069-1072. ［3］LIM K M, TAN A W C, TAN S C. A feature cova-riance matrix with serial particle filter for isolated sign language recognition［J］. Expert Systems with Applications: An International Journal, 2016, 54(C): 208-218. ［4］季玉龙, 杨光, 戈文一. 基于粒子滤波的目标主动轮廓跟踪算法［J］. 电子科技大学学报, 2015, 41(1): 91-96. JI Yulong, YANG Guang, GE Wenyi. A novel particle filter based object active contour tracking method［J］. Journal of the University of Electronic Science and Technology of China, 2015, 44(1): 91-96. ［5］ZHAO S, SONG X, TAN W, et al. A novel approach to hand gesture contour detection based on GVF Snake model and skin color elliptical model ［C］∥International Conference on Computer Application and System Modeling. Kuala Lumpur, Malaysia: IEEE, 2010: V5-381-V5-384. ［6］李晓旭, 戴彬, 曹洁. 基于多特征融合的改进UPF目标跟踪算法［J］. 上海交通大学学报, 2014, 48(10): 1473-1478. LI Xiaoxu, DAI Bin, CAO Jie. An improved UPF object tracking algorithm based on multi-feature fusion［J］. Journal of Shanghai Jiao Tong University, 2014, 48(10): 1473-1478. ［7］GONZALES C, DUBUISSON S. Combinatorial re-sampling particle filter: An effective and efficient method for articulated object tracking［J］. International Journal of Computer Vision, 2015, 112(3): 255-284.. ［8］张铁, 马琼雄. 人机交互中的人体目标跟踪算法［J］. 上海交通大学学报, 2015, 49(8): 1213-1219. ZHANG Tie, MA Qiongxiong. Human object tracking algorithm for human-robot interaction［J］. Journal of Shanghai Jiao Tong University, 2015, 49(8): 1213-1219. ［9］ONGKITTIKUL S, WORRALL S, KONDOZ A. Two hand tracking using colour statistical model with the k-means embedded particle filter for hand gesture recognition［C］∥Proceedings of Computer Information Systems and Industrial Management Applications. IEEE Computer Society. Washington, DC, USA: IEEE Computer Society, 2008: 201-206. ［10］HESS R, FERN A. Discriminatively trained particle filters for complex multi-object tracking［C］∥IEEE Conference on Computer Vision & Pattern Recognition. Miami, Florida, USA: IEEE Computer Society, 2009: 240-247. ［11］TANG J. A multi-direction GVF Snake for the segmentation of skin cancer images［J］. Pattern Recognition, 2009, 42(6): 1172-1179. ［12］ZHAI P, SHI C. Normal and tangent components normalization based GVF Snake for image segmentation［C］∥International Conference on Digital Image Processing. Chengu, Chin: International Society for Optics and Photonics, 2016: 1003318-1003319. ［13］XU C, YEZZI A J, PRINCE J L. On the relationship between parametric and geometric active contours［C］∥Asilomar Conference on Signals, Systems and Computers. Pacific Grove, CA, USA: Circuits, Systems and Computers, 2000: 483-489. ［14］XIANG Y, CHUNG A C S, YE J. An active contour model for image segmentation based on elastic interaction［J］. Journal of Computational Physics, 2006, 219(1): 455-476. ［15］SMISTAD E, ELSTER A C, LINDSETH F. Real-time gradient vector flow on GPUs using OpenCL［J］. Journal of Real-Time Image Processing, 2015, 10(1): 67-74.

[1]	白雄飞, 龚水成, 李雪松, 许博, 杨晓力, 王明彦. 基于泊松融合数据增强的焊缝金相组织缺陷分类研究[J]. 上海交通大学学报, 2023, 57(10): 1316-1328.
[2]	王佳婧1，2，张树生1，何卫平1. 基于多信息融合的失效DPM码识别[J]. 上海交通大学学报（自然版）, 2014, 48(12): 1675-1680.
[3]	赵洪伟，谢永芳，曹斌芳，蒋朝辉. 基于Gabor小波和LPP的浮选过程泡沫纹理特征提取及应用[J]. 上海交通大学学报（自然版）, 2014, 48(07): 942-947.
[4]	王佳婧1,2，张树生1，何卫平1. 金属零件上二维条码高光区域的恢复[J]. 上海交通大学学报（自然版）, 2013, 47(12): 1836-1841.
[5]	王晓端1，刘书炘2，刘满华1. 基于模型分析的指纹奇异点检测[J]. 上海交通大学学报（自然版）, 2013, 47(08): 1222-1226.
[6]	李斌, 叶昊. 基于仿射几何不变量的鲁棒图像配准算法[J]. 上海交通大学学报（自然版）, 2012, 46(12): 1881-1884.
[7]	吴一全1, 2, 张晓杰1, 吴诗婳1, 张国华2, 张生伟2, 于素芬2. 二维直方图θ-划分最小误差图像阈值分割[J]. 上海交通大学学报（自然版）, 2012, 46(06): 892-899.
[8]	秦红星1, 杨杰2. 基于无网格局部彼得罗夫伽辽金方法的点采样曲面滤波[J]. 上海交通大学学报（自然版）, 2012, 46(04): 584-590.
[9]	秦红星，杨杰，郭律，唐炜. 基于图像处理器的EWA Splatting体绘制加速算法[J]. 上海交通大学学报（自然版）, 2008, 42(12): 1943-1946.
[10]	唐炜，姚莉秀，杨杰，秦红星. 基于矢量场自适应采样算法的图像体绘制技术[J]. 上海交通大学学报（自然版）, 2008, 42(10): 1650-1654.
[11]	苏赋. Curvelet感兴趣区域相关图的纹理图像检索[J]. 上海交通大学学报（自然版）, 2014, 48(05): 653-657.
[12]	李晓旭1，戴彬1，曹洁1,2. 基于多特征融合的改进UPF目标跟踪算法[J]. 上海交通大学学报（自然版）, 2014, 48(10): 1473-1478.
[13]	曹洁a,b，李玉琴a，吴迪b. 基于改进差分进化的高精度粒子滤波算法[J]. 上海交通大学学报（自然版）, 2014, 48(12): 1714-1720.
[14]	郭改放,何卫平,李夏霜,王健,吴振芳. 基于边缘和水平集的复杂背景金属零件二维条码精确定位方法[J]. 上海交通大学学报, 2017, 51(1): 90-.
[15]	薛梦霞,刘士荣,王坚. 基于机器视觉的动态多目标识别[J]. 上海交通大学学报, 2017, 51(6): 727-733.