Human Tracking Based on MultiFeature for Intelligent Robot Under the CTF Locating Strategy

Abstract

Abstract:

To realize a human tracking task in a cluttered environment, a method of multifeature based human tracking under the CTF(coarsetofine) locating strategy was proposed. The proposed method located the target from a RFID system coarsely. Then, the silhouette of the headshoulder, the cloth color and motion feature were extracted to locate the target accurately by using the processing techniques including adaptive template matching algorithm, improved Camshift and Extended Kalman Filter. At last, an intelligent gear shift controller based on fuzzy rules considering the motion state of the target and the robot was utilized to drive the robot. The experimental results show that the presented method can keep the robot in a suitable distance from the target and handle the problem of occlusion, a sudden turn, and complicated background.

Key words：

Key words: intelligent robot, target tracking, coarse-to-fine (CTF) locating strategy, multifeature

CLC Number:

TP 391.4

JIA Songmin1,WANG Shuang1,WANG Lijia1,2,LI Xiuzhi1. Human Tracking Based on MultiFeature for Intelligent Robot Under the CTF Locating Strategy[J]. Journal of Shanghai Jiaotong University, 2014, 48(07): 1039-1045.

References

［1］Yin Shimin, Na JinHee, Choi JinYoung. Hierarchical Kalmanparticle filter with adaptation to motion changes for object tracking［J］. Computer Vision and Image Understanding, 2011, 115(6): 885900.

［2］牛长峰, 刘玉树. 融合多特征的粒子滤波目标跟踪算法［J］. 华中科技大学学报:自然科学版, 2010, 38(1): 1821.

NIU Changfeng, LIU Yushu. Particle filter targets tracking by fusing multiple features［J］. Journal of Huazhong University of Science & Technology: Natural Science Edition, 2010, 38(1): 1821.

［3］Amir Hooshang Mazinan, Arash AmirLatifi. Applying mean shift, motion information and Kalman filtering approaches to object tracking［J］. ISA Transactions, 2012, 51: 485497.

［4］刘士荣孙凯, 张波涛, 等. 基于改进Camshift算法的移动机器人运动目标跟踪［J］. 华中科技大学学报：自然科学版, 2011, 39(增刊Ⅱ): 223226.

LIU Shirong, SUN Kai, ZHANG Botao，et al. Mobile robot moving object tracking based on modified Camshift algorithm［J］. Journal of Huazhong University of Science & Technology: Natural Science Edition, 2011, 39(Ⅱ): 223226.

［5］Germa T, Lerasle F. Videobased face recognition and tracking from a robot companion［J］. International Journal of Pattern Recognition and Artificial Intelligence, 2009, 23(3): 591616.

［6］戴渊明, 韦巍, 林亦宁. 基于颜色纹理特征的均值漂移目标跟踪算法［J］. 浙江大学学报:工学版, 2012, 46(2): 212217.

DAI Yuanming, WEI Wei, LIN Yining. An improved meanshift tracking algorithm based on color and texture feature［J］. Journal of Zhejiang University: Engineering Science, 2012, 46(2): 212217.

［7］李冠彬, 吴贺丰. 基于颜色纹理直方图的带权分块均值漂移目标跟踪算法［J］. 计算机辅助设计与图形学学报, 2011, 23(12): 26.

LI Guanbin, WU Hefeng. Weighted fragmentsbased meanshift tracking using colortexture histogram［J］. Journal of ComputerAided Design & Computer Graphics, 2011, 23(12): 20592066.

［8］刘婕, 张金艺, 查肇祥, 等. 重叠年轮式无源射频识别定位算法设计［J］. 上海交通大学学报, 2012, 46(11): 18161820.

LIU Jie, ZHANG Jinyi, ZHA Zhaoxiang, et al. Overlapped growth ring passive radio frequency identification positioning algorithm［J］. Journal of Shanghai Jiaotong University, 2012, 46(11): 18161820.

［9］林振华, 王营冠, 夏凌楠, 等. 错误测量下节点选择策略对跟踪精度的影响［J］. 华中科技大学学报：自然科学版, 2012, 40(8): 118122.

LIN Zhenhua, WANG Yingguan, XIA Lingnan, et al. Influence on tracking accuracy of nodes selection strategy with erratic measurement［J］. Journal of Huazhong University of Science & Technology: Natural Science Edition, 2012, 40(8): 118122.

［10］Sanpechuda T, Kovavisaruch L. A review of RFID localization: Applications and techniques［C］∥ Int Conf Electr Eng/Electron, Comput, Telecommun Inf Technol. 5th IEEE IntConf Electrical Engineering\\Electronics, Computer, Telecommunications and Information Technology. 445 Hoes Lane – P O Box 1331, Piscataway, NJ 088551331, United States: Inst of Elec and Elec Eng Computer Society, 2008: 769772.

［11］Parveen Flora, Briens Cedric, Berruti, et al. Effect of particle size, liquid content and location on the stability of agglomerates in a fluidized bed［J］. Powder Technology, 2013, 237: 276385.

［12］王景川, 方毅, 陈卫东. 移动机器人定位的自适应功率调节射频识别系统［J］. 上海交通大学学报, 2012, 46(2): 207212.

WANG Jingchuan, FANG Yi, CHEN Weidong. Mobile robot selflocalization based on RFID system with adaptive power control［J］. Journal of Shanghai Jiaotong University, 2012, 46(2): 207212.

［13］Ouadah N, Cadenat V, Lerasle F, et al. Multisensorbased control strategy for initiating and maintaining interaction between a robot and a human［J］. Advanced Robotics, 2011, 25(910): 12491270.

［14］胡春华, 马旭东, 戴先中. 一种基于行为的移动机器人目标人跟踪控制方法［J］. 控制工程, 2011, 18(2): 318321.

HU Chunhua, MA Xudong, DAI Xianzhong. A robust person following control method for behaviorbased mobile robot［J］. Control Engineering of China, 2011, 18(2): 318321.

［15］Satake J, Iura J. Stereobased multiperson tracking using overlapping silhouette templates［C］// ProceedingsInternational Conference on Pattern Recognition. 20th International Conference on Pattern Recognition，ICPR 2010. Piscataway, NJ 088551331, United States: Institute of Electrical and Electronics Engineers Inc, 2010: 43044307.

［16］Jia S M, Sheng J B, Shang E Z, et al. Robot localization in indoor environments using radio frequency identification technology and stereo vision［J］. Advanced Robotics, 2008, 22: 279297.

［17］Jia S M, Wang S H, Wang L J, et al. Robust human detecting and tracking using varying scale template matching［C］∥ IEEE Int Conf Inf Autom, ICIA. 2012 International Conference on Information and Automation. 2001 L Street N W, Suite 700, Washington, DC 200364928, United States: IEEE Computer Society, 2012: 2530.

［18］郭伟斌, 陈勇. 基于模糊控制的除草机器人自主导航［J］. 机器人, 2010, 32(2): 204209.

GUO Weibing, CHEN Yong. Fuzzy control based autonomous navigation for a weeding robot［J］. Robot, 2010, 32(2): 204209.

[1]	HE Qinglin, ZHAO Hongyu, CHEN Yuxuan, HOU Xianghao. Design of Distributed Underwater Acoustic Tracking Algorithm for Aerial Targets Based on CRLB [J]. Air & Space Defense, 2025, 8(1): 86-94.
[2]	LI Keyong, LI Chuchen, CAI Yunze. Key Technologies for Collaborative Situational Awareness Based on Swarm-to-Swarm Interception [J]. Air & Space Defense, 2025, 8(1): 1-9.
[3]	TANG Shengjing, WANG Taiyan, ZHAO Ganglian, GUO Jie, LI Jiali, YIN Hang（. Review of Multi-Sensor Data Fusion for Target Tracking [J]. Air & Space Defense, 2024, 7(4): 18-29.
[4]	HAO Liang, HUANG Yinghao, YAO Lixiu, CAI Yunze. An Adaptive Maneuvering Target Tracking Algorithm Based on Fuzzy Inference [J]. Journal of Shanghai Jiao Tong University, 2024, 58(4): 468-480.
[5]	HE Zishu, SU Yang, CHENG Ting. Opportunistic Cooperative Target Tracking Algorithm Based on the Co-located MIMO Radar Networking System [J]. Air & Space Defense, 2022, 5(1): 6-11.
[6]	ZHANG Lulu (章露露), DONG Xiangxiang (董祥祥), YAO Lixiu (姚莉秀), CAI Yunze (蔡云泽). Velocity-Varying Target Tracking of Mobile Sensor Network Based on Flocking Control [J]. J Shanghai Jiaotong Univ Sci, 2021, 26(4): 446-453.
[7]	CHEN Xiao，LI Ya’an，LI Yuxing，YU Jing. Maneuvering Target Tracking Algorithm Based on Weighted Distance of Probability Data Association [J]. Journal of Shanghai Jiao Tong University, 2018, 52(4): 474-479.
[8]	LI Tantan,LEI Ming. Heuristic Algorithm-Based Initiation Method of Probability Hypothesis Density Filter for Target Tracking [J]. Journal of Shanghai Jiao Tong University, 2018, 52(1): 63-69.
[9]	DAI Lizhen. Research of an Intrinsic Motivation Based on the Tropism [J]. Journal of Shanghai Jiao Tong University, 2017, 51(7): 892-896.
[10]	LI Jiaqiang1a,2,ZHAO Chunyan1b,2,CHEN Jinli1a,1b,ZHAO Ronghua1b,2. A Modified Generalized Least Square Registration Algorithm on WGS-84 Coordinate [J]. Journal of Shanghai Jiaotong University, 2016, 50(05): 771-775.
[11]	ZHANG Tie，MA Qiongxiong. Human Object Tracking Algorithm for Human-Robot Interaction [J]. Journal of Shanghai Jiaotong University, 2015, 49(08): 1213-1219.
[12]	HOU Jing* (侯静), JING Zhan-rong (景占荣), YANG Yan (羊彦). Target Tracking in Standoff Jammer Using Unscented Kalman Filter and Particle Fiter with Negative Information [J]. Journal of shanghai Jiaotong University (Science), 2014, 19(2): 181-189.
[13]	LIU Shirong1,2，WU Chu1,3,ZHANG Botao1,2,ZHANG Haibing1,2. A Tracking Algorithm Based on SIFT Feature and Particle Filter with Epipolar Constraint [J]. Journal of Shanghai Jiaotong University, 2014, 48(07): 1026-1032.
[14]	MA Shan,ZHANG Tiedong,PANG Yongjie,WAN Lei. Acoustic Images Multi-Target Tracking Method Based on Modified Particle Filter [J]. Journal of Shanghai Jiaotong University, 2013, 47(12): 1848-1855.