Intelligent Video Surveillance for Checking Attendance of Traffic Controllers in Level Crossing

doi:10.1007/s12204-013-1464-4

Abstract

Abstract: This paper proposes a detecting and tracking scheme for automatic checking attendance of traffic controllers in level crossing by recognizing their warning waistcoats. Considering of the actual requirement of rapidity and validity, this paper employs techniques of motion detection, color segmentation and feature matching to deal with the challenging problems of illumination varying, light reflection and disturbance. Therefore, the task of distinguishing the target from candidates can be fulfilled accurately. Once a target being detected, the established color models are modified through learning color of the detected target, and then Cam-shift algorithm is employed to track this target smoothly. The experiments in real scenes demonstrate that this method has a great capability to detect and track traffic controllers in complex level crossing environment accurately, and the comparisons further demonstrate the validity of the proposed method.

Key words: traffic sign detection| color model| feature matching| tracking

摘要： This paper proposes a detecting and tracking scheme for automatic checking attendance of traffic controllers in level crossing by recognizing their warning waistcoats. Considering of the actual requirement of rapidity and validity, this paper employs techniques of motion detection, color segmentation and feature matching to deal with the challenging problems of illumination varying, light reflection and disturbance. Therefore, the task of distinguishing the target from candidates can be fulfilled accurately. Once a target being detected, the established color models are modified through learning color of the detected target, and then Cam-shift algorithm is employed to track this target smoothly. The experiments in real scenes demonstrate that this method has a great capability to detect and track traffic controllers in complex level crossing environment accurately, and the comparisons further demonstrate the validity of the proposed method.

关键词: traffic sign detection| color model| feature matching| tracking

CLC Number:

TP 391

XIANG Ke* (向可), WANG Xuan-yin (王宣银), CAO Song-xiao (曹晓松), FU Xiao-jie (富晓杰). Intelligent Video Surveillance for Checking Attendance of Traffic Controllers in Level Crossing[J]. Journal of shanghai Jiaotong University (Science), 2014, 19(1): 41-49.

References

[1] Velastin S A, Boghossian B A, Lo B P L, et al.PRISMATICA: Toward ambient intelligence in public transport environments [J]. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, 2005, 35(1): 164-182.
[2] Carincotte C, Desurmont X, Ravera B, et al.Toward generic intelligent knowledge extraction from video and audio: The EU-funded caretaker project[C]//The Institution of Engineering and Technology Conference on Crime and Security. London, UK:IEEE, 2006: 470-475.
[3] Guo F, Cai Z X, Tang J. Chinese traffic police gesture recognition in complex scene [C]//2011 International Joint Conference of IEEE TrustCom-11/IEEE ICESS-11/FCST-11. Changsha, China: IEEE Computer Society, 2011: 1505-1511.
[4] Alon J, Athitsos V, Yuan Q, et al. A unified framework for gesture recognition and spatiotemporal gesture segmentation [J]. IEEE Transaction on Pattern Analysis and Machine Intelligence, 2009, 31(9): 1685-1699.
[5] Poppe R. A survey on vision-based human action recognition [J]. Image and Vision Computing, 2010,28(6): 976-990.
[6] Ren F X, Huang J S, Jiang R Y. General traffic sign recognition by feature matching [C]//24th International Conference on Image and Vision Computing New Zealand. Wellington: IEEE, 2009: 409-414.
[7] Maldonado-Bascon S, Lafuente-Arroyo S, Gil-Jimenez P, et al. Road-sign detection and recognition based on support vector machines [J]. IEEE Transactions on Intelligent Transportation Systems, 2007,8(2): 264-278
[8] Kim E, Haseyama M, Kitajima H. Fast and robust ellipse extraction from complicated images [C]//Proceedings of the International Conference on Information Technology and Applications (ICITA).Bathurst, Australia: IEEE Computer Society, 2002:1-86467-114-9.
[9] Belaroussi R, Foucher P, Tarel J P, et al. Road sign detection in images: A case study [C]//2010 20th International Conference on Pattern Recognition(ICPR). Istanbul, Turkey: IEEE Computer Society,2010: 484-488.
[10] Zhang K, Sheng Y, Li J. Automatic detection of road traffic signs from natural scene images based on pixel vector and central projected shape feature [J].IET Intelligent Transport Systems, 2012, 6(3): 282-291.
[11] Ruta A, Li Y M, Liu X H. Real-time traffic sign recognition from video by class-specific discriminative features [J]. Pattern Recognition, 2010, 43(1): 416-430.
[12] Bahlmann C, Zhu Y, Ramesh V, et al. A system for traffic sign detection, tracking and recognition using color, shape, and motion information [C]//Proceedings of Intelligent Vehicles Symposium. Las Vegas, NV:IEEE, 2005: 255-260.
[13] Xiang K, Wang X Y, Cao S X, et al. A new approach for real-time segmenting moving objects under cluttered background [C]//2012 IEEE Symposium on Electrical and Electronics Engineering (EEESYM).Kuala Lump, Malaysia: IEEE, 2012: 224-227.
[14] Shadeed W G, Abu-Al-Nadi D I, Mismar M J. Road traffic sign detection in color images[C]//Proceedings of the 2003 10th IEEE International Conference on Electronics, Circuits and Systems(ICECS). Sharjah, United Arab Emirates: IEEE,2003: 890-893.

[1]	HUANG Yinggang1 (黄迎港), LUO Wenguang1∗ (罗文广), HUANG Dan2 (黄丹), LAN Hongli1 (蓝红莉). Cascade Optimization Control of Unmanned Vehicle Path Tracking under Harsh Driving Conditions [J]. J Shanghai Jiaotong Univ Sci, 2023, 28(1): 114-125.
[2]	XUE Weipeng (薛炜彭), WU Minghu (吴明虎), WANG Lin∗ (王琳). Spatial Temporal Correlation 3D Vehicle Detection and Tracking System with Multiple Surveillance Cameras [J]. J Shanghai Jiaotong Univ Sci, 2023, 28(1): 52-60.
[3]	YUAN Dongdong (袁冬冬), WANG Yankai∗ (王彦恺). Data Driven Model-Free Adaptive Control Method for Quadrotor Trajectory Tracking Based on Improved Sliding Mode Algorithm [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(6): 790-798.
[4]	GUO Tao, LIU Mingming, CAO Lei, HU Jingzhao, HONG Guojun, YOU Yunxiang. A Numerical Method for Transient Tracking of Sediment Particles in Dredge Pump [J]. Journal of Shanghai Jiao Tong University, 2022, 56(5): 656-663.
[5]	HUANG He, WU Kun, LI Xinrui, WANG Jun, WANG Huifeng, RU Feng. A Multi-Feature Particle Filter Vehicle Tracking Algorithm Based on Adaptive Interpolation Moth-Flame Optimization [J]. Journal of Shanghai Jiao Tong University, 2022, 56(2): 143-155.
[6]	LING Hui, DU Qinjun, FENG Han, PANG Hao, YANG Shuxin, LUO Yonggang. Torque Ripple Reduction Method of Switched Reluctance Motor Based on Five-Level Converter [J]. Journal of Shanghai Jiao Tong University, 2022, 56(12): 1608-1618.
[7]	HE Zishu, SU Yang, CHENG Ting. Opportunistic Cooperative Target Tracking Algorithm Based on the Co-located MIMO Radar Networking System [J]. Air & Space Defense, 2022, 5(1): 6-11.
[8]	CHEN Jiacheng (陈佳诚), LI Lin(李霖), YANG Xubo (杨旭波). Eﬃcient Online Vehicle Tracking for Real–Virtual Mapping Systems [J]. J Shanghai Jiaotong Univ Sci, 2021, 26(5): 598-606.
[9]	WANG Muyuan∗ (王木塬), WU Xiaodong (吴晓东). Multi-Object Tracking Strategy of Autonomous Vehicle Using Modiﬁed Unscented Kalman Filter and Reference Point Switching [J]. J Shanghai Jiaotong Univ Sci, 2021, 26(5): 607-614.
[10]	ZHANG Lulu (章露露), DONG Xiangxiang (董祥祥), YAO Lixiu (姚莉秀), CAI Yunze (蔡云泽). Velocity-Varying Target Tracking of Mobile Sensor Network Based on Flocking Control [J]. J Shanghai Jiaotong Univ Sci, 2021, 26(4): 446-453.
[11]	LI Qingbo, FANG Zeyuan, CHEN Guoliang, MEI Zhiwei, YANG Ting. Research on Decoupling Algorithm of Strapdown Seeker Based on Tracking Differentiator [J]. Air & Space Defense, 2021, 4(4): 44-49.
[12]	LIU Xiaoyang, XU Weili, CHEN Jiming, XU Peiran, ZHOU Xiangxiang. A Self-Adaptive Modified Angle Filtering Algorithm Based on Passive Tracking Environment [J]. Air & Space Defense, 2021, 4(2): 48-.
[13]	HOU Yuguan, HAN Yuanpeng, XIE Jinyue, MAO Xingpeng. A Radar DOA Tracking Method for Multiple Targets Based on SDE Model [J]. Air & Space Defense, 2021, 4(1): 41-46.
[14]	ZHOU Zhipeng, YIN Dong, DING Jinwen, LUO Yuhao, YUAN Mingyue, ZHU Chengfeng. Collaborative Tracking Method in Multi-Camera System [J]. J Shanghai Jiaotong Univ Sci, 2020, 25(6): 802-810.
[15]	ZHANG Jianjun, WU Zhonghua, LIU Qunpo, WANG Hongqi, LIU Weidong. Bilateral Adaptive Impedance Control Scheme in Master-Slave Manipulator Teleoperation System [J]. Journal of Shanghai Jiaotong University, 2020, 54(6): 615-623.