Intelligent Video Surveillance for Checking Attendance of Traffic Controllers in Level Crossing

doi:10.1007/s12204-013-1464-4

Abstract

Abstract: This paper proposes a detecting and tracking scheme for automatic checking attendance of traffic controllers in level crossing by recognizing their warning waistcoats. Considering of the actual requirement of rapidity and validity, this paper employs techniques of motion detection, color segmentation and feature matching to deal with the challenging problems of illumination varying, light reflection and disturbance. Therefore, the task of distinguishing the target from candidates can be fulfilled accurately. Once a target being detected, the established color models are modified through learning color of the detected target, and then Cam-shift algorithm is employed to track this target smoothly. The experiments in real scenes demonstrate that this method has a great capability to detect and track traffic controllers in complex level crossing environment accurately, and the comparisons further demonstrate the validity of the proposed method.

Key words: traffic sign detection| color model| feature matching| tracking

摘要： This paper proposes a detecting and tracking scheme for automatic checking attendance of traffic controllers in level crossing by recognizing their warning waistcoats. Considering of the actual requirement of rapidity and validity, this paper employs techniques of motion detection, color segmentation and feature matching to deal with the challenging problems of illumination varying, light reflection and disturbance. Therefore, the task of distinguishing the target from candidates can be fulfilled accurately. Once a target being detected, the established color models are modified through learning color of the detected target, and then Cam-shift algorithm is employed to track this target smoothly. The experiments in real scenes demonstrate that this method has a great capability to detect and track traffic controllers in complex level crossing environment accurately, and the comparisons further demonstrate the validity of the proposed method.

关键词: traffic sign detection| color model| feature matching| tracking

CLC Number:

TP 391

XIANG Ke* (向可), WANG Xuan-yin (王宣银), CAO Song-xiao (曹晓松), FU Xiao-jie (富晓杰). Intelligent Video Surveillance for Checking Attendance of Traffic Controllers in Level Crossing[J]. Journal of shanghai Jiaotong University (Science), 2014, 19(1): 41-49.

References

[1] Velastin S A, Boghossian B A, Lo B P L, et al.PRISMATICA: Toward ambient intelligence in public transport environments [J]. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, 2005, 35(1): 164-182.
[2] Carincotte C, Desurmont X, Ravera B, et al.Toward generic intelligent knowledge extraction from video and audio: The EU-funded caretaker project[C]//The Institution of Engineering and Technology Conference on Crime and Security. London, UK:IEEE, 2006: 470-475.
[3] Guo F, Cai Z X, Tang J. Chinese traffic police gesture recognition in complex scene [C]//2011 International Joint Conference of IEEE TrustCom-11/IEEE ICESS-11/FCST-11. Changsha, China: IEEE Computer Society, 2011: 1505-1511.
[4] Alon J, Athitsos V, Yuan Q, et al. A unified framework for gesture recognition and spatiotemporal gesture segmentation [J]. IEEE Transaction on Pattern Analysis and Machine Intelligence, 2009, 31(9): 1685-1699.
[5] Poppe R. A survey on vision-based human action recognition [J]. Image and Vision Computing, 2010,28(6): 976-990.
[6] Ren F X, Huang J S, Jiang R Y. General traffic sign recognition by feature matching [C]//24th International Conference on Image and Vision Computing New Zealand. Wellington: IEEE, 2009: 409-414.
[7] Maldonado-Bascon S, Lafuente-Arroyo S, Gil-Jimenez P, et al. Road-sign detection and recognition based on support vector machines [J]. IEEE Transactions on Intelligent Transportation Systems, 2007,8(2): 264-278
[8] Kim E, Haseyama M, Kitajima H. Fast and robust ellipse extraction from complicated images [C]//Proceedings of the International Conference on Information Technology and Applications (ICITA).Bathurst, Australia: IEEE Computer Society, 2002:1-86467-114-9.
[9] Belaroussi R, Foucher P, Tarel J P, et al. Road sign detection in images: A case study [C]//2010 20th International Conference on Pattern Recognition(ICPR). Istanbul, Turkey: IEEE Computer Society,2010: 484-488.
[10] Zhang K, Sheng Y, Li J. Automatic detection of road traffic signs from natural scene images based on pixel vector and central projected shape feature [J].IET Intelligent Transport Systems, 2012, 6(3): 282-291.
[11] Ruta A, Li Y M, Liu X H. Real-time traffic sign recognition from video by class-specific discriminative features [J]. Pattern Recognition, 2010, 43(1): 416-430.
[12] Bahlmann C, Zhu Y, Ramesh V, et al. A system for traffic sign detection, tracking and recognition using color, shape, and motion information [C]//Proceedings of Intelligent Vehicles Symposium. Las Vegas, NV:IEEE, 2005: 255-260.
[13] Xiang K, Wang X Y, Cao S X, et al. A new approach for real-time segmenting moving objects under cluttered background [C]//2012 IEEE Symposium on Electrical and Electronics Engineering (EEESYM).Kuala Lump, Malaysia: IEEE, 2012: 224-227.
[14] Shadeed W G, Abu-Al-Nadi D I, Mismar M J. Road traffic sign detection in color images[C]//Proceedings of the 2003 10th IEEE International Conference on Electronics, Circuits and Systems(ICECS). Sharjah, United Arab Emirates: IEEE,2003: 890-893.

[1]	HE Qinglin, ZHAO Hongyu, CHEN Yuxuan, HOU Xianghao. Design of Distributed Underwater Acoustic Tracking Algorithm for Aerial Targets Based on CRLB [J]. Air & Space Defense, 2025, 8(1): 86-94.
[2]	LI Keyong, LI Chuchen, CAI Yunze. Key Technologies for Collaborative Situational Awareness Based on Swarm-to-Swarm Interception [J]. Air & Space Defense, 2025, 8(1): 1-9.
[3]	TANG Jianguo1, 2, MAO Jinghang1, 2, LIU Mingyue1, 2. Design and Hierarchical Sliding Mode Path Tracking of Deep-Sea Lander with Rudder [J]. Ocean Engineering Equipment and Technology, 2025, 12(1): 106-118.
[4]	LIU Yuesheng (刘月笙), HE Ning^∗(贺宁), HE Lile (贺利乐), ZHANG Yiwen (张译文), XI Kun (习坤), ZHANG Mengrui (张梦芮). Self-Tuning of MPC Controller for Mobile Robot Path Tracking Based on Machine Learning [J]. J Shanghai Jiaotong Univ Sci, 2024, 29(6): 1028-1036.
[5]	YONG Jiuqin1, 2, XUE Zhentao1, 2, CHEN Li1, 2. Influence of Sea Condition on Tracking Accuracy and Control Energy Consumption of Unmanned Surface Vessels under Straight Line Navigation [J]. Ocean Engineering Equipment and Technology, 2024, 11(4): 103-109.
[6]	HAO Liang, HUANG Yinghao, YAO Lixiu, CAI Yunze. An Adaptive Maneuvering Target Tracking Algorithm Based on Fuzzy Inference [J]. Journal of Shanghai Jiao Tong University, 2024, 58(4): 468-480.
[7]	WU Xiaojing^∗(武晓晶), CAO Tongyao (曹童瑶), ZHEN Ran (甄然), LI Zhijie (李志杰). AlgoTime-Varying Formation-Containment Tracking Control for Unmanned Aerial Vehicle Swarm Systems with Switching Topologies and a Non-Cooperative Target [J]. J Shanghai Jiaotong Univ Sci, 2024, 29(4): 689-701.
[8]	TANG Shengjing, WANG Taiyan, ZHAO Ganglian, GUO Jie, LI Jiali, YIN Hang（. Review of Multi-Sensor Data Fusion for Target Tracking [J]. Air & Space Defense, 2024, 7(4): 18-29.
[9]	CHEN Kun(陈坤), ZHAO Xu(赵旭), DONG Chunyu(董春玉), DI Zichao(邸子超), CHEN Zongzhi(陈宗枝). Anti-Occlusion Object Tracking Algorithm Based on Filter Prediction [J]. J Shanghai Jiaotong Univ Sci, 2024, 29(3): 400-413.
[10]	LIU Zengmin (刘增敏), WANG Shentao(王申涛), YAO Lixiu(姚莉秀), CAI Yunze(蔡云泽). Online Multi-Object Tracking Under Moving Unmanned Aerial Vehicle Platform Based on Object Detection and Feature Extraction Network [J]. J Shanghai Jiaotong Univ Sci, 2024, 29(3): 388-399.
[11]	LIU Chuanbin, JIAO Wenshu, WU Qiuwei, CHEN Jian, ZHOU Qian. Strategy of Wind-Storage Combined System Participating in Power System Secondary Frequency Regulation Based on Model Predictive Control [J]. Journal of Shanghai Jiao Tong University, 2024, 58(1): 91-101.
[12]	LUO Tong, ZHANG Min, LIANG Chengyu. Multi-UAV Cooperative Target Tracking and Guidance Law Design [J]. Air & Space Defense, 2023, 6(3): 113-118.
[13]	ZHANG Kaibo1(张凯波)，CHEN Li1*(陈丽)，DONG Qi2(董琦). Input-Constrained Hybrid Control of a Hyper-Redundant Mobile Medical Manipulator [J]. J Shanghai Jiaotong Univ Sci, 2023, 28(3): 348-359.
[14]	XUE Weipeng (薛炜彭), WU Minghu (吴明虎), WANG Lin∗ (王琳). Spatial Temporal Correlation 3D Vehicle Detection and Tracking System with Multiple Surveillance Cameras [J]. J Shanghai Jiaotong Univ Sci, 2023, 28(1): 52-60.
[15]	HUANG Yinggang1 (黄迎港), LUO Wenguang1∗ (罗文广), HUANG Dan2 (黄丹), LAN Hongli1 (蓝红莉). Cascade Optimization Control of Unmanned Vehicle Path Tracking under Harsh Driving Conditions [J]. J Shanghai Jiaotong Univ Sci, 2023, 28(1): 114-125.