Intelligent Video Surveillance for Checking Attendance of Traffic Controllers in Level Crossing

doi:10.1007/s12204-013-1464-4

Abstract

Abstract: This paper proposes a detecting and tracking scheme for automatic checking attendance of traffic controllers in level crossing by recognizing their warning waistcoats. Considering of the actual requirement of rapidity and validity, this paper employs techniques of motion detection, color segmentation and feature matching to deal with the challenging problems of illumination varying, light reflection and disturbance. Therefore, the task of distinguishing the target from candidates can be fulfilled accurately. Once a target being detected, the established color models are modified through learning color of the detected target, and then Cam-shift algorithm is employed to track this target smoothly. The experiments in real scenes demonstrate that this method has a great capability to detect and track traffic controllers in complex level crossing environment accurately, and the comparisons further demonstrate the validity of the proposed method.

Key words: traffic sign detection| color model| feature matching| tracking

摘要： This paper proposes a detecting and tracking scheme for automatic checking attendance of traffic controllers in level crossing by recognizing their warning waistcoats. Considering of the actual requirement of rapidity and validity, this paper employs techniques of motion detection, color segmentation and feature matching to deal with the challenging problems of illumination varying, light reflection and disturbance. Therefore, the task of distinguishing the target from candidates can be fulfilled accurately. Once a target being detected, the established color models are modified through learning color of the detected target, and then Cam-shift algorithm is employed to track this target smoothly. The experiments in real scenes demonstrate that this method has a great capability to detect and track traffic controllers in complex level crossing environment accurately, and the comparisons further demonstrate the validity of the proposed method.

关键词: traffic sign detection| color model| feature matching| tracking

CLC Number:

TP 391

XIANG Ke* (向可), WANG Xuan-yin (王宣银), CAO Song-xiao (曹晓松), FU Xiao-jie (富晓杰). Intelligent Video Surveillance for Checking Attendance of Traffic Controllers in Level Crossing[J]. Journal of shanghai Jiaotong University (Science), 2014, 19(1): 41-49.

References

[1] Velastin S A, Boghossian B A, Lo B P L, et al.PRISMATICA: Toward ambient intelligence in public transport environments [J]. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, 2005, 35(1): 164-182.
[2] Carincotte C, Desurmont X, Ravera B, et al.Toward generic intelligent knowledge extraction from video and audio: The EU-funded caretaker project[C]//The Institution of Engineering and Technology Conference on Crime and Security. London, UK:IEEE, 2006: 470-475.
[3] Guo F, Cai Z X, Tang J. Chinese traffic police gesture recognition in complex scene [C]//2011 International Joint Conference of IEEE TrustCom-11/IEEE ICESS-11/FCST-11. Changsha, China: IEEE Computer Society, 2011: 1505-1511.
[4] Alon J, Athitsos V, Yuan Q, et al. A unified framework for gesture recognition and spatiotemporal gesture segmentation [J]. IEEE Transaction on Pattern Analysis and Machine Intelligence, 2009, 31(9): 1685-1699.
[5] Poppe R. A survey on vision-based human action recognition [J]. Image and Vision Computing, 2010,28(6): 976-990.
[6] Ren F X, Huang J S, Jiang R Y. General traffic sign recognition by feature matching [C]//24th International Conference on Image and Vision Computing New Zealand. Wellington: IEEE, 2009: 409-414.
[7] Maldonado-Bascon S, Lafuente-Arroyo S, Gil-Jimenez P, et al. Road-sign detection and recognition based on support vector machines [J]. IEEE Transactions on Intelligent Transportation Systems, 2007,8(2): 264-278
[8] Kim E, Haseyama M, Kitajima H. Fast and robust ellipse extraction from complicated images [C]//Proceedings of the International Conference on Information Technology and Applications (ICITA).Bathurst, Australia: IEEE Computer Society, 2002:1-86467-114-9.
[9] Belaroussi R, Foucher P, Tarel J P, et al. Road sign detection in images: A case study [C]//2010 20th International Conference on Pattern Recognition(ICPR). Istanbul, Turkey: IEEE Computer Society,2010: 484-488.
[10] Zhang K, Sheng Y, Li J. Automatic detection of road traffic signs from natural scene images based on pixel vector and central projected shape feature [J].IET Intelligent Transport Systems, 2012, 6(3): 282-291.
[11] Ruta A, Li Y M, Liu X H. Real-time traffic sign recognition from video by class-specific discriminative features [J]. Pattern Recognition, 2010, 43(1): 416-430.
[12] Bahlmann C, Zhu Y, Ramesh V, et al. A system for traffic sign detection, tracking and recognition using color, shape, and motion information [C]//Proceedings of Intelligent Vehicles Symposium. Las Vegas, NV:IEEE, 2005: 255-260.
[13] Xiang K, Wang X Y, Cao S X, et al. A new approach for real-time segmenting moving objects under cluttered background [C]//2012 IEEE Symposium on Electrical and Electronics Engineering (EEESYM).Kuala Lump, Malaysia: IEEE, 2012: 224-227.
[14] Shadeed W G, Abu-Al-Nadi D I, Mismar M J. Road traffic sign detection in color images[C]//Proceedings of the 2003 10th IEEE International Conference on Electronics, Circuits and Systems(ICECS). Sharjah, United Arab Emirates: IEEE,2003: 890-893.

[1]	LI Shijie, LIU Taixu, LIU Jialun, DONG Zhilin, XU Chengqi. Trajectory Tracking Control of Azimuth Stern Drive Tugs Based on GRU-MPC [J]. Journal of Shanghai Jiao Tong University, 2026, 60(3): 418-426.
[2]	ZHANG Kunfeng, XU Xiao, SUN Zhuoran, XU Zhizhao, NIU Yalei. Design of Real-Time Simulation System for Target Detection and Tracking Devices Based on Digital-Physical Integration [J]. Air & Space Defense, 2026, 9(2): 60-67.
[3]	LI Xuan, XIE Kaigui, SHAO Changzheng, HU Bo. Power System Expansion Planning Model and Solution Algorithm Based on Load Feasible Region and Reliability Tracking [J]. Journal of Shanghai Jiao Tong University, 2026, 60(2): 200-210.
[4]	SONG Zihao, WEI Handi, XIAO Longfei, et al. Straight-Line Trajectory Tracking Control of Surface-Towed Vehicles under Complex Disturbances [J]. Ocean Engineering Equipment and Technology, 2026, 13(1): 34-45.
[5]	YANG Minghui, WEI Yali, LU Junyan, LI Xinhai. A Cross-Modal Target Matching Method for Optical Image and SAR Images Based on Window Attention Mechanism [J]. Air & Space Defense, 2026, 9(1): 73-79.
[6]	CHE Zhiyuan, YU Haitao, PANG Yuyi, ZHANG Jiahui. Tracking Differentiator-Based Dual-Time-Scale Sliding Mode Control for Permanent Magnet Synchronous Motor [J]. Journal of Shanghai Jiao Tong University, 2025, 59(9): 1249-1259.
[7]	ZHOU Xia, CHEN Wenjian, DAI Jianfeng, XIE Xiangpeng. Black-Start Coordinated Control Strategy of Optical Storage Microgrid Considering State of Charge Balance of Distributed Energy Storage [J]. Journal of Shanghai Jiao Tong University, 2025, 59(7): 938-951.
[8]	BANKOLE Adesola Temitope, IGBONOBA Ezekiel Endurance Chukwuemeke. Simulation-Based Novel Hybrid Proportional Derivative/H-Infinity Controller Design for Improved Trajectory Tracking of a Two-Link Robot Arm [J]. J Shanghai Jiaotong Univ Sci, 2025, 30(6): 1179-1187.
[9]	Tian Siyu, Gao Jinyang, Huang Peng, Ma Xinyu, Ma Ziyu. Magnetic Tracking System with Capability of Automatic Magnetic Moment Measurement [J]. J Shanghai Jiaotong Univ Sci, 2025, 30(4): 646-657.
[10]	HE Qinglin, ZHAO Hongyu, CHEN Yuxuan, HOU Xianghao. Design of Distributed Underwater Acoustic Tracking Algorithm for Aerial Targets Based on CRLB [J]. Air & Space Defense, 2025, 8(1): 86-94.
[11]	LI Keyong, LI Chuchen, CAI Yunze. Key Technologies for Collaborative Situational Awareness Based on Swarm-to-Swarm Interception [J]. Air & Space Defense, 2025, 8(1): 1-9.
[12]	TANG Jianguo1, 2, MAO Jinghang1, 2, LIU Mingyue1, 2. Design and Hierarchical Sliding Mode Path Tracking of Deep-Sea Lander with Rudder [J]. Ocean Engineering Equipment and Technology, 2025, 12(1): 106-118.
[13]	LIU Yuesheng (刘月笙), HE Ning^∗(贺宁), HE Lile (贺利乐), ZHANG Yiwen (张译文), XI Kun (习坤), ZHANG Mengrui (张梦芮). Self-Tuning of MPC Controller for Mobile Robot Path Tracking Based on Machine Learning [J]. J Shanghai Jiaotong Univ Sci, 2024, 29(6): 1028-1036.
[14]	TANG Shengjing, WANG Taiyan, ZHAO Ganglian, GUO Jie, LI Jiali, YIN Hang（. Review of Multi-Sensor Data Fusion for Target Tracking [J]. Air & Space Defense, 2024, 7(4): 18-29.
[15]	HAO Liang, HUANG Yinghao, YAO Lixiu, CAI Yunze. An Adaptive Maneuvering Target Tracking Algorithm Based on Fuzzy Inference [J]. Journal of Shanghai Jiao Tong University, 2024, 58(4): 468-480.