Intelligent Video Surveillance for Checking Attendance of Traffic Controllers in Level Crossing

doi:10.1007/s12204-013-1464-4

摘要/Abstract

摘要： This paper proposes a detecting and tracking scheme for automatic checking attendance of traffic controllers in level crossing by recognizing their warning waistcoats. Considering of the actual requirement of rapidity and validity, this paper employs techniques of motion detection, color segmentation and feature matching to deal with the challenging problems of illumination varying, light reflection and disturbance. Therefore, the task of distinguishing the target from candidates can be fulfilled accurately. Once a target being detected, the established color models are modified through learning color of the detected target, and then Cam-shift algorithm is employed to track this target smoothly. The experiments in real scenes demonstrate that this method has a great capability to detect and track traffic controllers in complex level crossing environment accurately, and the comparisons further demonstrate the validity of the proposed method.

关键词: traffic sign detection, color model, feature matching, tracking

Abstract: This paper proposes a detecting and tracking scheme for automatic checking attendance of traffic controllers in level crossing by recognizing their warning waistcoats. Considering of the actual requirement of rapidity and validity, this paper employs techniques of motion detection, color segmentation and feature matching to deal with the challenging problems of illumination varying, light reflection and disturbance. Therefore, the task of distinguishing the target from candidates can be fulfilled accurately. Once a target being detected, the established color models are modified through learning color of the detected target, and then Cam-shift algorithm is employed to track this target smoothly. The experiments in real scenes demonstrate that this method has a great capability to detect and track traffic controllers in complex level crossing environment accurately, and the comparisons further demonstrate the validity of the proposed method.

Key words: traffic sign detection, color model, feature matching, tracking

中图分类号:

TP 391

XIANG Ke* (向可), WANG Xuan-yin (王宣银), CAO Song-xiao (曹晓松), FU Xiao-jie (富晓杰). Intelligent Video Surveillance for Checking Attendance of Traffic Controllers in Level Crossing[J]. 上海交通大学学报（英文版）, 2014, 19(1): 41-49.

XIANG Ke* (向可), WANG Xuan-yin (王宣银), CAO Song-xiao (曹晓松), FU Xiao-jie (富晓杰). Intelligent Video Surveillance for Checking Attendance of Traffic Controllers in Level Crossing[J]. Journal of shanghai Jiaotong University (Science), 2014, 19(1): 41-49.

参考文献

[1] Velastin S A, Boghossian B A, Lo B P L, et al.PRISMATICA: Toward ambient intelligence in public transport environments [J]. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, 2005, 35(1): 164-182.
[2] Carincotte C, Desurmont X, Ravera B, et al.Toward generic intelligent knowledge extraction from video and audio: The EU-funded caretaker project[C]//The Institution of Engineering and Technology Conference on Crime and Security. London, UK:IEEE, 2006: 470-475.
[3] Guo F, Cai Z X, Tang J. Chinese traffic police gesture recognition in complex scene [C]//2011 International Joint Conference of IEEE TrustCom-11/IEEE ICESS-11/FCST-11. Changsha, China: IEEE Computer Society, 2011: 1505-1511.
[4] Alon J, Athitsos V, Yuan Q, et al. A unified framework for gesture recognition and spatiotemporal gesture segmentation [J]. IEEE Transaction on Pattern Analysis and Machine Intelligence, 2009, 31(9): 1685-1699.
[5] Poppe R. A survey on vision-based human action recognition [J]. Image and Vision Computing, 2010,28(6): 976-990.
[6] Ren F X, Huang J S, Jiang R Y. General traffic sign recognition by feature matching [C]//24th International Conference on Image and Vision Computing New Zealand. Wellington: IEEE, 2009: 409-414.
[7] Maldonado-Bascon S, Lafuente-Arroyo S, Gil-Jimenez P, et al. Road-sign detection and recognition based on support vector machines [J]. IEEE Transactions on Intelligent Transportation Systems, 2007,8(2): 264-278
[8] Kim E, Haseyama M, Kitajima H. Fast and robust ellipse extraction from complicated images [C]//Proceedings of the International Conference on Information Technology and Applications (ICITA).Bathurst, Australia: IEEE Computer Society, 2002:1-86467-114-9.
[9] Belaroussi R, Foucher P, Tarel J P, et al. Road sign detection in images: A case study [C]//2010 20th International Conference on Pattern Recognition(ICPR). Istanbul, Turkey: IEEE Computer Society,2010: 484-488.
[10] Zhang K, Sheng Y, Li J. Automatic detection of road traffic signs from natural scene images based on pixel vector and central projected shape feature [J].IET Intelligent Transport Systems, 2012, 6(3): 282-291.
[11] Ruta A, Li Y M, Liu X H. Real-time traffic sign recognition from video by class-specific discriminative features [J]. Pattern Recognition, 2010, 43(1): 416-430.
[12] Bahlmann C, Zhu Y, Ramesh V, et al. A system for traffic sign detection, tracking and recognition using color, shape, and motion information [C]//Proceedings of Intelligent Vehicles Symposium. Las Vegas, NV:IEEE, 2005: 255-260.
[13] Xiang K, Wang X Y, Cao S X, et al. A new approach for real-time segmenting moving objects under cluttered background [C]//2012 IEEE Symposium on Electrical and Electronics Engineering (EEESYM).Kuala Lump, Malaysia: IEEE, 2012: 224-227.
[14] Shadeed W G, Abu-Al-Nadi D I, Mismar M J. Road traffic sign detection in color images[C]//Proceedings of the 2003 10th IEEE International Conference on Electronics, Circuits and Systems(ICECS). Sharjah, United Arab Emirates: IEEE,2003: 890-893.

[1]	ZHANG Lulu (章露露), DONG Xiangxiang (董祥祥), YAO Lixiu (姚莉秀), CAI Yunze (蔡云泽). Velocity-Varying Target Tracking of Mobile Sensor Network Based on Flocking Control[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(4): 446-453.
[2]	ZHOU Zhipeng, YIN Dong, DING Jinwen, LUO Yuhao, YUAN Mingyue, ZHU Chengfeng. Collaborative Tracking Method in Multi-Camera System[J]. J Shanghai Jiaotong Univ Sci, 2020, 25(6): 802-810.
[3]	ZHENG Tianhai, FENG Zhengping, ZHAO Shuo, PAN Wanjun. Active Disturbance Rejection Controller Based Heading Control of Underwater Flight Vehicles[J]. Journal of Shanghai Jiao Tong University(Science), 2020, 25(4): 441-446.
[4]	HUANG Hantao, ZHOU Jingye, DI Qing, ZHOU Jiawei, LI Jiawang . Three-Dimensional Trajectory Tracking Control of Underactuated Autonomous Underwater Vehicles with Input Saturation[J]. Journal of Shanghai Jiao Tong University(Science), 2020, 25(4): 470-477.
[5]	ZHONG Haowen (钟昊文), WANG Chao (王超), TUO Hongya (庹红娅), HU Jian (胡健), QIAO Lingfen. Transfer Learning Based on Joint Feature Matching and Adversarial Networks[J]. Journal of Shanghai Jiao Tong University (Science), 2019, 24(6): 699-705.
[6]	LIU Jun (刘俊), DING Ziqi (丁子祈), LU Qi (陆麒), HAN Xianhong (韩先洪) . Mode Tracking Scheme Among Remeshed Models for Structural Optimization[J]. Journal of Shanghai Jiao Tong University (Science), 2019, 24(6): 706-715.
[7]	CHEN Shuhao (陈树浩), MAO Xuchu (茅旭初). Research and Implementation of Beidou-3 Satellite Multi-Band Signal Acquisition and Tracking Method[J]. Journal of Shanghai Jiao Tong University (Science), 2019, 24(5): 571-578.
[8]	SONG Xueqian* (宋雪倩), HU Shiqiang (胡士强). Hierarchy-Based Adaptive Generalized Predictive Control for Aerial Grasping of a Quadrotor Manipulator[J]. Journal of Shanghai Jiao Tong University (Science), 2019, 24(4): 451-458.
[9]	MENG Yu *(孟宇), GAN Xin (甘鑫), WANG Yu (汪钰), GU Qing (顾青). LQR-GA Controller for Articulated Dump Truck Path Tracking System[J]. Journal of Shanghai Jiao Tong University (Science), 2019, 24(1): 78-85.
[10]	LIU Yueyang (刘岳洋), HU Qinglei (胡庆雷), GUO Lei (郭雷). Finite-Time Attitude Tracking Control of Spacecraft with Actuator Saturation[J]. Journal of Shanghai Jiao Tong University (Science), 2018, 23(5): 650-656.
[11]	LU Jiahui (陆佳辉), CHEN Yimin* (陈一民), ZOU Yibo (邹一波), ZOU Guozhi (邹国志). Long-Term Tracking Based on Spatio-Temporal Context[J]. 上海交通大学学报（英文版）, 2017, 22(4): 504-512.
[12]	WEI Jianming1* (韦建明), ZHANG Youan2 (张友安), LIU Jingmao3 (刘京茂). Observer-Based Adaptive Neural Iterative Learning Control for a Class of Time-Varying Nonlinear Systems[J]. 上海交通大学学报（英文版）, 2017, 22(3): 303-312.
[13]	GUO Li (郭立). A Comprehensive Method to Reject Detection Outliers by Combining Template Descriptor with Sparse 3D Point Clouds[J]. 上海交通大学学报（英文版）, 2017, 22(2): 188-192.
[14]	ZHANG Qian* (张茜), LIU Zhiyuan (刘志远). Hierarchical Control Strategy of Trajectory Tracking for Intelligent Vehicle[J]. 上海交通大学学报（英文版）, 2017, 22(2): 224-232.
[15]	WANG Jianjun1* (王建军), CHEN Shanben2 (陈善本), SHAO Yufeng1 (邵宇丰). Research on Maximum Power Point Tracking in Redundant Load Mode for Photovoltaic System[J]. 上海交通大学学报（英文版）, 2016, 21(3): 257-262.