Machine Vision Rapid Detection Method of the Track Fasteners Missing

doi:10.16183/j.cnki.jsjtu.2017.10.017

Abstract

Abstract: The detection of missing track fasteners is an important part of daily inspection of the railway. Owing to the new requirements of realtime and self adaptation of the automatic detection technology, a method of realtime detection of missing track fasteners based on machine vision is proposed in this paper. In order to deal with the interference of environmental light, the image acquisition device includes hood and lightemitting diode (LED) auxiliary light source. The switching median filtering is used and the Canny edge detection is improved based on image gradient amplitude for image adaptive enhancement of the characteristics of fastener edges. The feature of article fasteners to play in stable boundary and the projection curve characteristics of template matching are combined to realize the realtime detection of missing fasteners. Experimental results showed that the image detection time of every frame is 245.61ms, the average of ecognition accuracy is 85.8%. The highest speed of real time detection of missing fastener of actual operation line is 3.82m/s. These results suggest that the proposed method is adaptive.

Key words: rapid detection; machine vision; fasteners missing; image enhancement; template matching

CLC Number:

TP 391.4

MIN Yongzhi1,XIAO Benyu1,DANG Jianwu1,YIN Chao1,YUE Biao1,MA Hongfeng2. Machine Vision Rapid Detection Method of the Track Fasteners Missing[J]. Journal of Shanghai Jiao Tong University, 2017, 51(10): 1268-1272.

References

［1］LI Q, REN S. A visual detection system for rail surface defects［J］.IEEE Transactions on Systems Man & Cybernetics Part C, 2012, 42(6): 15311542.
［2］钱广春. 基于计算机视觉的铁路扣件缺失快速探测方法研究［D］.上海: 上海交通大学电子信息与电气工程学院, 2011.
［3］王凌, 张冰, 陈锡爱. 基于计算机视觉的钢轨扣件螺母缺失检测系统［J］.计算机工程与设计, 2011, 32(12): 41474150.
WANG Ling, ZHANG Bing, CHEN Xiai. Inspection system for loss of rail fastening nut based on computer vision［J］. Computer Engineering and Design, 2011, 32(12): 41474150.
［4］谢凤英, 吴叶芬, 周世新. 基于互信息的铁路轨枕扣件自动定位算法［J］.中国体视学与图像分析, 2013, 18(2): 145149.
XIE Fengying, WU Yefen, ZHOU Shixin. Railway fastener locating algorithm based on mutual information［J］. Chinese Journal of Stereology and Image Analysis, 2013, 18(2): 145149.
［5］罗建桥, 刘甲甲, 李柏林, 等. 基于局部特征和语义信息的扣件图像检测［J］.计算机应用研究, 2016, 33(8): 25142523.
LUO Jianqiao, LIU Jiajia, LI Bailin, et al. Detection for railway fasteners based on local features and semantic information［J］. Application Research of Computers, 2016, 33(8): 25142523.
［6］ZHANG S, KARIM M A. A new impulse detector for switching median filters［J］. IEEE Signal Processing Letters, 2002, 9(11): 360363.
［7］张小虎, 李由, 李立春, 等. 一种基于梯度方向直方图的直线轮廓提取新方法［J］.光学技术, 2006, 32(6): 824826.
ZHANG Xiaohu, LI You, LI Lichun, et al. A newline boundary detection algorithm based on histogram of gradient’s direction［J］. Optical Technique, 2006, 32(6): 824826.
［8］曾俊. 图像边缘检测技术及其应用研究［D］.武汉: 华中科技大学自动化学院, 2011.
［9］胡铟. 基于单目视觉的运动目标检测与跟踪算法研究［D］. 南京: 南京理工大学计算机科学与工程学院, 2008.

[1]	ZHAO Ziren1, DU Shichang1, HUANG Delin1, REN Fei2, LIANG Xinguang2. Modelling and Bottleneck Analysis of Product Quality in Transient Phase#br# of MultiStage Manufacturing Systems Based on Markovian Chains [J]. Journal of Shanghai Jiao Tong University, 2017, 51(10): 1166-1173.
[2]	ZHOU Penghui, MA Hongzhan, CHEN Dongping, CHEN Mengyue, CHU Xuening. Identification of Product Redesign Modules Based on#br# Fuzzy Random Failure Mode and Effects Analysis [J]. Journal of Shanghai Jiao Tong University, 2017, 51(10): 1189-1195.
[3]	LI Changxi1, 2, ZHOU Yan1, LIN Han3, LI Lingzhi1, GUO Ge1. TemporalSpatial Sequential Fusion Recognition Method of#br# Ballistic Missile Target Based on MIMOFNN Model [J]. Journal of Shanghai Jiao Tong University, 2017, 51(9): 1138-.
[4]	FENG Mingyue, HE Minghao, HAN Jun, YU Chunlai. High Resolution Direction of Arrival Estimation Based on#br# Covariance Fitting Estimation of Signal Parameters by#br# Rotational Invariance Technique Algorithm [J]. Journal of Shanghai Jiao Tong University, 2017, 51(9): 1145-.
[5]	?YANG Ping1,SHENG Jie1,WANG Yucheng2,LI Zhuyong1,JIN Zhijian1,HONG Zhiyong1. Quench Propagation Characteristics Influenced by NonUniform Properties of YBa2Cu3O7δ High Temperature Superconducting Tape [J]. Journal of Shanghai Jiaotong University, 2017, 51(9): 1090-1096.
[6]	WANG Xing, ZHOU Yipeng, TIAN Yuanrong, CHEN You, ZHOU Dongqing, HE Jiyuan. Sparse Decomposition for Frequency Modulation Radar Signal Based on#br# Advanced Genetic Algorithm and SinChirplet Atom [J]. Journal of Shanghai Jiao Tong University, 2017, 51(9): 1124-1130.
[7]	ZHANG Liangjun1, 2, LI Xiaoci1, WU Jingyi1, CAI Aifeng1. ThermalStructure Coupling Analysis of #br# Microgravity Environment Simulation Suspension Structure for #br# Large Space Deployable Mechanisms [J]. Journal of Shanghai Jiao Tong University, 2017, 51(8): 954-961.
[8]	XIA Hailiang1, 2, LIU Yakun1, 2, LIU Quanzhen3, LIU Baoquan3, FU Zhengcai1, 2. Metal Ablation Affected by Electrode Shapes Under#br# Long Continuing Lightning Current [J]. Journal of Shanghai Jiao Tong University, 2017, 51(8): 903-908.
[9]	GU Jiayang, XIE Yulin, TAO Yanwu, HUANG Xianghong, WU Jie. Numerical Simulation and Experimental Study on VortexInduced#br# Motion of a New Type of Floating Drilling Production Storage Offloading [J]. Journal of Shanghai Jiao Tong University, 2017, 51(7): 878-885.
[10]	LIN Da, ZHU Yijia, WEI Xiaodong, WANG Zhiyu, ZHANG Wugao. Combustion and Particle Emission Characteristics Affected by#br# Fuel Supply Parameters for a Diesel Engine Fuelled with#br# Polyoxymethylene Dimethyl Ethers/Diesel [J]. Journal of Shanghai Jiao Tong University, 2017, 51(7): 787-795.
[11]	MENG Qingyang1, YAN Weiwu1, HU Yong1, CHENG Jianlin1, CHEN Shihe2, ZHANG Xi2. Model Identification Based on Subspace Model Identification of#br# Superheated Steam System in UltraSupercritical CoalFired Power Unit [J]. Journal of Shanghai Jiao Tong University, 2017, 51(6): 672-678.
[12]	JIANG Huajuna, CAI Yana, b, LI Chaohaoa, LI Fanga, b, HUA Xueminga, b. Recognition Method for Gas Pores on XRay Image of Lap Joints#br# Based on the Improved Sobel Algorithm [J]. Journal of Shanghai Jiao Tong University, 2017, 51(6): 665-671.
[13]	DONG Guanhua,YIN Qin,YIN Guofu,XIANG Zhaowei. Identification and Modeling of Coupling Dynamic Stiffness in Joints of Machine Tool [J]. Journal of Shanghai Jiaotong University, 2015, 49(09): 1263-1434.
[14]	XIE Qijiang,YU Haidong. Coupling Relationship Between Loads on Cutterhead of Tunnel Boring Machine and Contact Stiffness of Gripper Shoes and Rocks [J]. Journal of Shanghai Jiaotong University, 2015, 49(09): 1269-1275.
[15]	ZHONG Jianlin1,MA Dawei1,REN Jie1,LI Shijun2,WANG Xu3. Static Compression Analysis of Rubber Hollow Cylinder Based on Plane Strain Assumption [J]. Journal of Shanghai Jiaotong University, 2015, 49(09): 1276-1280.