Journal of Shanghai Jiao Tong University

Journal of Shanghai Jiaotong University >

2023 , Vol. 57 >Issue 10: 1292 - 1304

DOI: https://doi.org/10.16183/j.cnki.jsjtu.2022.303

Transportation Engineering

Airport Pavement Snow and Ice State Perception Based on Improved YOLOX-s

Expand
  • 1. School of Electronic Information and Automation, Civil Aviation University of China, Tianjin 300300, China
    2. AVIC Tianjin Aviation Machinery and Electricity Co., Ltd., Tianjin 300308, China
    3. Engineering Technology Research Centre, Second Research Institute of Civil Aviation Administration of China, Chengdu 610041, China

Received date: 2022-08-04

  Revised date: 2022-11-23

  Accepted date: 2022-12-01

  Online published: 2023-10-31

Fold

Abstract

Aimed at the lack of awarness of safety and airworthiness state perception ability of airport ice runway and the new demand of interaction of runway surface condition report, a multi-scale feature fusion based ice and snow state perception model of airport runway is proposed. Based on the YOLOX-s model, first, the global context block (GC block) is introduced into the backbone feature extraction network to obtain more abundant shallow and deep features. Then, the PANet networks in neck are replaced with the bi-directional feature pyramid network (BiFPN) to improve the feature fusion ability. Afterwards, an adaptive spatial feature fusion (ASFF) structure is added to the tail of the enhanced feature extraction network to further enhance the feature fusion effect. Finally, α-EIoU is used to optimize the loss function to improve the convergence speed and accuracy of the model. The experimental results show that the improved YOLOX-s model has an average accuracy of 91.53% in the snow and ice pollutant data set obtained from the runway snow and ice experimental system, which is 4.68% higher than the original YOLOX-s model, and can provide decision-making support for airport runway snow removal operations.

Key words： pavement snow and ice state perception; YOLOX-s; global context block (GC block); bi-directional feature pyramid network (BiFPN); adaptive spatial feature fusion (ASFF); α-EIoU loss function

Cite this article

XING Zhiwei, KAN Ben, LIU Zishuo, LI Biao, LUO Qian . Airport Pavement Snow and Ice State Perception Based on Improved YOLOX-s[J]. Journal of Shanghai Jiaotong University, 2023 , 57(10) : 1292 -1304 . DOI: 10.16183/j.cnki.jsjtu.2022.303

References

[1] International Civil Aviation Organization. Global Reporting Format[EB/OL]. (2020-05-26) [2022-07-15]. https://www.icao.int/safety/Pages/GRF.aspx.
[2] KIM H G, JANG M S, LEE Y S, et al. A black ice detection method using infrared camera and YOLO[J]. Journal of the Korea Institute of Information and Communication Engineering, 2020, 25(12): 1874-1881.
[3] MA X, CHI R. Method for black ice detection on roads using tri-wavelength backscattering measurements[J]. Applied Optics, 2020, 59(24): 7242-7246.
[4] BABY K C, GEORGE B. A capacitive ice layer detection system suitable for autonomous inspection of runways using an ROV[C]// Robotic and Sensors Environment. Magdeburg, Germany: IEEE, 2012: 127-132.
[5] TROIANO A, PASERO E, MESIN L. New system for detecting road ice formation[J]. IEEE Transactions on Instrumentation & Measurement, 2011, 60(3): 1091-1101.
[6] HOSHINO S, HASHIMOTO K, TATEYAMA K, et al. Snow and ice monitoring technique for the contaminated runway[C]// AIAA SciTech 2020 Forum. New York, USA: AIAA, 2020: 767-777.
[7] 任宏宇, 苑丹丹, 桂康, 等. 复阻抗式结冰探测技术的温度补偿方法研究[J]. 仪器仪表学报, 2021, 42(6): 88-94.
[7] REN Hongyu, YUAN Dandan, GUI Kang, et al. A temperature compensation method for complex impedance ice detection[J]. Chinese Journal of Scientific Instrument, 2021, 42(6): 88-94.
[8] HONG S B, LEE B W, KIM C H, et al. System dynamics modeling for estimating the locations of road icing using GIS[J]. Applied Science-Basel, 2021, 11(18): 8537-8547.
[9] 勾一, 李清英, 刘森云. 基于闪光红外热波探测的积冰界线识别算法研究[J/OL]. 实验流体力学. http://kns.cnki.net/kcms/detail/11.5266.V.20220621.1044.002.html.
[9] GOU Yi, LI Qingying, LIU Senyun. Flash infrared thermal wave detection of ice surface edge[J/OL]. Journal of Experiment in Fluid Mechanics. http://kns.cnki.net/kcms/detail/11.5266.V.20220621.1044.002.html.
[10] QIN F G F, CHEN X D, FARID M M. Growth kinetics of ice films spreading on a subcooled solid surface[J]. Separation & Purification Technology, 2004, 39(1/2): 109-121.
[11] QIN F G F, ZHAO J C, RUSSELL A B, et al. Simulation and experiment of the unsteady heat transport in the onset time of nucleation and crystallization of ice from the subcooled solution[J]. International Journal of Heat and Mass Transfer, 2003, 46(17): 3221-3231.
[12] CHEN B, ZHOU C, LIU Y, et al. Correlation analysis of runway icing parameters and improved PSO-LSSVM icing prediction[J]. Cold Regions Science and Technology, 2022, 54(15): 193-198.
[13] COSTA M, MONIACI W, PASERO F. INFO: An artificial neural system to forecast ice formation on the road[C]// IEEE International Symposium on Computational Intelligence for Measurement Systems & Applications. Lugano, Switzerland: IEEE, 2003: 127-132.
[14] ENVELOPE Z D. Uncertainty-aware accurate insulator fault detection based on an improved YOLOX model[J]. Energy Reports, 2022, 8: 12809-12821.
[15] ISHIKAWA N, NARUSE R, MAENO K. Heat balance characteristics of road snow and ice[J]. Low Temperature Science (Physics), 1987, 46(2): 151-162.
[16] MAENO K, NARITA E, NISHIMURA K, et al. Road snow and ice structure and new classification[J]. Low Temperature Science (Physics), 1987, 46(3): 119-133.
[17] 王雪莹. 道路冰雪与路面粘附特性及除雪机理研究[D]. 吉林: 吉林大学, 2019.
[17] WANG Xueying. Study on adhesion characteristics and snow removal mechanism of road ice, snow and pavement[D]. Jilin: Jilin University, 2019.
[18] CAO Y, XU J, LIN S, et al. GCNet: Non-Local networks meet Squeeze-Excitation networks and beyond[C]//2019 IEEE/CVF International Conference on Computer Vision Workshop. Seoul, Koera: IEEE, 2020: 390-401.
[19] WANG X, GIRSHICK R, GUPTA A, et al. Non-local neural networks[C]//2018 IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City, USA: IEEE, 2018: 225-235.
[20] HU J, SHEN L, ALBANIE S, et al. Squeeze-and-Excitation networks[J]. IEEE Transactions on Pattern Recognition and Machine Intelligence, 2017, 42(8): 2011-2023.
[21] TAN M, PANG R, LE Q V. EfficientDet: Scalable and efficient object detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle, USA: IEEE, 2020: 10778-10787.
[22] 李登攀, 任晓明, 颜楠楠. 基于无人机航拍的绝缘子掉串实时检测研究[J]. 上海交通大学学报, 2022, 56(8): 994-1003.
[22] LI Dengpan, REN Xiaoming, YAN Nannan. Real-time detection of insulator drop string based on UAV aerial photography[J]. Journal of Shanghai Jiao Tong University, 2022, 56(8): 994-1003.
[23] LI X LIW, REN D, et al. Enhanced blind face restoration with multi-exemplar images and adaptive spatial feature fusion[C]// 2020 IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City, USA: IEEE, 2020: 235-245.
[24] 程换新, 蒋泽芹, 程力, 等. 基于改进YOLOX-S的安全帽反光衣检测算法[J]. 电子测量技术, 2022, 45(6): 130-135.
[24] CHENG Huanxin, JIANG Zeqin, CHENG Li, et al. Helmet and reflective clothing detection algorithm based on improved YOLOX-S[J]. Electronic Measurement Technology, 2022, 45(6): 130-135.
[25] ZHANG Y F, REN W, ZHANG Z, et al. Focal and efficient IOU loss for accurate bounding box regression[J]. Neurocomputing, 2022, 506: 146-157.
[26] HE J, ERFANI S, MA X, et al. Alpha-IoU: A family of power intersection over union losses for bounding box regression[C]// 2021 IEEE Conference on Computer Vision and Pattern Recognition. Shenzhen, China: IEEE, 2021: 280-291.
Options
Outlines

/

〈 〉