Journal of Shanghai Jiao Tong University

Journal of Shanghai Jiaotong University >

2024 , Vol. 58 >Issue 4: 565 - 578

DOI: https://doi.org/10.16183/j.cnki.jsjtu.2023.026

Electronic Information and Electrical Engineering

FPGA Design of Image Defogging System in Intelligent Tachograph

Expand
  • a. Xi’an Key Laboratory of Intelligent Expressway Information Fusion and Control, Chang’an University, Xi’an 710064, China
    b. School of Electronics and Control Engineering, Chang’an University, Xi’an 710064, China
    c. School of Information Engineering, Chang’an University, Xi’an 710064, China

Received date: 2023-01-19

  Revised date: 2023-04-23

  Accepted date: 2023-04-28

  Online published: 2023-05-31

Fold

Abstract

In hazy weather, due to the low visibility of traffic roads, the video images collected are degraded and the image information is fuzzy. Considering the problem of low real-time processing of the traditional system, an image defogging system based on the ZYNQ platform is designed and applied to the intelligent driving recorder system. First, aiming at the problems of the traditional dark channel defogging algorithm in the sky region, a sky region segmentation strategy is proposed to correct the image restoration parameters. Then, in order to solve the problem that the pixel ordering of the whole image consumes a lot of resources when calculating the global atmospheric light value, a frame iteration method is proposed to optimize the atmospheric light value by making the advantage of the parallel operation on the FPGA platform, and at the same time, the optimization of guided filtering is realized. Finally, using dual-channel high definition multimedia interface (HDMI) resources, a real-time traffic image video processing experimental platform is established by using one channel of the dual HDMI resources as video input and the other as video processing output, and experimental simulation of the algorithm in this paper is conducted. The experimental results show that the system has a good defogging performance for the traffic video in hazy weather, especially in solving the problem of defogging distortion in the sky area. When the traffic video with a resolution of 1 280×720 is defogged, the processing speed can reach 30 frame/s meeting the real-time requirements.

Key words： traffic video; image defogging; ZYNQ platform; real-time processing

Cite this article

HUANG He, HU Kaiyi, YANG Lan, WANG Hao, GAO Tao, WANG Huifeng . FPGA Design of Image Defogging System in Intelligent Tachograph[J]. Journal of Shanghai Jiaotong University, 2024 , 58(4) : 565 -578 . DOI: 10.16183/j.cnki.jsjtu.2023.026

References

[1] 苗开超, 姚叶青, 王传辉, 等. 一次导致重大交通事故的大雾天气成因分析[J]. 气象科技进展, 2021, 11(4): 23-27.
  MIAO Kaichao, YAO Yeqing, WANG Chuanhui, et al. Analysis of a dense fog event caused a fatal traffic accident[J]. Advances in Meteorological Science and Technology, 2021, 11(4): 23-27.
[2] 王洁, 王顺吉, 侯刚. 基于Zynq的嵌入式数字图像处理系统设计[J]. 实验室科学, 2020, 23(4): 70-73.
  WANG Jie, WANG Shunji, HOU Gang. Design of embedded image system based on Z7 series[J]. Laboratory Science, 2020, 23(4): 70-73.
[3] 黄鹤, 胡凯益, 郭璐, 等. 改进的海雾图像去除方法[J]. 哈尔滨工业大学学报, 2021, 53(8): 81-91.
  HUANG He, HU Kaiyi, GUO Lu, et al. Improved defogging algorithm for sea fog[J]. Journal of Harbin Institute of Technology, 2021, 53(8): 81-91.
[4] CAI B L, XU X M, JIA K, et al. DehazeNet: An end-to-end system for single image haze removal[J]. IEEE Transactions on Image Processing, 2016, 25(11): 5187-5198.
[5] 黄鹤, 胡凯益, 宋京, 等. 雾霾线求解透射率的二次优化方法[J]. 西安交通大学学报, 2021, 55(8): 130-138.
  HUANG He, HU Kaiyi, SONG Jing, et al. A twice optimization method for solving transmittance with haze-lines[J]. Journal of Xi’an Jiaotong University, 2021, 55(8): 130-138.
[6] NAYAR S K, NARASIMHAN S G. Vision in bad weather[C]// Proceedings of the Seventh IEEE International Conference on Computer Vision. New York, NY, USA: IEEE, 2002:598-605.
[7] HE K M, SUN J, TANG X O. Single image haze removal using dark channel prior[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011, 33(12): 2341-2353.
[8] 黄鹤, 李昕芮, 宋京, 等. 多尺度窗口的自适应透射率修复交通图像去雾方法[J]. 中国光学, 2019, 12(6): 1311-1320.
  HUANG He, LI Xinrui, SONG Jing, et al. A traffic image dehaze method based on adaptive transmittance estimation with multi-scale window[J]. Chinese Optics, 2019, 12(6): 1311-1320.
[9] 尹震宇, 徐光远, 张飞青, 等. 面向Zynq平台的卷积神经网络单元设计与实现[J]. 小型微型计算机系统, 2022, 43(2): 231-235.
  YIN Zhenyu, XU Guangyuan, ZHANG Feiqing, et al. Design and implementation of convolution neural network unit based on Zynq platform[J]. Journal of Chinese Computer Systems, 2022, 43(2): 231-235.
[10] KIM J H, KIM C S. Approximate solution to optimized contrast enhancement for hazy image[C]// IEEE International Symposium on Consumer Electronics. Seoul, Korea: IEEE, 2014: 1-2.
[11] 刘倩, 陈茂银, 周东华. 基于单幅图像的快速去雾算法[C]// 中国控制与决策会议. 贵阳: 控制与决策编辑部, 2013: 3781-3786.
  LIU Qian, CHEN Maoyin, ZHOU Donghua. Fast haze removal from a single image[C]// Chinese Control and Decision Conference. Guiyang, China: Control and Decision, 2013: 3781-3786.
[12] 刘光飞, 胡辽林. 暗通道先验去雾算法的改进及FPGA实现[J]. 西安理工大学学报, 2016, 32(1): 77-82.
  LIU Guangfei, HU Liaolin. Improvement and FPGA implementation of dark channel priori dehazing algorithm[J]. Journal of Xi’an University of Technology, 2016, 32(1): 77-82.
[13] 龚亮, 孙俊喜, 顾播宇, 等. 基于FPGA的视频图像去雾系统的设计与实现[J]. 电视技术, 2013, 37(7): 6-8.
  GONG Liang, SUN Junxi, GU Boyu, et al. Design and implementation of haze removal system of video image based on FPGA[J]. Video Engineering, 2013, 37(7): 6-8.
[14] LIU H, HUANG D, HOU S, et al. Large size single image fast defogging and the real time video defogging FPGA architecture[J]. Neurocomputing, 2017, 269(20): 97-107.
[15] BEGUM R, RAJAPRIYA S, KANNAN G. FPGA implementation and simulation of guided image filtering[C]// International Conference Icats. Thanjavur, India: ICATS, 2014:218-227.
[16] 黄文辉, 陈仁雷, 张家谋. 数字视频图像质量客观测量方法的改进与实现[J]. 北京邮电大学学报, 2005(4): 87-90.
  HUANG Wenhui, CHEN Renlei, ZHANG Jiamou. Improvement and implementation of objective digital video quality measurement[J]. Journal of Beijing University of Posts and Telecommunications, 2005(4): 87-90.
[17] 黄鹤, 胡凯益, 李战一, 等. 融合MCAP和GRTV正则化的无人机航拍建筑物图像去雾方法[J]. 上海交通大学学报, 2023, 57(3): 366-378.
  HUANG He, HU Kaiyi, LI Zhanyi, et al. An image dehazing method for UAV aerial photography of buildings combining MCAP and GRTV regularization[J]. Journal of Shanghai Jiao Tong University, 2023, 57(3): 366-378.
[18] CHOI L K, YOU J, BOVIK A C. Referenceless prediction of perceptual fog density and perceptual image defogging[J]. IEEE Transactions on Image Processing, 2015, 24(11): 3888-3901.
Options
Outlines

/

〈 〉