J Shanghai Jiaotong Univ Sci ›› 2022, Vol. 27 ›› Issue (5): 715-722.doi: 10.1007/s12204-022-2435-4

• Automation System & Theory • Previous Articles     Next Articles

Multilevel Disparity Reconstruction Network for Real-Time Stereo Matching

LIU Zhuoran (刘卓然), ZHAO Xu∗ (赵旭)   

  1. (School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China)
  • Received:2020-12-18 Online:2022-09-28 Published:2022-09-03

Abstract: Recently, stereo matching algorithms based on end-to-end convolutional neural networks achieve excellent performance far exceeding traditional algorithms. Current state-of-the-art stereo matching networks mostly rely on full cost volume and 3D convolutions to regress dense disparity maps. These modules are computationally complex and high consumption of memory, and difficult to deploy in real-time applications. To overcome this problem, we propose multilevel disparity reconstruction network, MDRNet, a lightweight stereo matching network without any 3D convolutions. We use stacked residual pyramids to gradually reconstruct disparity maps from low-level resolution to full-level resolution, replacing common 3D computation and optimization convolutions. Our approach achieves a competitive performance compared with other algorithms on stereo benchmarks and real-time inference at 30 frames per second with 4×104 resolutions.

Key words: stereo matching, disparity reconstruction, real-time, stacked residual pyramid

CLC Number: