J Shanghai Jiaotong Univ Sci ›› 2022, Vol. 27 ›› Issue (2): 176-189.doi: 10.1007/s12204-021-2383-4

• Medicine-Engineering Interdisciplinary Research • Previous Articles     Next Articles

SeRN: A Two-Stage Framework of Registration for Semi-Supervised Learning for Medical Images

JIA Dengqiang1 * (贾灯强), LUO Xinzhe2 (罗鑫喆), DING Wangbin3 (丁王斌),HUANG Liqin3 (黄立勤), ZHUANG Xiahai2 (庄吓海)   

  1. (1. School of Naval Architecture, Ocean and Civil Engineering, Shanghai Jiao Tong University, Shanghai 200240, China;2. School of Data Science, Fudan University, Shanghai 200433, China; 3. College of Physics and Information Engineering, Fuzhou University, Fuzhou 350117, China)
  • Received:2021-06-25 Online:2022-03-28 Published:2022-05-02

Abstract: Significant breakthroughs in medical image registration have been achieved using deep neural networks (DNNs). However, DNN-based end-to-end registration methods often require large quantities of data or adequate annotations for training. To leverage the intensity information of abundant unlabeled images, unsupervised registration methods commonly employ intensity-based similarity measures to optimize the network parameters.However, finding a sufficiently robust measure can be challenging for specific registration applications. Weakly supervised registration methods use anatomical labels to estimate the deformation between images. High-level structural information in label images is more reliable and practical for estimating the voxel correspondence of anatomic regions of interest between images, whereas label images are extremely difficult to collect. In this paper, we propose a two-stage semi-supervised learning framework for medical image registration, which consists of unsupervised and weakly supervised registration networks. The proposed semi-supervised learning framework is trained with intensity information from available images, label information from a relatively small number of labeled images and pseudo-label information from unlabeled images. Experimental results on two datasets (cardiac and abdominal images) demonstrate the efficacy and efficiency of this method in intra- and inter-modality medical image registrations, as well as its superior performance when a vast amount of unlabeled data and a small set of annotations are available. Our code is publicly available at https://github.com/jdq818/SeRN.

Key words: medical image registration| semi-supervised learning| intra-modality| inter-modality

CLC Number: