J Shanghai Jiaotong Univ Sci ›› 2023, Vol. 28 ›› Issue (4): 459-.doi: 10.1007/s12204-022-2491-9

• • 上一篇    



  1. (北京工业大学 信息学部软件学院,北京100124)
  • 收稿日期:2020-12-31 接受日期:2021-05-14 出版日期:2023-07-28 发布日期:2023-07-31

Ensemble of Two-Path Capsule Networks for Diagnosis of Turner Syndrome Using Global-Local Facial Images

LIU Lu (刘璐)   

  1. (School of Software Engineering, Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China)
  • Received:2020-12-31 Accepted:2021-05-14 Online:2023-07-28 Published:2023-07-31

摘要: 特纳综合征是一种染色体异常疾病,对女性病人的成长造成极大的危害。及时诊断对该病患者具有重要意义。然而,现有的临床筛查方法相对耗时且费用昂贵。相关研究人员提出使用机器学习方法进行特纳综合征诊断,但是这些方法的诊断准确率有待提升。因此,面向特纳综合征诊断任务,提出一种基于全局-局部人脸图像的双路径胶囊网络集成方法。具体地,对特纳综合征人脸图像进行预处理,并在医疗专家的指导下,将人脸图像分割为8部分具有医学意义的局部人脸图像;然后,基于完整人脸图像和8部分局部图像进行双路径胶囊网络模型训练,以小样本学习方法解决模型训练过程中面临的样本不足问题;最后,以基于概率的集成方法对9个特纳综合征人脸分类模型进行集成。通过对基础分类模型进行分析,发现眼部区域和鼻子区域的异常面容与特纳综合征疾病具有强相关性。实验结果显示,该集成方法对特纳综合征诊断任务具有一定的有效性,能够取得0.9241的最高诊断准确率。

关键词: 特纳综合征,双路径胶囊网络,集成方法,小样本学习

Abstract: Turner syndrome (TS) is a chromosomal disorder disease that only affects the growth of female patients. Prompt diagnosis is of high significance for the patients. However, clinical screening methods are time-consuming and cost-expensive. Some researchers used machine learning-based methods to detect TS, the performance of which needed to be improved. Therefore, we propose an ensemble method of two-path capsule networks (CapsNets) for detecting TS based on global-local facial images. Specifically, the TS facial images are preprocessed and segmented into eight local parts under the direction of physicians; then, nine two-path CapsNets are respectively trained using the complete TS facial images and eight local images, in which the few-shot learning is utilized to solve the problem of limited data; finally, a probability-based ensemble method is exploited to combine nine classifiers for the classification of TS. By studying base classifiers, we find two meaningful facial areas are more related to TS patients, i.e., the parts of eyes and nose. The results demonstrate that the proposed model is effective for the TS classification task, which achieves the highest accuracy of 0.924 1.

Key words: Turner syndrome (TS), two-path capsule network (CapsNet), ensemble method, few-shot learning