上海交通大学学报

上海交通大学学报

• • 上一篇    

基于呼吸机波形图像识别的呼吸模式检测算法

  

  1. 1. 上海交通大学 电子信息与电气工程学院，上海 200240；

    2. 上海交通大学医学院附属瑞金医院 重症医学科，上海 200021

  • 作者简介:陈果（2000—），研究生，从事深度学习研究
  • 基金资助:
    上海市“科技创新行动计划”医学创新研究专项23Y11900100项目

Respiratory Pattern Detection Algorithm Based on Ventilator Waveform Image Recognition

  1. 1. School of Sensing Science and Engineering, School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China; 

    2. Department of Critical Care Medicine, Ruijin Hospital Affiliated to Shanghai Jiaotong, University School of Medicine, Shanghai 200021, China

PDF (PC)

11

摘要： 呼吸机波形图像可以反映机械通气时的呼吸模式。现有的呼吸回路监测和管理技术存在实时监测困难，过度依赖医护人员经验等局限性。为了实现机械通气时实时呼吸模式监测和提高异常呼吸模式的识别准确性，通过引入实时图像采集设备和基于深度学习的图像识别技术，将临床中采集到的真实图像通过基于NanoDet-Plus模型的感兴趣区域提取、图像预处理和基于LAMP(Layer-adaptive Sparsity For The Magnitude-Based Pruning)重要性评估策略和MagnitudePruner剪枝策略剪枝、CWD(Channel-wise Distillation)和BCKD(Bridging Cross-task Protocol Inconsistency for Distillation in Dense Object Detection)蒸馏后的YOLOv8n-Prune模型进行波形图像识别，算法实现了对临床环境中常见异常情况，包括积水、漏气、分泌物累积、人机不同步等多种异常呼吸模式的[1]检测，模型在规模得到压缩的情况下，mAP50达到0.990，mAP50:95达到0.879，通过类激活映射实验，证明了算法具有一定的可解释性。结合实时图像采集设备，算法可做到对异常呼吸模式的实时监测，在临床实践中具有良好的应用价值。


收稿日期：2025-01-08 修回日期：2025-02-08 录用日期：2025-04-09

基金项目：上海市“科技创新行动计划”医学创新研究专项23Y11900100项目

作者简介：陈果（2000—），研究生，从事深度学习研究。

通信作者：吕娜，副教授，博士生导师；E-mail：nana414526@sjtu.edu.cn。

关键词: 呼吸机, 机器视觉, 深度学习

Abstract:

Ventilator waveform images can reflect the breathing pattern during mechanical ventilation. Existing respiratory circuit monitoring and management techniques have limitations such as difficulty in real-time monitoring and over-reliance on healthcare personnel experience. In order to realize real-time respiratory pattern monitoring during mechanical ventilation and improve the recognition accuracy of abnormal respiratory patterns, by introducing real-time image acquisition equipment and deep learning-based image recognition technology, real images acquired in the clinic are processed through region of interest extraction based on the NanoDet-Plus model, image preprocessing, and LAMP (Layer-adaptive Sparsity For The Magnitude-Based Pruning) strategy and MagnitudePruner pruning strategy pruning, CWD (Channel-wise Distillation) and BCKD (Bridging Cross-task Protocol Inconsistency for Distillation in Dense Object Detection). for Distillation in Dense Object Detection) distillation of the YOLOv8n-Prune model for waveform image recognition, the algorithm achieves the detection of a variety of abnormal respiratory patterns in the common abnormalities in clinical environments, including water retention, air leakage, secretion accumulation, and patient-ventilator asynchrony, etc., and the model, in the case of the scale getting compressed, mAP50 reaches 0.990 and mAP50:95 reaches 0.879. The algorithm is shown to be interpretable through class activation mapping experiments. Combined with real-time image acquisition equipment, the algorithm can achieve real-time monitoring of abnormal breathing patterns, which has good application value in clinical practice.

Key words: ventilator, machine vision, deep learning

中图分类号: