J Shanghai Jiaotong Univ Sci ›› 2025, Vol. 30 ›› Issue (1): 34-42.doi: 10.1007/s12204-024-2722-3

• Medicine-Engineering Interdisciplinary • Previous Articles    

Augmented Reality Based Navigation System for Endoscopic Transnasal Optic Canal Decompression

基于视频图像增强现实的视神经管减压手术导航系统

FU Hang1 (傅航),XU Jiangchang1 (许江长), LI Yinwei2,4* (李寅炜),ZHOU Huifang2,4 (周慧芳),CHEN Xiaojun1,3* (陈晓军)   

  1. (1. Institute of Biomedical Manufacturing and Life Quality Engineering; State Key Laboratory System and Vibration; School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China; 2. Department of Ophthalmology, Shanghai Ninth People’s Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200011, China; 3. Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China; 4. Shanghai Key Laboratory of Orbital Diseases and Ocular Oncology, Shanghai 200011, China)
  2. (1. 上海交通大学 机械与动力工程学院;机械系统与振动国家重点实验室;生命质量与生物医学制造研究所,上海 200240; 2. 上海交通大学医学院附属上海市第九人民医院 眼科,上海 200011; 3. 上海交通大学 医疗机器人研究院,上海 200240; 4. 上海市眼眶病眼肿瘤重点实验室,上海 200011)
  • Accepted:2023-08-07 Online:2025-01-28 Published:2025-01-28

Abstract: Endoscopic transnasal optic nerve decompression surgery plays a crucial role in minimal invasive treatment of complex traumatic optic neuropathy. However, a major challenge faced during the procedure is the inability to visualize the optic nerve intraoperatively. To address this issue, an endoscopic image-based augmented reality surgical navigation system is developed in this study. The system aims to virtually fuse the optic nerve onto the endoscopic images, assisting surgeons in determining the optic nerve’s position and reducing surgical risks. First, a calibration algorithm based on a checkerboard grid of immobile points is proposed, building upon existing calibration methods. Additionally, to tackle accuracy issues associated with augmented reality technology, an optical navigation and visual fusion compensation algorithm is proposed to improve the intraoperative tracking accuracy. To evaluate the system’s performance, model experiments were meticulously designed and conducted. The results confirm the accuracy and stability of the proposed system, with an average tracking error of (0.99 ± 0.46) mm. This outcome demonstrates the effectiveness of the proposed algorithm in improving the augmented reality surgical navigation system’s accuracy. Furthermore, the system successfully displays hidden optic nerves and other deep tissues, thus showcasing the promising potential for future applications in orbital and maxillofacial surgery.

Key words: optic nerve decompression, endoscopy, augmented reality, surgical navigation regret value, perceived heterogeneity, psychological distance

摘要: 内镜下经鼻视神经管减压手术是治疗复杂外伤性视神经病变的重要手段,但是其存在术中视神经不可见的难题。因此,开发了一套基于内窥镜图像的增强现实手术导航系统,实现视神经在内窥镜图像上的虚实融合显示,辅助医生判断视神经位置,降低手术风险。在现有的标定方法上,提出基于棋盘格不动点的标定算法;针对增强现实技术存在的精度问题,提出光学导航与视觉融合补偿算法提升术中跟踪精度。设计并开展模型实验,验证系统的精度和稳定性。所提出的增强现实系统平均跟踪误差为(0.99±0.46)mm,表明所提出的算法能够有效提升增强现实手术导航系统的精度,能够准确地呈现隐蔽的视神经等深部组织,未来在眶颌外科手术中将具有良好的应用前景。

关键词: 视神经减压,内窥镜,增强现实,手术导航

CLC Number: