Augmented Reality Based Navigation System for Endoscopic Transnasal Optic Canal Decompression

doi:10.1007/s12204-024-2722-3

Abstract

Abstract: Endoscopic transnasal optic nerve decompression surgery plays a crucial role in minimal invasive treatment of complex traumatic optic neuropathy. However, a major challenge faced during the procedure is the inability to visualize the optic nerve intraoperatively. To address this issue, an endoscopic image-based augmented reality surgical navigation system is developed in this study. The system aims to virtually fuse the optic nerve onto the endoscopic images, assisting surgeons in determining the optic nerve’s position and reducing surgical risks. First, a calibration algorithm based on a checkerboard grid of immobile points is proposed, building upon existing calibration methods. Additionally, to tackle accuracy issues associated with augmented reality technology, an optical navigation and visual fusion compensation algorithm is proposed to improve the intraoperative tracking accuracy. To evaluate the system’s performance, model experiments were meticulously designed and conducted. The results confirm the accuracy and stability of the proposed system, with an average tracking error of (0.99 ± 0.46) mm. This outcome demonstrates the effectiveness of the proposed algorithm in improving the augmented reality surgical navigation system’s accuracy. Furthermore, the system successfully displays hidden optic nerves and other deep tissues, thus showcasing the promising potential for future applications in orbital and maxillofacial surgery.

Key words: optic nerve decompression, endoscopy, augmented reality, surgical navigation regret value, perceived heterogeneity, psychological distance

摘要： 内镜下经鼻视神经管减压手术是治疗复杂外伤性视神经病变的重要手段，但是其存在术中视神经不可见的难题。因此，开发了一套基于内窥镜图像的增强现实手术导航系统，实现视神经在内窥镜图像上的虚实融合显示，辅助医生判断视神经位置，降低手术风险。在现有的标定方法上，提出基于棋盘格不动点的标定算法；针对增强现实技术存在的精度问题，提出光学导航与视觉融合补偿算法提升术中跟踪精度。设计并开展模型实验，验证系统的精度和稳定性。所提出的增强现实系统平均跟踪误差为（0.99±0.46）mm，表明所提出的算法能够有效提升增强现实手术导航系统的精度，能够准确地呈现隐蔽的视神经等深部组织，未来在眶颌外科手术中将具有良好的应用前景。

关键词: 视神经减压，内窥镜，增强现实，手术导航

CLC Number:

FU Hang¹ (傅航),XU Jiangchang¹ (许江长), LI Yinwei^2，4* (李寅炜),ZHOU Huifang^2，4 (周慧芳),CHEN Xiaojun^1，3* (陈晓军). Augmented Reality Based Navigation System for Endoscopic Transnasal Optic Canal Decompression[J]. J Shanghai Jiaotong Univ Sci, 2025, 30(1): 34-42.

References

[1] LIN J Q, HU W L, WU Q, et al. An evolving perspective of endoscopic transnasal optic canal decompression for traumatic optic neuropathy in clinic [J]. Neurosurgical Review, 2021, 44(1): 19-27.
[2] STEINSAPIR K D, GOLDBERG R A. Traumatic optic neuropathy: An evolving understanding [J]. American Journal of Ophthalmology, 2011, 151(6): 928- 933.e2.
[3] PIROUZMAND F. Epidemiological trends of traumatic optic nerve injuries in the largest Canadian adult trauma center [J]. The Journal of Craniofacial Surgery, 2012, 23(2): 516-520.
[4] AL-QURAINY I A, STASSEN L F, DUTTON G N, et al. The characteristics of midfacial fractures and the association with ocular injury: A prospective study [J]. Postgraduate Medical Journal, 1991, 29(5): 291-301.
[5] HOLT G R, HOLT J E. Incidence of eye injuries in facial fractures: An analysis of 727 cases [J]. Marine Drugs, 1983, 91(3): 276-279.
[6] HE Z H, LI Q, YUAN J M, et al. Evaluation of transcranial surgical decompression of the optic canal as a treatment option for traumatic optic neuropathy [J]. Clinical Neurology and Neurosurgery, 2015, 134: 130-135.
[7] ABHINAV K, ACOSTA Y, WANG W H, et al. Endoscopic endonasal approach to the optic canal: Anatomic considerations and surgical relevance [J]. Neurosurgery, 2015, 11(3): 431-446.
[8] PARK S, HOWE R D, TORCHIANA D F. Virtual fixtures for robotic cardiac surgery [M]//Medical image computing and computer-assisted intervention – MICCAI 2001. Berlin, Heidelberg: Springer Berlin Heidelberg, 2001: 1419-1420.
[9] CITARDI M J, AGBETOBA A, BIGCAS J L, et al. Augmented reality for endoscopic sinus surgery with surgical navigation: A cadaver study [J]. International Forum of Allergy & Rhinology, 2016, 6(5): 523-528.
[10] WINNE C, KHAN M, STOPP F, et al. Overlay visualization in endoscopic ENT surgery [J]. International Journal of Computer Assisted Radiology and Surgery, 2011, 6(3): 401-406.
[11] JIA T T, TAYLOR Z A, CHEN X J. Long term and robust 6DoF motion tracking for highly dynamic stereo endoscopy videos [J]. Computerized Medical Imaging and Graphics, 2021, 94: 101995.
[12] GOLSE N, PETIT A, LEWIN M, et al. Augmented reality during open liver surgery using a markerless non-rigid registration system [J]. Journal of Gastrointestinal Surgery, 2021, 25(3): 662-671.
[13] SHIU Y C, AHMAD S. Calibration of wrist-mounted robotic sensors by solving homogeneous transform equations of the form AX = XB [J]. IEEE Transactions on Robotics and Automation, 1989, 5(1): 16-29.
[14] THOMPSON S, STOYANOV D, SCHNEIDER C, et al. Hand-eye calibration for rigid laparoscopes using an invariant point [J]. International Journal of Computer Assisted Radiology and Surgery, 2016, 11(6): 1071-1080.
[15] MORGAN I, JAYARATHNE U, RANKIN A, et al. Hand-eye calibration for surgical cameras: A Procrustean Perspective-n-Point solution [J]. International Journal of Computer Assisted Radiology and Surgery, 2017, 12(7): 1141-1149.
[16] LEE S, SHIM S, HA H G, et al. Simultaneous optimization of patient image registration and hand–eye calibration for accurate augmented reality in surgery [J]. IEEE Transactions on Biomedical Engineering, 2020, 67(9): 2669-2682.
[17] KINDRATENKO V V. A survey of electromagnetic position tracker calibration techniques [J]. Virtual Reality, 2000, 5(3): 169-182.
[18] SHAO L, FU T Y, ZHENG Z, et al. Augmented reality navigation with real time tracking for facial repair surgery [J]. International Journal of Computer Assisted Radiology and Surgery, 2022, 17(6): 981-991.
[19] GAO Y, LIU K, LIN L, et al. Use of augmented reality navigation to optimise the surgical management of craniofacial fibrous dysplasia [J]. British Journal of Oral and Maxillofacial Surgery, 2022, 60(2): 162-167.
[20] ARUN K S, HUANG T S, BLOSTEIN S D. Leastsquares fitting of two 3-D point sets [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1987, PAMI-9(5): 698-700.
[21] BESL P J, MCKAY N D. A method for registration of 3-D shapes [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1992, 14(2): 239-256.
[22] SHAO J L, LUO H L, XIAO D Q, et al. Progressive hand-eye calibration for laparoscopic surgery navigation [M]//Computer assisted and robotic endoscopy and clinical image-based procedures. Cham: Springer, 2017: 42-49.
[23] ZHANG Z Y. Flexible camera calibration by viewing a plane from unknown orientations [C]//Seventh IEEE International Conference on Computer Vision. Kerkyra: IEEE, 1999: 666-673.
[24] LI L, YANG J, CHU Y K, et al. A novel augmented reality navigation system for endoscopic sinus and skull base surgery: A feasibility study [J]. PLoS One, 2016, 11(1): e0146996.