Endoscopic transnasal optic nerve decompression surgery plays a crucial role in minimal invasive treatment of complex traumatic optic neuropathy. However, a major challenge faced during the procedure is the inability to visualize the optic nerve intraoperatively. To address this issue, an endoscopic image-based augmented reality surgical navigation system is developed in this study. The system aims to virtually fuse the optic nerve onto the endoscopic images, assisting surgeons in determining the optic nerve’s position and reducing surgical risks. First, a calibration algorithm based on a checkerboard grid of immobile points is proposed, building upon existing calibration methods. Additionally, to tackle accuracy issues associated with augmented reality technology, an optical navigation and visual fusion compensation algorithm is proposed to improve the intraoperative tracking accuracy. To evaluate the system’s performance, model experiments were meticulously designed and conducted. The results confirm the accuracy and stability of the proposed system, with an average tracking error of (0.99 ± 0.46) mm. This outcome demonstrates the effectiveness of the proposed algorithm in improving the augmented reality surgical navigation system’s accuracy. Furthermore, the system successfully displays hidden optic nerves and other deep tissues, thus showcasing the promising potential for future applications in orbital and maxillofacial surgery.
傅航1，许江长 1，李寅炜2
,
4，周慧芳2
,
4，陈晓军1
,
3
. Augmented Reality Based Navigation System for Endoscopic Transnasal Optic Canal Decompression[J]. Journal of Shanghai Jiaotong University(Science), 2025
, 30(1)
: 34
-42
.
DOI: 10.1007/s12204-024-2722-3
[1] LIN J Q, HU W L, WU Q, et al. An evolving perspective of endoscopic transnasal optic canal decompression for traumatic optic neuropathy in clinic [J]. Neurosurgical Review, 2021, 44(1): 19-27.
[2] STEINSAPIR K D, GOLDBERG R A. Traumatic optic neuropathy: An evolving understanding [J]. American Journal of Ophthalmology, 2011, 151(6): 928- 933.e2.
[3] PIROUZMAND F. Epidemiological trends of traumatic optic nerve injuries in the largest Canadian adult trauma center [J]. The Journal of Craniofacial Surgery, 2012, 23(2): 516-520.
[4] AL-QURAINY I A, STASSEN L F, DUTTON G N, et al. The characteristics of midfacial fractures and the association with ocular injury: A prospective study [J]. Postgraduate Medical Journal, 1991, 29(5): 291-301.
[5] HOLT G R, HOLT J E. Incidence of eye injuries in facial fractures: An analysis of 727 cases [J]. Marine Drugs, 1983, 91(3): 276-279.
[6] HE Z H, LI Q, YUAN J M, et al. Evaluation of transcranial surgical decompression of the optic canal as a treatment option for traumatic optic neuropathy [J]. Clinical Neurology and Neurosurgery, 2015, 134: 130-135.
[7] ABHINAV K, ACOSTA Y, WANG W H, et al. Endoscopic endonasal approach to the optic canal: Anatomic considerations and surgical relevance [J]. Neurosurgery, 2015, 11(3): 431-446.
[8] PARK S, HOWE R D, TORCHIANA D F. Virtual fixtures for robotic cardiac surgery [M]//Medical image computing and computer-assisted intervention – MICCAI 2001. Berlin, Heidelberg: Springer Berlin Heidelberg, 2001: 1419-1420.
[9] CITARDI M J, AGBETOBA A, BIGCAS J L, et al. Augmented reality for endoscopic sinus surgery with surgical navigation: A cadaver study [J]. International Forum of Allergy & Rhinology, 2016, 6(5): 523-528.
[10] WINNE C, KHAN M, STOPP F, et al. Overlay visualization in endoscopic ENT surgery [J]. International Journal of Computer Assisted Radiology and Surgery, 2011, 6(3): 401-406.
[11] JIA T T, TAYLOR Z A, CHEN X J. Long term and robust 6DoF motion tracking for highly dynamic stereo endoscopy videos [J]. Computerized Medical Imaging and Graphics, 2021, 94: 101995.
[12] GOLSE N, PETIT A, LEWIN M, et al. Augmented reality during open liver surgery using a markerless non-rigid registration system [J]. Journal of Gastrointestinal Surgery, 2021, 25(3): 662-671.
[13] SHIU Y C, AHMAD S. Calibration of wrist-mounted robotic sensors by solving homogeneous transform equations of the form AX = XB [J]. IEEE Transactions on Robotics and Automation, 1989, 5(1): 16-29.
[14] THOMPSON S, STOYANOV D, SCHNEIDER C, et al. Hand-eye calibration for rigid laparoscopes using an invariant point [J]. International Journal of Computer Assisted Radiology and Surgery, 2016, 11(6): 1071-1080.
[15] MORGAN I, JAYARATHNE U, RANKIN A, et al. Hand-eye calibration for surgical cameras: A Procrustean Perspective-n-Point solution [J]. International Journal of Computer Assisted Radiology and Surgery, 2017, 12(7): 1141-1149.
[16] LEE S, SHIM S, HA H G, et al. Simultaneous optimization of patient image registration and hand–eye calibration for accurate augmented reality in surgery [J]. IEEE Transactions on Biomedical Engineering, 2020, 67(9): 2669-2682.
[17] KINDRATENKO V V. A survey of electromagnetic position tracker calibration techniques [J]. Virtual Reality, 2000, 5(3): 169-182.
[18] SHAO L, FU T Y, ZHENG Z, et al. Augmented reality navigation with real time tracking for facial repair surgery [J]. International Journal of Computer Assisted Radiology and Surgery, 2022, 17(6): 981-991.
[19] GAO Y, LIU K, LIN L, et al. Use of augmented reality navigation to optimise the surgical management of craniofacial fibrous dysplasia [J]. British Journal of Oral and Maxillofacial Surgery, 2022, 60(2): 162-167.
[20] ARUN K S, HUANG T S, BLOSTEIN S D. Leastsquares fitting of two 3-D point sets [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1987, PAMI-9(5): 698-700.
[21] BESL P J, MCKAY N D. A method for registration of 3-D shapes [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1992, 14(2): 239-256.
[22] SHAO J L, LUO H L, XIAO D Q, et al. Progressive hand-eye calibration for laparoscopic surgery navigation [M]//Computer assisted and robotic endoscopy and clinical image-based procedures. Cham: Springer, 2017: 42-49.
[23] ZHANG Z Y. Flexible camera calibration by viewing a plane from unknown orientations [C]//Seventh IEEE International Conference on Computer Vision.
Kerkyra: IEEE, 1999: 666-673.
[24] LI L, YANG J, CHU Y K, et al. A novel augmented reality navigation system for endoscopic sinus and skull base surgery: A feasibility study [J]. PLoS One, 2016, 11(1): e0146996.
