Real-Time Deformation Simulation of Kidney Surgery Based on Virtual Reality

doi:10.1007/s12204-021-2295-3

J Shanghai Jiaotong Univ Sci ›› 2021, Vol. 26 ›› Issue (3): 290-297.doi: 10.1007/s12204-021-2295-3

Real-Time Deformation Simulation of Kidney Surgery Based on Virtual Reality

JING Mengjiea (荆梦杰), CUI Zhixina (崔志鑫), FU Hanga (傅航), CHEN Xiaojuna,b (陈晓军)

(a. Institute of Biomedical Manufacturing and Life Quality Engineering, State Key Laboratory of
Mechanical System and Vibration, School of Mechanical Engineering; b. Institute of
Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China)

出版日期:2021-06-28 发布日期:2021-06-02
通讯作者: CHEN Xiaojun(陈晓军) E-mail:xiaojunchen@sjtu.edu.cn
基金资助:
the National Key Research and Development
Program of China (No. 2017YFB1302900),
the National Natural Science Foundation of China
(Nos. 81971709, M-0019, and 82011530141), the Foundation
of Science and Technology Commission of Shanghai
Municipality (Nos. 19510712200, and 20490740700),
and the Shanghai Jiao Tong University Foundation
on Medical and Technological Joint Science
Research (Nos. ZH2018ZDA15, YG2019ZDA06, and
ZH2018QNA23), and the 2020 Key Research Project of
Xiamen Municipal Government (No. 3502Z20201030)

Real-Time Deformation Simulation of Kidney Surgery Based on Virtual Reality

JING Mengjiea (荆梦杰), CUI Zhixina (崔志鑫), FU Hanga (傅航), CHEN Xiaojuna,b (陈晓军)

(a. Institute of Biomedical Manufacturing and Life Quality Engineering, State Key Laboratory of
Mechanical System and Vibration, School of Mechanical Engineering; b. Institute of
Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China)

Online:2021-06-28 Published:2021-06-02
Contact: CHEN Xiaojun(陈晓军) E-mail:xiaojunchen@sjtu.edu.cn
Supported by:
the National Key Research and Development
Program of China (No. 2017YFB1302900),
the National Natural Science Foundation of China
(Nos. 81971709, M-0019, and 82011530141), the Foundation
of Science and Technology Commission of Shanghai
Municipality (Nos. 19510712200, and 20490740700),
and the Shanghai Jiao Tong University Foundation
on Medical and Technological Joint Science
Research (Nos. ZH2018ZDA15, YG2019ZDA06, and
ZH2018QNA23), and the 2020 Key Research Project of
Xiamen Municipal Government (No. 3502Z20201030)

摘要/Abstract

摘要： Virtual reality-based surgery simulation is becoming popular with the development of minimally invasive abdominal surgery, where deformable soft tissue is modelled and simulated. The mass-spring model (MSM) and finite element method (FEM) are common methods used in the simulation of soft tissue deformation. However, MSM has an issue concerning accuracy, while FEM has a problem with efficiency. To achieve higher accuracy and efficiency at the same time, we applied a co-rotational FEM in the simulation of a kidney with a tumour inside, achieving a real-time and accurate deformation simulation. In addition, we set a multi-model representation for mechanical simulation and visual rendering. The implicit Euler method and conjugate gradient method were adopted for setting and solving the linear system. For a realistic simulation of surgery, constraints outside the kidney and between the kidney and tumour were set with two series of mechanical properties for the two models. Experiments were conducted to validate the accuracy and real-time performance.

Abstract: Virtual reality-based surgery simulation is becoming popular with the development of minimally invasive abdominal surgery, where deformable soft tissue is modelled and simulated. The mass-spring model (MSM) and finite element method (FEM) are common methods used in the simulation of soft tissue deformation. However, MSM has an issue concerning accuracy, while FEM has a problem with efficiency. To achieve higher accuracy and efficiency at the same time, we applied a co-rotational FEM in the simulation of a kidney with a tumour inside, achieving a real-time and accurate deformation simulation. In addition, we set a multi-model representation for mechanical simulation and visual rendering. The implicit Euler method and conjugate gradient method were adopted for setting and solving the linear system. For a realistic simulation of surgery, constraints outside the kidney and between the kidney and tumour were set with two series of mechanical properties for the two models. Experiments were conducted to validate the accuracy and real-time performance.

中图分类号:

R 318
TP 391

JING Mengjie (荆梦杰), CUI Zhixin (崔志鑫), FU Hang (傅航), CHEN Xiaojun (陈晓军). Real-Time Deformation Simulation of Kidney Surgery Based on Virtual Reality[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(3): 290-297.

JING Mengjie (荆梦杰), CUI Zhixin(崔志鑫), FU Hang (傅航), CHEN Xiaojun (陈晓军). Real-Time Deformation Simulation of Kidney Surgery Based on Virtual Reality[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(3): 290-297.

参考文献 18

	[1]
	ANTONIOU S A, ANTONIOU G A, ANTONIOU A I, et al. Past, present, and future of
	minimally invasive abdominal surgery [J]. Journal of the Society of Laparoendoscopic
	Surgeons, 2015, 19(3): e2015.00052.
	[2]
	BERNHARDT S, NICOLAU S A, SOLER L, et al. The status of augmented reality in
	laparoscopic surgery as of 2016 [J]. Medical Image Analysis, 2017, 37: 66-90.
[3]	DUAN
	Y P, HUANG W M, CHANG H B, et al. Volume preserved mass–spring model with novel
	constraints for soft tissue deformation [J]. IEEE Journal of Biomedical and
	Health Informatics, 2016, 20(1): 268- 280.
	[4]
	NEALEN A, M¨ULLER M, KEISER R, et al. Physically based deformable models in
	computer graphics [J]. Computer Graphics Forum, 2006, 25(4): 809-836.
	[5]
	ZIENKIEWICZ O C, TAYLOR R L, ZHU J Z. Field problems: A multidimensional finite
	element method [M]//The finite element method: Its basis and fundamentals. Amsterdam:
	Elsevier, 2013: 115-149.
[6]	DE
	S, KIM J, LIM Y J, et al. The point collocationbased method of finite spheres
	(PCMFS) for real time surgery simulation [J]. Computers & Structures, 2005,
83	(17/18): 1515-1525.
	[7]
	FREUTEL M, SCHMIDT H, D¨URSELEN L, et al. Finite element modeling of soft
	tissues: Material models, tissue interaction and challenges [J]. Clinical
	Biomechanics, 2014, 29(4): 363-372.
	[8]
	COURTECUISSE H, JUNG H, ALLARD J, et al. GPU-based real-time soft tissue
	deformation with cutting and haptic feedback [J]. Progress in Biophysics and
	Molecular Biology, 2010, 103(2/3): 159-168.
	[9]
	COURTECUISSE H, ALLARD J, KERFRIDEN P, et al. Real-time simulation of contact
	and cutting of heterogeneous soft-tissues [J]. Medical Image Analysis, 2014,
18	(2): 394-410.
	[10]
	PLANTEF`EVE R, PETERLIK I, HAOUCHINE N, et al. Patient-specific biomechanical
	modeling for guidance during minimally-invasive hepatic surgery [J]. Annals of Biomedical
	Engineering, 2016, 44(1): 139-153.
	[11]
	HELLER N, SATHIANATHEN N, KALAPARA A, et al. The KiTS19 challenge data: 300
	kidney tumor cases with clinical context, CT semantic segmentations, and
	surgical outcomes [EB/OL]. [2020-12-02]. https://arxiv.org/pdf/1904.00445v2.pdf.
	[12]
	NEWMAN T S, YI H. A survey of the marching cubes algorithm [J]. Computers &
	Graphics, 2006, 30(5): 854-879.
	[13]
	GARLAND M, HECKBERT P S. Surface simplification using quadric error metrics
[C]	//Proceedings of the 24th Annual Conference on Computer Graphics and Interactive
	Techniques. New York: ACM Press, 1997: 209-216.
[14]	JU
	T, LOSASSO F, SCHAEFER S, et al. Dual contouring of hermite data
[C]	//Proceedings of the 29th Annual Conference on Computer Graphics and
	Interactive Techniques. New York: ACM Press, 2002: 339- 346.
	[15]
	NESME M, PAYAN Y, FAURE F. Efficient, physically plausible finite elements
	[EB/OL]. [2020-12-02]. https://hal.inria.fr/inria-00394480v1/document.
	[16]
	FAURE F, DURIEZ C, DELINGETTE H, et al. SOFA: A multi-model framework for
	interactive physical simulation [M]//Soft tissue biomechanical modeling for computer
	assisted surgery. Berlin, Heidelberg: Springer, 2012: 283-321.
	[17]
	BARAFF D, WITKIN A. Large steps in cloth simulation [C]//Proceedings of the
25	th Annual Conference on Computer Graphics and Interactive Techniques. New
	York: ACM Press, 1998: 43-54.
[18]	SHEWCHUK J R. An introduction to the
	conjugate gradient method without the agonizing pain [R]. Schenley Park
	Pittsburgh, PA, USA: Carnegie Mellon University, 1994.

Real-Time Deformation Simulation of Kidney Surgery Based on Virtual Reality

Real-Time Deformation Simulation of Kidney Surgery Based on Virtual Reality

PDF (PC)

可视化

摘要/Abstract

引用本文

使用本文

参考文献 18

相关文章 15

编辑推荐

Metrics

本文评价

[1]	. [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(2): 168-175.
[2]	. [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(1): 1-6.
[3]	. [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(1): 7-14.
[4]	. [J]. J Shanghai Jiaotong Univ Sci, 2022, 27(1): 15-23.
[5]	CHENG Rongshan, (程荣山), JIANG Ziang, (蒋子昂), DIMITRIOU Dimitris, GONG Weihua, (龚伟华), TSAI Tsung-Yuan, (蔡宗远). Biomechanical Analysis of Personalised 3D-Printed Clavicle Plates of Different Materials to Treat Midshaft Clavicle Fractures[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(3): 259-266.
[6]	SUN Binbin (孙彬彬), HAN Yu (韩煜), JIANG Wenbo (姜闻博), DAI Kerong(戴尅戎). 3D Printing Bioink Preparation and Application in Cartilage Tissue Reconstruction in Vitro[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(3): 267-271.
[7]	WANG Wenhao, (王文豪), DENG Qian(邓迁), LI Tao (李涛), LIU Yuehua (刘月华), LIU Yang (刘洋), SUN Yeye (孙叶叶), DENG Changxu (邓昌旭), ZHOU Xiaojun (周小军), MA Zhenjiang (马振江), QIANG Lei (强磊), WANG Jinwu, (王金武), DAI Kerong, (戴尅戎). Research Update on Bioreactors Used in Tissue Engineering[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(3): 272-283.
[8]	SHI Junyu (史俊宇), LI Yuan (李元), ZHANG Xiao (张枭), ZHANG Xiaomeng (张晓梦), LAI Hongchang (赖红昌). Accuracy Assessment of a Novel Radiographic Method to Evaluate Guided Bone Regeneration Outcomes Using a 3D-Printed Model[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(3): 284-289.
[9]	XU Jiangchang (许江长), HE Shamin (何莎敏), YU Dedong (于德栋), WU Yiqun (吴轶群), CHEN Xiaojun, (陈晓军). Automatic Segmentation Method for Cone-Beam Computed Tomography Image of the Bone Graft Region within Maxillary Sinus Based on the Atrous Spatial Pyramid Convolution Network[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(3): 298-305.
[10]	FENG Qiping (冯齐平), CHU Fengting (储沨婷), CHEN Rongjing (陈荣敬), PAN Xiaogang (潘晓岗). Effects of Mandibular Extractions with Clear Aligners: A Finite Element Analysis[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(3): 377-382.
[11]	PAN Shengxuan (潘晟轩), ZOU Diyang (邹第洋), PAN Xiaogang(潘晓岗), TSAI Tsung-Yuan (蔡宗远). Effect of Attachment on Movement Control of the Central Incisor Using Invisible Orthodontics: In-Silico Finite Element Analysis[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(3): 383-390.
[12]	HAN Yu(韩煜), SUN Binbin (孙彬彬), JIANG Wenbo (姜闻博), DAI Kerong(戴尅戎). Formability of Printing Ink for Melt Electrowriting[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(3): 411-415.
[13]	GAI Xin, (盖欣), BAI Yun (白芸), LI Shujun (李述军), WANG Liao (王燎), AI Songtao (艾松涛), HAO Yulin (郝玉琳), YANG Rui (杨锐), DAI Kerong (戴尅戎). Review on Corrosion Characteristics of Porous Titanium Alloys Fabricated by Additive Manufacturing[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(3): 416-430.
[14]	ZHOU Xuhui (周旭辉), ZHANG Wenguang (张文光), XIE Jie (谢颉). Effects of Micro-Milling and Laser Engraving on Processing Quality and Implantation Mechanics of PEG-Dexamethasone Coated Neural Probe[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(1): 1-9.
[15]	CAI Weijie (蔡伟杰), HAMUSHAN Musha (木沙·哈木山), ZHAO Changli (赵常利), CHENG Pengfei (程鹏飞), ZHONG Wanrun (钟万润), HAN Pei (韩培). Influence of Supramolecular Chiral Hydrogel on Cellular Behavior of Endothelial Cells Under High-Glucose-Induced Injury[J]. J Shanghai Jiaotong Univ Sci, 2021, 26(1): 17-24.