Lucio Tommaso De Paolis



Advanced Navigation and Augmented Visualization in Minimally Invasive Surgery

pdf PDF


Minimally invasive surgery offers advantages that make it the best choice for many diseases. The Virtual Reality technology gives a great support to this surgical procedure methods through medical image processing and visualization, 3D organ’s reconstruction and intraoperative surgical guidance. In this paper is presented an advanced visualization and navigation platform that permits the surgeon to have the possibility to visualize both the traditional patient information (the CT image dataset) and a 3D model of the patient’s anatomy obtained through the processing of these images. The platform permits two different visualization modalities that are available in real time and dynamically. According to the surgeon needs, it is possible to obtain the automatic reslicing of the orthogonal planes in order to have an accurate visualization exactly next to the actual position of the surgical instrument tip. In addition, it is possible to activate the clipping modality that allows cutting the 3D model in correspondence of a chosen visualization plane. The platform can be used as support for the diagnosis, for the surgical preoperative planning and also for an image-guided surgery.


Medical images, 3D model, augmented reality, image-guided surgery


[1] W. Seong, E.-J. Kim, and J.-W. Park, “Automatic Segmentation Technique without User Modification for 3D Visualization in Medical Image”, CIS 2004, LNCS 3314, 2004, pp. 595–600.

[2] Y.-N. Young, D. Levy, “Registration-Based Morphing of Active Contours for Segmentation of CT Scans”, Mathematical Biosciences and Engineering, 2(1), pp. 79-96, January 2006.

[3] T. Kitasaka et al., “Automated extraction of abdominal organs from uncontrasted 3D abdominal X-Ray CT images based on anatomical knowledge”, Journal of Computer Aided Diagnosis of Medical Images, 9(1), pp. 1-14, 2005.

[4] 3D Slicer, http://www.slicer.org

[5] OsiriX Imaging Software, www.osirixviewer.comParaView, http://www.paraview.org

[6] O. Faha, “Osirix: An open source platform for advanced multimodality medical imaging,” 4th International Conference on Information & Communications Technology, pp. 1–2, December 2006.

[7] ITK-SNAP, http://www.itksnap.org

[8] Mimics Medical Imaging Software, Materialise, http://www.materialise.com

[9] K. Clearya, L. Ibanez, S. Ranjan, and B. Blake, “IGSTK: a software toolkit for image-guided surgery applications”, in Conf Computer Aided Radiology and Surgery (CARS 2004), Chicago, USA.

[10] P. Cheng, H. Zhang, and H.-s. Kim, “IGSTK: Framework and Example Application Using an Open Source Toolkit for Image-Guided Surgery Applications”. Washington, DC, USA.

[11] ITK - Insight Segmentation and Registration Toolkit, http://www.itk.org

[12] NDI Polaris Vicra, http://www.ndigital.com

[13] F. Sauer, “Image Registration: Enabling Technology for Image Guided Surgery and Therapy”, Proceedings of the 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference, Shanghai, China, September 1-4, 2005.

[14] B. K. P. Horn, “Closed-form solution of absolute orientation using unit Quaternions” Department of Electrical Engineering, University of Hawaii at Manoa, Honolulu, November 1986.

[15] H. Furtado and B. Gersak, “Minimally Invasive Surgery and Augmented Reality. New Technology Frontiers in Minimally Invasive Therapies”, 2007, pp. 195-201.

[16] E. Samset, D. Schmalstieg , J. Vander Sloten, A. Freudenthal, J. Declerck, S. Casciaro, Ø. Rideng, and B. Gersak, “Augmented Reality in Surgical Procedures”, SPIE Human Vision and Electronic Imaging XIII, 2008.

[17] L. T. De Paolis, F. Ricciardi, A. F. Dragoni, and G. Aloisio, “An augmented reality application for the radio frequency ablation of the liver tumors”, 2011 International Conference on Computational Science and Its Applications (ICCSA 2011), Springer LNCS, pp. 572–581.

[18] N. Navab, M. Feuerstein, and C.Bichlmeier, “Laparoscopic Virtual Mirror - New Interaction Paradigm for Monitor Based Augmented Reality”, Proc. IEEE Virtual Reality Conf. 2007 (VR 2007), Charlotte, North Carolina, USA, 2007, pp. 10-14.

[19] S. Nicolau, A. Garcia, X. Pennec, L. Soler, X. Buy, A. Gangi, . N. Ayache, and J. Marescaux, “An augmented reality system for liver thermal ablation: Design and evaluation on clinical cases”, Elsevier, 2009.

[20] C. Bichlmeier, F. Wimmer, H. S. Michael, and N. Nassir, “Contextual Anatomic Mimesis: Hybrid In-Situ Visualization Method for Improving Multi-Sensory Depth Perception in Medical Augmented Reality”, Proc. Sixth IEEE and ACM Int. Symposium on Mixed and Augmented Reality (ISMAR ‘07), Nara, Japan, 2007, pp. 129-138.

Cite this paper

Lucio Tommaso De Paolis. (2016) Advanced Navigation and Augmented Visualization in Minimally Invasive Surgery. Computers, 1, 199-205


Copyright © 2017 Author(s) retain the copyright of this article.
This article is published under the terms of the Creative Commons Attribution License 4.0