A surgical system for automatic registration, stiffness mapping and dynamic image overlay

Nicolas Zevallos, Arun Srivatsan Rangaprasad, Hadi Salman, Lu Li, Jianing Qian, Saumya Saxena, Mengyun Xu, Kartik Patath and Howie Choset
Conference Paper, International Symposium on Medical Robotics, March, 2018

View Publication

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.


In this paper we develop a surgical system using the da Vinci research kit (dVRK) that is capable of autonomously searching for tumors and dynamically displaying the tumor location using augmented reality. Such a system has the potential to quickly reveal the location and shape of tumors and visually overlay that information to reduce the cognitive overload of the surgeon. We believe that our approach is one of the first to incorporate state-of-the-art methods in registration, force sensing and tumor localization into a unified surgical system. First, the preoperative model is registered to the intra-operative scene using a Bingham distribution-based filtering approach. An active level set estimation is then used to find the location and the shape of the tumors. We use a recently developed miniature force sensor to perform the palpation. The estimated stiffness map is then dynamically overlaid onto the registered preoperative model of the organ. We demonstrate the efficacy of our system by performing experiments on phantom prostate models with embedded stiff inclusions.

author = {Nicolas Zevallos and Arun Srivatsan Rangaprasad and Hadi Salman and Lu Li and Jianing Qian and Saumya Saxena and Mengyun Xu and Kartik Patath and Howie Choset},
title = {A surgical system for automatic registration, stiffness mapping and dynamic image overlay},
booktitle = {International Symposium on Medical Robotics},
year = {2018},
month = {March},
keywords = {Registration, tumor localization, stiffness mapping, augmented reality},
} 2018-02-21T10:40:55-04:00