Cal-MR: Center for Automation and Learning for Medical Robotics, University of California Berkeley, Berkeley, California, USA


Autonomous Robot Surgery: Performing Surgical Subtasks without Human Intervention

Published on Oct 14, 2014

Abstract: Automating repetitive surgical subtasks such as suturing, cutting and debridement can reduce surgeon fatigue and procedure times and facilitate supervised tele-surgery. Programming is difficult because human tissue is deformable and highly specular.
Using the da Vinci Research Kit (DVRK) robotic surgical assistant, we explore a “Learning By Observation” (LBO) approach where we identify, segment, and parameterize sub-trajectories (“surgemes”) and sensor conditions to build a finite state machine (FSM) for each subtask. The robot then executes the FSM repeatedly to tune parameters and if necessary update the FSM structure.

We evaluate the approach on two surgical subtasks: debridement of 3D Viscoelastic Tissue Phantoms (3d-DVTP), in which small target fragments are removed from a 3D viscoelastic tissue phantom, and Pattern Cutting of 2D Orthotropic Tissue Phantoms (2d-PCOTP), a step in the standard Fundamentals of Laparoscopic Surgery training suite, in which a specified circular area must be cut from a sheet of orthotropic tissue phantom. We describe the approach and physical experiments, which yielded a success rate of 96% for 50 trials of the 3d-DVTP subtask and 70% for 20 trials of the 2d-PCOTP subtask.

Authors:
Adithyavairavan Murali, Siddarth Sen, Ben Kehoe, Animesh Garg, Seth McFarland, Sachin Patil, W. Douglas Boyd, Susan Lim, Pieter Abbeel, Ken Goldberg

Date: October 2014

Acknowledgements:
We thank our collaborators, in particular Allison Okamura, Greg Hager, Blake Hannaford, and Jacob Rosen. We thank Intuitive Surgical, and in particular Simon DiMao, for making the DVRK possible. We also thank the DVRK community, including Howie Choset, Anton Deguet, James Drake, Greg Fisher, Peter Kazanzides, Tim Salcudean, Nabil Simaan, and Russ Taylor. We also thank Aliakbar Toghyan, Barbara Gao, Raghid Mardini, and Sylvia Herbert for their assistance on this project. This work is supported in part by a seed grant from the UC Berkeley Center for Information Technology in the Interest of Science (CITRIS), by the U.S. National Science Foundation under Award IIS-1227536: Multilateral Manipulation by Human-Robot Collaborative Systems, by AFOSR-YIP Award #FA9550-12-1-0345, and by Darpa Young Faculty Award #D13AP00046.
 

Robot-Assisted Surgery: Autonomous Tumor Localization and Extraction

Published on Jun 26, 2015

Winner of Best Video Award at Hamlyn Surgical Robotics Symposium, London, June 2015

Autonomous Tumor Localization and Extraction: Palpation, Incision, Debridement and Adhesive Closure with the da Vinci Research Kit

Abstract:
We are developing tooling and software that allows automation of subtasks for surgeons. Palpation of tissues remain a simple, yet important means by which surgeons verify the location of tumors to make precise incisions.
We have created tooling and software a system to autonomously perform a multi-step surgical procedure? involving palpation, dissection, retraction debridement and adhesive closure in a silicone tissue phantom.

This video demonstrates a successful trial of the entire five-step procedure where human input is required only at four points to change tools? We also show failure modes of the current autonomous system and
we are working on experiments to characterize the reliability of each step and on incorporating computer vision and new probing algorithms to improve robustness.

Contributors:
Stephen McKinley, Siddarth Sen, Animesh Garg, Yiming Jen, David Gealy, Pieter Abbeel, Ken Goldberg
 
Back
Top