Leveraging Multimodal Haptic Sensory Data for Robust Cutting

Kevin Zhang, Mohit Sharma, Manuela Veloso and Oliver Kroemer
Conference Paper, Proceedings of IEEE-RAS International Conference on Humanoid Robots, October, 2019

Download Publication

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.


Cutting is a common form of manipulation when working with divisible objects such as food, rope, or clay. Cooking in particular relies heavily on cutting to divide food items into desired shapes. However, cutting food is a challenging task due to the wide range of material properties exhibited by food items. Due to this variability, the same cutting motions cannot be used for all food items. Sensations from contact events, e.g., when placing the knife on the food item, will also vary depending on the material properties, and the robot will need to adapt accordingly.

In this paper, we propose using vibrations and force-torque feedback from the interactions to adapt the slicing motions and monitor for contact events. The robot learns neural networks for performing each of these tasks and generalizing across different material properties. By adapting and monitoring the skill executions, the robot is able to reliably cut through more than 20 different types of food items and even detect whether certain food items are fresh or old.

author = {Kevin Zhang and Mohit Sharma and Manuela Veloso and Oliver Kroemer},
title = {Leveraging Multimodal Haptic Sensory Data for Robust Cutting},
booktitle = {Proceedings of IEEE-RAS International Conference on Humanoid Robots},
year = {2019},
month = {October},
} 2019-11-08T08:07:36-05:00