/Personalized Dynamics Models for Adaptive Assistive Navigation Systems

Personalized Dynamics Models for Adaptive Assistive Navigation Systems

Eshed Ohn-Bar, Kris Kitani and Chieko Asakawa
Conference Paper, Conference on Robot Learning, October, 2018

Download Publication (PDF)

Copyright notice: This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author’s copyright. These works may not be reposted without the explicit permission of the copyright holder.


Consider an assistive system that guides visually impaired users through speech and haptic feedback to their destination. Existing robotic and ubiquitous navigation technologies (e.g., portable, ground, or wearable systems) often operate in a generic, user-agnostic manner. However, to minimize confusion and navigation errors, our real-world analysis reveals a crucial need to adapt the instructional guidance across different end-users with diverse mobility skills. To address this practical issue in scalable system design, we propose a novel model-based reinforcement learning framework for personalizing the system-user interaction experience. When incrementally adapting the system to new users, we propose to use a weighted experts model for addressing data-efficiency limitations in transfer learning with deep models. A real-world dataset of navigation by blind users is used to show that the proposed approach allows for (1) more accurate long-term human behavior prediction (up to 20 seconds into the future) through improved reasoning over personal mobility characteristics, interaction with surrounding obstacles, and the current navigation goal, and (2) quick adaptation at the onset of learning, when data is limited.

BibTeX Reference
author = {Eshed Ohn-Bar and Kris Kitani and Chieko Asakawa},
title = {Personalized Dynamics Models for Adaptive Assistive Navigation Systems},
booktitle = {Conference on Robot Learning},
year = {2018},
month = {October},
keywords = {Indoor Navigation, Model-Based Reinforcement Learning, Human-Robot Interaction, Assistive Technologies for the Visually Impaired},