Learning From History: Test-Time Verification and Adaptation for Robotics
Abstract: The physical properties and dynamics that decide how an object or environment responds to a robot's actions are often impossible to determine from visual observation alone. An object's mass distribution and friction, the kinematics of an articulated object: these latent factors dictate the correct action, yet they leave little or no trace in a single [...]
View Generalizable Manipulation Policies via Sim-to-Real Transfer
Abstract: Visual imitation learning is a promising approach to training robot manipulation policies capable of completing a wide variety of tasks. A key requirement for these manipulation policies is to exhibit robust generalization capabilities when deployed in the real world, where the objects, scenes, and sensors a robot encounters differ from those seen during training. In [...]
Learning-Guided Search over Continuous Actions for Long-Horizon Robot Manipulation
Abstract: Despite recent advances in policy learning, long-horizon manipulation remains difficult because learned policies must avoid compounding errors while preserving future feasibility. While search-based planning can explicitly reason over future consequences, it becomes expensive in high-dimensional continuous action spaces. Classical Task and Motion Planning methods address this by introducing symbolic objects, relations, and abstractions for [...]
Exploring High-Level Goal Prediction for Hierarchical Imitation Learning in Robotic Manipulation
Abstract: Hierarchical imitation learning has become an effective approach for robotic manipulation: a high-level policy predicts a sub-goal end-effector pose, while a low-level policy executes the actions needed to reach it. This decomposition improves generalization and provides an interpretable interface, but the design of the high-level goal predictor remains an open question. This thesis studies [...]
Beyond Vision-Language-Action Models: Adapting, Steering, and Accelerating Generalist Robot Policies
Abstract: Generalist robot policies, vision-language-action models that combine a large pretrained vision-language model backbone with a diffusion or flow-matching action head, are increasingly capable, yet hard to deploy in the real world. Three gaps separate such a policy from a deployable one: a data gap (adapting to a new task still demands task-specific teleoperation data), an inference gap (the policy [...]
Carnegie Mellon University
Towards Scalable Robot Learning: From Teleoperation to Web-scale Data
Abstract: Humanoid robots operating in human environments must manipulate articulated objects under contact and kinematic constraints that human demonstrations do not satisfy. That mismatch makes the human--humanoid embodiment gap the central bottleneck for learning from human data: robot demonstrations are expensive and sparse, while human demonstrations inhabit a different state-action space and often violate robot [...]
Consistent Modeling of 4D Scenes for Perception and Generation
Abstract: A core challenge in vision is building representations that capture 3D scenes over time for both perception and generation. This thesis studies consistency across views, time, and modalities by moving from dense grid-based representations toward entity-centric scene representations that can be maintained across frames and used for interactive generation. The first part of the [...]