Learning-Guided Search over Continuous Actions for Long-Horizon Robot Manipulation
Abstract: Despite recent advances in policy learning, long-horizon manipulation remains difficult because learned policies must avoid compounding errors while preserving future feasibility. While search-based planning can explicitly reason over future consequences, it becomes expensive in high-dimensional continuous action spaces. Classical Task and Motion Planning methods address this by introducing symbolic objects, relations, and abstractions for [...]
Exploring High-Level Goal Prediction for Hierarchical Imitation Learning in Robotic Manipulation
Abstract: Hierarchical imitation learning has become an effective approach for robotic manipulation: a high-level policy predicts a sub-goal end-effector pose, while a low-level policy executes the actions needed to reach it. This decomposition improves generalization and provides an interpretable interface, but the design of the high-level goal predictor remains an open question. This thesis studies [...]
Beyond Vision-Language-Action Models: Adapting, Steering, and Accelerating Generalist Robot Policies
Abstract: Generalist robot policies, vision-language-action models that combine a large pretrained vision-language model backbone with a diffusion or flow-matching action head, are increasingly capable, yet hard to deploy in the real world. Three gaps separate such a policy from a deployable one: a data gap (adapting to a new task still demands task-specific teleoperation data), an inference gap (the policy [...]
Carnegie Mellon University
Towards Scalable Robot Learning: From Teleoperation to Web-scale Data
Abstract: Humanoid robots operating in human environments must manipulate articulated objects under contact and kinematic constraints that human demonstrations do not satisfy. That mismatch makes the human--humanoid embodiment gap the central bottleneck for learning from human data: robot demonstrations are expensive and sparse, while human demonstrations inhabit a different state-action space and often violate robot [...]
Consistent Modeling of 4D Scenes for Perception and Generation
Abstract: A core challenge in vision is building representations that capture 3D scenes over time for both perception and generation. This thesis studies consistency across views, time, and modalities by moving from dense grid-based representations toward entity-centric scene representations that can be maintained across frames and used for interactive generation. The first part of the [...]