We are developing reliable, highly autonomous systems (especially mobile robots) that operate in rich, uncertain environments. The goal is to create intelligent systems that can operate autonomously for long periods of time in unstructured, natural environments. This necessitates robots that can plan, effectively reason about uncertainty, diagnose and recover from unanticipated errors, and reason about their limitations. In particular, we are interested in architectures for autonomy that combine deliberative and reactive behavior, reliable execution monitoring and error recovery, multi-robot coordination, probabilistic and symbolic planning, formal verification of autonomous systems, and human-robot social interaction.