Abstract: Robots must often make decisions in scenes containing many objects: they need to identify what is present, understand where objects are, predict how they will interact, and choose actions accordingly. Learning these capabilities directly from pixels is challenging, especially when the number and arrangement of objects can change from one scene to another. In [...]

Abstract:  Most cameras on robots today capture images without considering scene content. In contrast, animal eyes have fast mechanical movements that control how the scene is imaged in detail by the fovea, where visual acuity is highest. The prevalence of active vision during biological imaging, and the wide variety of it, makes it very clear [...]