Improve individual outputs. We develop iterative refinement methods for compositional visual generation, enabling models to progressively refine their outputs using feedback from vision-language model critics. We study how different forms of test-time scaling — depth, breadth, and hybrid strategies — trade off accuracy, quality, and computational cost.

Improve the research process. We extend the feedback loop from individual generations to automated experimentation. Using LLM agents for machine-learning and robotic policy-learning tasks, we investigate whether ‘autoresearch’ agents can propose improvements, run experiments, learn from their outcomes, and accumulate experience that transfers across tasks.

Improve safety and oversight. As agents become increasingly autonomous within self-improvement loops, they may learn to mislead evaluators in pursuit of their objectives. We investigate lying in LLMs, identify internal mechanisms and representations associated with deception, and evaluate interventions to mitigate it.

Together, these directions frame self-improvement as a feedback loop involving generation, evaluation, revision, and learning. The thesis presents work toward making such loops more capable and trustworthy as they scale toward increasingly autonomous scientific discovery and recursive AI development, as envisioned in the AI 2027 scenario (https://ai-2027.com/).