▶ Watch ↗AI Engineer World's Fair 202616:41
Conference affiliation: CTO · Cua · 2026
Dillon DuPont is chief technology officer of Cua, where he develops open-source infrastructure for AI agents that operate computers. His work addresses a practical question behind autonomous software use: whether an agent can interpret an interface, execute the correct action, and prove it completed the task without breaking anything else.
DuPont studied computer science at MIT and worked on projects combining visual computing with physical interfaces. His augmented-reality circuit-design project ARRR.duino received the overall gold award at MIT Reality Hack 2022.
In 2023, he created GPT-4V-Act, a browser agent that translated screenshots and numbered interface elements into mouse-and-keyboard actions. At Microsoft, he contributed to Windows Agent Arena, an open-source desktop-agent benchmark published at ICML 2025. His contributions included webpage and accessibility-tree parsing, benchmark integration, and task evaluation.
DuPont joined Cua in May 2025. He subsequently built tools for recording human computer-use trajectories and developed composite computer-use agents that separate a model’s planning abilities from the visual grounding needed to locate interface elements.
▶ Watch ↗AI Engineer World's Fair 202616:41
Loading more talks and highlights…