▶ Watch ↗AI Engineer World's Fair 202615:53
Conference affiliation: DigitalOcean · 2026
Tyler Gillam is a software engineer who helped build DigitalOcean’s Inference Router, which selects language models for individual requests according to the task, cost, latency, and developer preferences. His work gives application builders practical controls over a consequential decision: which model should handle each step, and how to tell whether that choice improves the finished work.
Gillam’s engineering practice connects developer needs with product delivery. He meets developers, translates their problems into product ideas, and helps build and launch features. In inference routing, that means turning application requirements into settings developers can inspect, test, and revise. Code generation, bug fixing, and test writing can have different model pools and priorities, even within the same coding-agent session.
Gillam argues that automatic routing becomes frustrating when it behaves like a black box: a poor selection leaves the developer with little ability to improve the next decision. His approach emphasizes developer-controlled routing, with explicit task descriptions, eligible models, and selection policies that can change as a team learns what works.
DigitalOcean’s routing architecture combines Plano’s open-source proxy with a purpose-built routing model. Gillam helped build parts of the router, contributing to infrastructure designed to let developers inspect and adapt routing decisions without depending on an opaque, locked-in selector.
The configuration separates task matching from model selection. Developers describe a task in natural language, define the models eligible to perform it, and specify how to choose among them. A manually ordered pool can favor one model and fall back to another when it fails. A speed-oriented policy can instead select the model with the fastest recent responses. This makes preferences operational: they determine how requests move through the application.
Gillam’s practical contribution is especially clear in the coding workflow he configured inside OpenCode. He connected routing controls to evaluation and a working agent, making the consequences visible at several levels:
Gillam emphasizes a continuing improvement loop: route requests, evaluate the resulting work, adjust the configuration, and repeat. His distinctive emphasis is on making model selection something developers can improve inside their own applications. Explicit controls provide ways to change behavior; evaluation helps determine whether those changes are useful.
▶ Watch ↗AI Engineer World's Fair 202615:53
Loading more talks and highlights…