▶ Watch ↗AI Engineer World's Fair 202616:11
Conference affiliation: DoorDash · 2026
Nachiket Paranjape develops machine-learning and AI evaluation infrastructure that gives product teams more control over model development and quality assessment. At AI Engineer World’s Fair 2026, he represented DoorDash’s AI Platform team as a software engineer contributing to its AI Evals initiative. With Swaroop Chitlur Haridas, he described how shared APIs, operator-built annotation tools and reviewable automated judges let product managers and operations teams turn their domain knowledge into improvements to AI products.
In fall 2016, Paranjape was an electrical-engineering graduate student at Columbia University. With three teammates, he built an E Shopping Assistant that compared prices across stores, sent shopping lists to a selected seller and connected the shopping application to a Raspberry Pi checkout kiosk. RFID tags let the kiosk retrieve purchase information. The prototype brought software and physical interfaces together around a complete shopping workflow.
At DoorDash, he contributed to the growth of Fabricator, a declarative feature-engineering framework. Practitioners describe features through configuration, while shared infrastructure handles their production, reducing the need to assemble each data-processing workflow manually.
By November 2023, Paranjape was leading ML Workbench on DoorDash’s Machine Learning Platform team. He co-authored an account of its development with product designer Archit Jha. The initiative began with a browser interface for testing models because manual testing had become difficult to scale. As adoption grew, users wanted to inspect models, predictions and features in the same workspace.
Paranjape and his collaborators used interviews with teams including Search, Ads and ETA to decide which workflows to build. Although their ambition covered the machine-learning lifecycle, user research led them to narrow the initial scope. The work combined infrastructure engineering with interface design: understanding how practitioners developed models helped the team choose which capabilities would make the platform useful.
His career also includes an engineering-lead role at Galileo, which named him among the judges for the November 2025 Daytona HackSprint. DoorDash also credits him with contributing to the evaluation process for its unified consumer memory platform, which supports personalization across machine-learning and generative-AI applications.
In his public writing about AI quality, Paranjape argues that product managers and Strategy & Operations teams should be able to improve agent performance directly. His joint presentation with Haridas explains how DoorDash put cross-functional evaluation into practice. Strategy and operations teams establish priorities and the quality bar; product teams translate requirements into rubrics and workflows; operations teams annotate examples; engineers provide telemetry, datasets, APIs and automated judges.
Those responsibilities connect through a repeated evaluation loop. Teams capture agent traces and sessions, sample examples for review, annotate them with domain expertise and review the resulting judgments. The reviewed examples become golden datasets: reference cases used to measure performance and calibrate automated judges. Monitoring supplies further examples for the next round. This makes human review an ongoing input to quality assessment rather than a one-time labeling task.
Paranjape and Haridas reported lower per-annotation costs and faster iteration from these workflows, without supplying numerical results in the provided recording. The practical connection to ML Workbench is clear: both efforts make shared infrastructure useful by giving practitioners accessible ways to perform their own work. In evaluation, that means letting the people who understand a product’s quality requirements help define, test and improve the systems that judge it.
▶ Watch ↗AI Engineer World's Fair 202616:11
Loading more talks and highlights…