▶ Watch ↗AI Engineer World's Fair 202521:10
How Instacart transformed its search and discovery using an LLM-driven approach
Read the full talk →Key ideas
Scroll to read ↓Vinesh Gudla and Tejaswi Tenneti explain how conversion data, batch generation and careful evaluation made LLMs useful for grocery search and product discovery.
- Search must support both restocking and discovery1:15 ↗
- Broad queries, rare queries and discovery dead ends2:10 ↗
- Query understanding inherits the long-tail data problem4:09 ↗
- Ground category predictions in shopping behavior6:13 ↗
- Rewrite queries when a retailer cannot satisfy the original8:43 ↗
- Precompute outputs and keep live search inexpensive10:34 ↗
- Separate models can disagree about the same query11:56 ↗
- Give shoppers a useful next action13:17 ↗
- Plausible shopping lists still need behavioral context15:10 ↗
- Batch discovery generation, then rank the stored content17:04 ↗
- Evaluate correctness and product fit18:21 ↗
- Carry natural-language intent into retrieval and ranking19:24 ↗