▶ Watch ↗AI Engineer World's Fair 202518:59
How Intuit uses LLMs to explain taxes to millions of taxpayers
Read the full talk →Key ideas
Scroll to read ↓TurboTax combines prepared prompts, retrieval, tax experts and layered evaluations to explain personal tax outcomes while keeping calculations in its tax engine.
- Explain the tax outcome0:16 ↗
- Shared infrastructure for a regulated product1:37 ↗
- Prepared explanations and open-ended questions3:03 ↗
- Tax experts write prompts and establish the baseline5:52 ↗
- Fine-tuning to reduce the instruction burden7:25 ↗
- Evaluate the answer and the evaluator8:29 ↗
- Contracts and latency shape the product10:09 ↗
- How much evaluation does a prompt change need?12:30 ↗
- Route questions by what the user needs13:57 ↗
- Keep calculated numbers separate from generated language15:13 ↗
- Personalization matters beyond retrieval choice16:42 ↗
- Assurance depends on the scope of the explanation17:49 ↗