AI Engineer topic

KV caching & prefix reuse

9 AI Engineer conference talks about KV caching & prefix reuse.

AI Engineer World's Fair 202621:47

KV Cache-Aware Routing and P/D Disaggregation on Kubernetes — Yuchen Fama & Ashish Kamra, Red Hat

Yuchen Fama · Ashish Kamra

KV caching & prefix reuse · Inference · Distributed training & inference

AI Engineer World's Fair 20261:50:10

Agents That Own Their Inference — Du'an Lightfoot & Khaja Omer, Akamai Technologies

Du’An Lightfoot · Khaja Omer

Local inference · Infrastructure & deployment · Inference

AI Engineer Code 202520:32

What Makes Open Models Fast in Production — Sujee Maniyam, Nebius

Dylan Bristot · Sujee Maniyam

Infrastructure & deployment · Fine-tuning · Open-weight models

1:28:12

Deep dive on LLM Inference at Scale — Harshul Jain, Audible & Tanmay Sah, Independent AI Researcher

Harshul Jain · Tanmay Sah

Inference · KV caching & prefix reuse · Quantization

AI Engineer World's Fair 202622:46

How Inference Keeps Up with Our Insatiable Need for Tokens — Cerebras & Gimlet Labs

Daniel Kim

Inference · KV caching & prefix reuse · Distributed training & inference

AI Engineer World's Fair 202613:04

Same Model, Different Speed: Why Your Inference Provider Matters — FriendliAI

Yunmo Koo

Open-weight models · Coding agents · Infrastructure & deployment

AI Engineer World's Fair 202659:58

What Is an Inference Engine, Anyway? — Charles Frye, Modal

Charles Frye

Infrastructure & deployment · Inference · Observability & reliability

AI Engineer NYC 2026 Online Talks11:12

How to Actually Tokenmaxx and Save Millions — Alvin Pane, OutRival

Alvin Pane

Agent engineering · Observability & reliability · Evals

AI Engineer World's Fair 202647:25

Turning My Obsidian Vault Into a Local AI Engineer — Filip Makraduli, Superlinked

Filip Makraduli

Document understanding & OCR · MCP · Infrastructure & deployment