AI Engineer topic

Speculative decoding

8 AI Engineer conference talks about Speculative decoding.

AI Engineer World's Fair 202619:17

Stop Renting Intelligence: The Train-to-Deploy Loop for Specialized AI — Fireworks AI

Jetashree Ravi

Open-weight models · Fine-tuning · Infrastructure & deployment

AI Engineer World's Fair 20261:50:10

Agents That Own Their Inference — Du'an Lightfoot & Khaja Omer, Akamai Technologies

Du’An Lightfoot · Khaja Omer

Local inference · Infrastructure & deployment · Inference

17:42

Is a Faster Model Actually Faster? Test the Whole Job — Morgan Suo, MiniMax

Morgan Suo

AI cost & performance · Evals · Transformers & attention

AI Engineer World's Fair 202622:46

How Inference Keeps Up with Our Insatiable Need for Tokens — Cerebras & Gimlet Labs

Daniel Kim

Inference · KV caching & prefix reuse · Distributed training & inference

AI Engineer World's Fair 202613:04

Same Model, Different Speed: Why Your Inference Provider Matters — FriendliAI

Yunmo Koo

Open-weight models · Coding agents · Infrastructure & deployment

AI Engineer NYC 2026 Online Talks13:20

Your GPU Neighbor Can Hear Your Model — Branislav Brzak, Stealthium

Branislav Brzak

AI security · Infrastructure & deployment · Speculative decoding

AI Engineer World's Fair 202615:17

Is Speculative Decoding Worth It? Profiling vLLM on NVIDIA Blackwell — Akamai

Sheilah Kirui

Speculative decoding · Inference

AI Engineer World's Fair 202659:58

What Is an Inference Engine, Anyway? — Charles Frye, Modal

Charles Frye

Infrastructure & deployment · Inference · Observability & reliability