AI Engineer World's Fair 2024

Hypermode Launch

Loading slides…

Read the talk

Hypermode Launch

Rapid AI iteration depends on reversible choices: replaceable models, familiar APIs, observable inference, and fewer services to coordinate on the retrieval path.

From a talk by Kevin Van Gundy

Learning faster above a pizzeria

Kevin Van Gundy recalls three problems from his time at Vercel, when the company had an office above a pizzeria. It was losing to other JavaScript frameworks, losing badly to other hosting providers, and he was losing to a diet consisting exclusively of pepperoni pizza.

Three panels show figures carrying large blocks labeled JavaScript Frameworks and Hosting Providers, followed by a giant pepperoni pizza.Open full source frame
Three opening problems: JavaScript frameworks, hosting providers, and pepperoni pizza.

The turnaround, in his telling, came from developing the ability to iterate quickly. Without knowing the optimum strategy, the team could try more things, discover what the market wanted, and adapt its products accordingly. “Iteration is the compound interest of software.” Repeated experiments eventually revealed two developer preferences: adopt new technology incrementally, and defer architectural commitments until the application's behavior is better understood.

0:000:16
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

0:00 · section reference included

Make the wrong choice recoverable

That experimentation stops when developers are afraid of getting things wrong. Generative AI adds a long chain of decisions: hardware, model, prompt, integration, monitoring, and improvement. The consequences are familiar—runaway bills, hallucinating chatbots, and projects that consume months without delivering value. A system that supports iteration must reduce the cost of mistakes, because mistakes will happen repeatedly.

Van Gundy identifies three ways to make those decisions easier to revisit:

  • Model replacement: choosing the wrong model becomes less consequential when switching it out introduces little friction.
  • Shared APIs: classical software and AI components become easier to integrate when they use the same interfaces.
  • Inference tracing: following inference step by step gives developers visibility when changing prompts, strategies, or the mix of data supplied to a model.

Together, these mechanisms make changes easier to attempt and their effects easier to inspect.

1:221:26
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

1:22 · section reference included

Start with an AI function

Hypermode's proposed entry point is a runtime that integrates models and data into AI functions. The goal is to let developers add AI to an application without first acquiring specialized skills. Around that runtime, Hypermode supplies tools for rapid iteration and observation of functions in production. A team can begin with an incremental feature, develop its skills, and then reconsider the broader application as AI-native. The initial integration does not require making that larger architectural commitment upfront.

2:192:29
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

2:19 · section reference included

Put model guidance in the editor

Even adding one model can involve unnecessary documentation work. Van Gundy uses temperature as the example: does a model expect a value from 0–2, 0–1, or 1–10? The developer needs that information while configuring the model. Hypermode's launch-era promise was typeahead in the developer's preferred editor, out of the box, with no SDKs or downloads. This describes the workflow presented at the launch, rather than current installation guidance. The editor popup on the slide illustrates bringing parameter documentation directly into that workflow.

Black slide with the text “Hundreds of models. One interface.” and an editor popup showing temperature documentation.Open full source frame
“Hundreds of models. One interface.” beside editor assistance for temperature.
2:563:02
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

2:56 · section reference included

Consolidate the retrieval path

For production, Hypermode offers strong defaults while also allowing teams to bring an existing stack. The concrete example is retrieval-augmented generation, or RAG: embedding an input and searching a vector store introduces additional service interactions into a previously simpler application request.

Van Gundy characterizes traditional RAG as requiring N+1 requests and says Hypermode consolidates that retrieval path into one request.

Retrieval pathCoordination described in the launch
Traditional RAGAdditional input-embedding call, then vector-store access
Hypermode RAGOne request using an in-memory embedding and search service

The consolidation concerns the embedding-and-search path; those operations still have to occur. Van Gundy reports a saving of a couple hundred milliseconds per request for this retrieval path. He supplies no benchmark configuration, baseline measurements, or latency percentile, so the magnitude cannot be assessed independently from the presentation.

Three stacked diagrams compare a legacy search request, traditional RAG with multiple service connections, and a green Hypermode function connected to a product database.Open full source frame
Request paths before AI, with traditional RAG, and with Hypermode RAG.
3:193:29
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

3:19 · section reference included

Build intuition by comparing outputs

Once the integration works, understanding its behavior remains difficult. Nondeterministic systems do not produce the same intuitive feedback as conventional software, and Van Gundy describes each model as having its own personality. Hypermode's comparison tools let developers examine different inferences, tunes, and models. The resulting dataset can then be exported for fine-tuning, connecting the work of inspecting outputs with a subsequent model-improvement step.

3:49
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

3:49 · section reference included

From a workshop demo to a production plan

The closing question is practical: what will attendees tell their boss on Monday about what they learned? Van Gundy invites them to the after-lunch Hypermode workshop, with the team that built the platform, to practice making iteration velocity a core competency. The proposed applications are natural-language search, intelligent sorting of product data lists, outlier detection, and identifying bad actors.

Workshop slide lists natural language search, intelligently sorting every data list in an application, and outliers and bad actors detection, with a time of 1:00pm–1:50pm at GGB A.Open full source frame
Hypermode workshop applications: natural language search, intelligent sorting, and outlier detection.

The workshop promise was a demo attendees could be proud of and a plan to put something similar into production by the end of the following month. Van Gundy also offered $1,000 in Hypermode credits to help attendees get started. These were offers made at the 2024 event. The intended next step was to carry a concrete application beyond the workshop, with a production plan that made continued iteration possible.

4:064:15
Suggest correction

This note stays in this page until you copy or download it. Nothing is submitted; reloading clears the draft.

4:06 · section reference included

Resources

From the talk

Updates since the talk

  • Hypermode's open-source framework for model-connected functions in Go and AssemblyScript, with setup instructions. Archived September 11, 2025.

Transcript download
Full transcript

Loading transcript…