# The Next Medium: Why Real-Time Interactive Video Changes Everything — Ahmed Ahres, Reactor

Ahmed Ahres

AI Engineer World's Fair 2026

[Talk page](https://ai.engineer/talks/5dCAmSDOAjI-next-medium-why-real-time-interactive-video) · [Video](https://www.youtube.com/watch?v=5dCAmSDOAjI)

## The Next Medium: Why Real-Time Interactive Video Changes Everything

Real-time video generation replaces the finished file with a session people can steer, creating new applications and new demands on streaming, memory, latency, and evaluation.

### What if you could change the video while watching it?

[0:31](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=31s)

A prompt produces a video file. You watch it, decide what you wanted differently, and try again. That is the workflow Ahmed Ahres contrasts with **real-time interactive video**. He uses *world models* to mean this live, steerable medium, rather than other uses of the term associated with techniques such as Gaussian splatting.

In the prompt-to-file workflow he describes, **Veo 3** and **Seedance 2** can generate impressive footage, but the returned recording cannot respond to you while it plays. The question is what happens when pixels become programmable like software: generated continuously, with inputs that can change what appears next.

![Slide contrasts passive video with programmable video and pixels generated in real time.](https://ai.engineer/api/talk-essay-media/d507a16fcf37b0d650368f6b86b68843c8d4e0b6afc35828bad7b9b9022690df)

What happens when video becomes programmable, like software?

Ahres introduces himself as Reactor’s head of go-to-market, with a background in computer vision and machine learning, experience as a founder, and a hobby of shipping iOS and Android games. He describes Reactor as a Series A company building the infrastructure and developer platform that make these models accessible to application builders. The underlying problem is straightforward: generating a recording does not make it interactive. **Real time changes the medium, not just the speed of production.**

### Immediate feedback creates different applications

[2:59](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=179s)

A printed map gives you a representation someone prepared earlier. GPS adds a continuously updated position: you can see where you are and track movement. In Ahres’s analogy, the consequence is larger than locating yourself faster. Live location becomes an input to an application such as Uber.

Photography supplies a second feedback loop. With film, you shoot first and see the developed result later. A digital camera or iPhone shows what you are recording as you record it, letting you adjust the shot immediately. Ahres connects that ability to the quality of everyday content creation and, in turn, to Instagram and TikTok, while acknowledging that other factors contributed. The useful mechanism is the shortening of the loop between **action, observation, and adjustment**.

![Three connected cards labeled Film you sent away, The live viewfinder, and TikTok and Instagram beneath a heading about seeing in real time.](https://ai.engineer/api/talk-essay-media/64fd34fe0e0417c08e7c6ea52c7ebf8265a03cc39d8f0670a93c4e730c320333)

From film to the live viewfinder to TikTok and Instagram.

### Steering a continuing video

[4:24](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=264s)

Programmable video can be addressed, conditioned, and changed. The first model category resembles Veo or **Sora**, but with a continuing stream instead of a fixed-duration result. Ahres describes three properties together: generation continues, inputs can alter it, and the viewer sees the output as it is generated. His description of an infinite stream concerns continuing generation; it does not establish unlimited reliable memory.

The demonstration starts with an image of a dog. While the video continues, Ahres introduces the prompt “A cat shows up” and describes a cat appearing in the generated scene. The intervention happens during generation, rather than requiring a replacement for an already returned file. He then proposes further directions—a running or jumping dog, a dragon arriving, a trip to the World Cup—as possible continuations of the story. Those are suggestions, not additional demonstrated outcomes.

For creators, this feedback loop addresses a familiar complaint: the model can produce a compelling image, yet still resist the specific change the filmmaker wants. Ahres summarizes the appeal as “Instant feedback is the ultimate level of control.” The creator can observe the developing result and steer again, instead of relying entirely on the initial prompt.

Advertising follows from the same mechanism. Recent search interest could condition a logo inserted into a scene or an advertisement generated during viewing. Ahres is personally unenthusiastic about that application but expects it to grow. He also identifies an adoption barrier: brands care about exact visual identity, down to an incorrectly colored logo pixel. His eventual disappearance of preproduced ads is a forecast, contingent on overcoming that sensitivity.

### Navigable worlds and live characters

[7:06](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=426s)

The second category is a controllable world, exemplified by Google’s [**Genie 3**](https://deepmind.google/blog/genie-3-a-new-frontier-for-world-models/). An image and, typically, text establish the environment; the user then controls a character within it. Games are the obvious application, but combining navigation with steerable video also creates experiences between games and movies. Ahres reports community projects exploring that combination. Netflix’s *Bandersnatch*, where viewers select the next scene, supplies a familiar analogy for audience agency.

Controllable simulation also suggests applications beyond entertainment:

- **Robotics:** Vary an environment and the actions within it to generate training data. Ahres describes substantial activity among robotics labs and the prospect of effectively unlimited simulated examples.
- **Education:** Place a learner inside a situation, such as a historical setting, rather than only describing it. This reflects his preference for experiential learning over a future centered on textbooks or LLM conversations.

The third category is the **live interactive avatar**. Ahres acknowledges that existing avatars, including those used for customer support, often feel strange or unconvincing. He expects emerging research-preview models to become more useful when combined with continuing video generation and controllable environments. Proposed applications include customer support, training, sales, gaming, and streaming services.

### Applications built around audience input

[9:39](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=579s)

An interactive livestream makes the control loop visible. Viewers propose what should happen next, vote, and influence the continuing video. Ahres reports Reactor users building this kind of experience, with X, YouTube, and Twitch as possible distribution surfaces. The application coordinates collective input; the model generates the next visible development.

The vote-selection step can be kept separate from model integration. This JavaScript function accepts a map from viewer IDs to their current choices, so each viewer contributes one active vote. It returns a proposed next prompt; sending that prompt to a live session is a separate operation.

```javascript
function selectNextPrompt(votesByViewer) {
  const counts = new Map();

  for (const choice of votesByViewer.values()) {
    const prompt = choice.trim();
    if (!prompt) continue;
    counts.set(prompt, (counts.get(prompt) ?? 0) + 1);
  }

  const ranked = [...counts.entries()].sort(
    ([promptA, countA], [promptB, countB]) =>
      countB - countA || promptA.localeCompare(promptB)
  );

  return ranked[0]?.[0] ?? null;
}
```

Here, equal vote counts use alphabetical order as a simple application policy. The result remains a selection until the application submits it to generation.

Other reported projects apply the same input-and-response pattern to different activities:

- **Medical simulation:** Add or remove a medicine and explore what happens next as a training playground for aspiring doctors. These are reported application concepts, not evidence of clinical validity.
- **Cooking simulation:** Add an ingredient and inspect the generated result.
- **Video editing:** Use video-to-video generation to add visual effects while editing through prompts, speech, or clicks.

Ahres says the editing platforms are not yet very good because model quality remains limited. Their significance is the interaction pattern: a user directs changes while seeing the developing output.

### Four models behind the API

[10:59](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=659s)

Reactor’s platform presentation turns those interaction patterns into four model choices:

| Model | Intended workflow |
|---|---|
| [**Helios**](https://arxiv.org/abs/2603.04379) | Interactive video generation |
| [**LingBot-World**](https://github.com/robbyant/lingbot-world) | Navigable generated worlds |
| [**LongLive 2**](https://github.com/NVlabs/LongLive) | Multiple shots forming a continuing film |
| [**SANA-Streaming**](https://arxiv.org/abs/2605.30409) | Live video-to-video editing |

Ahres attributes Helios to ByteDance and describes LingBot as Alibaba’s Genie-like model; the LingBot repository credits the Robbyant Team. He identifies LongLive 2 and SANA-Streaming as NVIDIA models. With LongLive 2, prompts can be prepared in advance to guide a consistent story across shots.

![Four cards map Helios to interactive video, LingBot to navigable worlds, LongLive-2.0 to multi-shot film, and SANA-Streaming to live video editing.](https://ai.engineer/api/talk-essay-media/7f9f1c50786dc3485953835d47b537b662365c662c2e2fb3334a85fcd5cbe9f7)

Four models on one platform: Helios, LingBot, LongLive-2.0, and SANA-Streaming.

SANA-Streaming starts with existing footage rather than generating every element from scratch. A creator can upload recorded video or a Seedance 2 result, then add effects, remove people, or change the background. Ahres points to Hollywood previsualization as a useful setting for that workflow: explore a scene’s visual treatment before committing to its final production.

### A live session is not a batch job

[11:51](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=711s)

Batch video generation can be simplified to a request, a cloud job, and a returned file. A live model needs infrastructure that keeps serving an evolving experience.

| Concern | Batch generation | Live generation |
|---|---|---|
| Unit of work | Request or job | Continuing session |
| Delivery | Completed file | Streamed video |
| State | Bounded generation task | Context retained across interaction |

Streaming pixels from a server to a client adds delivery concerns that a file-returning workflow can avoid. Keeping the session running also makes memory a continuing responsibility.

Scene memory is a model limitation as well as a systems concern. Ahres recalls Genie 3 demonstrations where a character looks back and the world fails to preserve what was previously there. Turning left and then right should not casually replace the environment. Maintaining enough context to preserve that continuity remains difficult; a continuing stream alone does not solve it.

Geography adds another constraint. Ahres sets sub-100-millisecond latency worldwide as a requirement for the experience, not a measured Reactor service guarantee. A user in India or Japan should reach a GPU in that country or as close as possible. If compute is too distant, the delay interrupts the feedback loop that makes the medium interactive. Network latency, generated frame rate, and the time until an input visibly changes the scene are separate quantities; a single latency number cannot describe all three.

### Connecting an application to the stream

[13:35](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=815s)

The developer-facing goal is to hide much of that infrastructure behind a small integration. Ahres estimates roughly ten lines of code, while acknowledging that the example is simplified. The basic sequence is to authenticate, load a model, and connect its output and controls to a video application, image workflow, or plugin. The slide shows the intended compact integration rather than the full operational responsibilities of an application.

![Developer-first slide pairs an explanation of connecting and streaming a world with a short code example; the presenter points toward it.](https://ai.engineer/api/talk-essay-media/da97b549e4978058c0513c0f53f639a0c9529f8c61945a8a962249e61e9c9880)

A few calls to a living world.

For onboarding, the talk offers a signup QR code and the promotion code `AIE2026` for $75 in credits. That is the offer made during the presentation; its continued availability is not established here. Ahres also characterizes the platform’s models as inexpensive, without supplying a cost comparison.

### Frame rate, broadcasting, and simulation rules

[14:28](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=868s)

An audience member cites a stated 16 FPS for the game generator and asks what it would take to reach 30 FPS. Ahres names three approaches: multiple GPUs, model-weight optimization, and quantization. He frames the work as a matter of priorities, without reporting an achieved 30 FPS result.

A subsequent question suggests showcasing the technology at IBC, the International Broadcasting Convention in Amsterdam. Ahres says he was unfamiliar with the event and had not planned a showcase, but would look into it. The exchange connects the proposed medium to an existing industry concerned with producing and distributing video.

The next question asks about deterministic grounding: checking generated simulations against rule sets so that their behavior stays constrained. Ahres says Reactor does not provide those checks itself. He reports developers building such layers on the platform, open-sourcing them, and Reactor reusing community work. The division of responsibility is explicit: Reactor concentrates on the substantial infrastructure workload, while application builders can add rules that constrain a particular simulation.

### How do you know the world stayed consistent?

[16:28](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=988s)

The final substantive question concerns measurement: how should visual consistency be evaluated? Ahres distinguishes fidelity, which he considers comparatively easy to assess, from the broader challenge of evaluating an interactive world over time. He acknowledges evaluations for real time, consistency, and fidelity, but describes overall evaluation as unsolved and current assessment as heavily dependent on looking at the result and applying human judgment.

That should not be read as an absence of quantitative evaluation. The [LingBot-World paper](https://arxiv.org/html/2601.20540v1) reports VBench evaluation, including temporal and consistency measures, while acknowledging that world-model evaluation protocols remain immature. Existing video metrics and a solved general test for interactive worlds are different things. Ahres’s claim that nobody, including DeepMind, has solved the broader problem is his assessment of that research gap.

Asked what Reactor is doing about it, Ahres says its research team is working on the problem, without describing a method. The presentation therefore ends with an open engineering question: once users can act inside a generated stream, the system must be judged not only by how its frames look, but by whether the experience remains coherent as those actions accumulate.

## Resources

- [Helios research paper](https://arxiv.org/abs/2603.04379) — The autoregressive video-generation model's design, long-video training approach, and reported single-H100 performance.
- [Build with Helios on Reactor](https://www.reactor.inc/models/helios/api) — Current session setup and commands for steering a continuing video stream with prompts and reference images.
- [LingBot-World: Advancing Open-source World Models](https://arxiv.org/html/2601.20540v1) — Action-conditioned world generation, streaming distillation, memory demonstrations, and quantitative video evaluation.
- [LongLive research code](https://github.com/NVlabs/LongLive) — NVIDIA's long-video generation infrastructure, including multi-shot support and quantized inference.
- [LongLive 2 on Reactor](https://www.reactor.inc/models/longlive-v2/api) — Current API examples for scheduling shots, making hard cuts, and managing a continuous multi-shot session.
- [SANA-Streaming research paper](https://arxiv.org/abs/2605.30409) — Streaming video editing through a hybrid diffusion transformer, consistency training, and GPU optimizations.
- [Google DeepMind's Genie 3 announcement](https://deepmind.google/blog/genie-3-a-new-frontier-for-world-models/) — The original overview of navigable generated worlds, promptable events, agent experiments, and acknowledged limitations.

## Slides

### Real-time interactive video changes everything for developers

Ahmed Ahres defines world models as real-time interactive video and believes they will change how people produce and consume content.

[0:25](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=25s) [Reactor title slide introducing real-time interactive video for developers.](https://assets.ai.engineer/sites/aiecode2025/sha256/4273d2e5798fa7119f341a92122508d10edb42cf6d36f545a19a0e27f812547d.webp)

THE NEXT MEDIUM

Real-time interactive video changes everything for developers.

REACTOR
AI ENGINEER WORLD'S FAIR · 2026

### What happens when video becomes programmable?

Ahres contrasts generated video files viewers cannot change with the possibility of generating pixels in real time, asking what video programmable like software could enable.

[1:31](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=91s) [The slide contrasts passive video with video programmable like software when pixels can be generated in real time.](https://assets.ai.engineer/sites/aiecode2025/sha256/8bf94f0cb3620811c25f555b2424be0408bc654769c255f1efacc6c2a5d25739.webp)

THE STORY SO FAR

Video has always been passive.

What happens when it becomes programmable, like software?

When pixels can be generated in real time.

### Ahmed Ahres, Head of GTM at Reactor

Ahmed Ahres brings experience in computer vision, games and founding to Reactor, which he says is building a developer platform for integrating real-time interactive video.

[2:20](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=140s) [Ahmed Ahres’s background in computer vision, machine learning, games and founding, alongside his portrait and a description of Reactor’s real-time world model platform.](https://assets.ai.engineer/sites/aiecode2025/sha256/d7e9452649aa30581f19282ef6bcb53a86544022bf75d056a40cebc49c8e8458.webp)

WHO'S TALKING

Ahmed Ahres
Head of GTM, Reactor

Background in Computer Vision & Machine Learning (ex-Revolut).

Built and shipped games on iOS & Android for fun.

Former founder backed by a16z Speedrun.

Today, Head of GTM @ Reactor.

Reactor is a Series A company building the platform for real-time world models, democratizing access to this technology.

### We can generate anything

Ahres introduces the problem: generated video returns as a recording you cannot change, while real-time interaction changes the medium itself.

[2:41](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=161s) [Section slide stating that generated content cannot be changed.](https://assets.ai.engineer/sites/aiecode2025/sha256/65989aa4313701faf3bd054df903fc43b28d0bb21f64f7a8b49b861ddce175d3.webp)

01
/ 01   THE PROBLEM

We can generate anything. We just can't change it.

### Generated video is a recording

A video player sits at the end of its clip, illustrating the speaker’s point: once generated video renders, the viewer cannot change its frames.

[2:46](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=166s) [Text explains that a generated video is finished when rendered, beside a video player at its end.](https://assets.ai.engineer/sites/aiecode2025/sha256/db7497d0882b7f6ce1854760172b37110682f24e699ffd70d95f91b35a9badc2.webp)

THE PROBLEM

Generated video is a recording.

However stunning the clip, it is finished the moment it renders, so the story is over before you arrive and nothing you do can change a single frame of it.

It has played all the way to the end, and there is nowhere else for you to go.

Interface text:
00:08  00:08

### Real-time changes the medium

Ahres argues that real-time video changes the medium itself, rather than simply making generated recordings faster.

[2:53](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=173s) [Section slide stating that real time changes what the medium is.](https://assets.ai.engineer/sites/aiecode2025/sha256/40cf3ede8c2767df5d0d0b0683265542533fbfbbfd832caaf23147fe7bb5f248.webp)

Real-time changes what the medium is.

02
/ 02 — THE SHIFT

### A map is a recording; GPS is alive

GPS turns a fixed map into a live location that moves with you, enabling services such as Uber and live navigation.

[3:25](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=205s) [Three cards connect paper maps, live location, and on-demand services.](https://assets.ai.engineer/sites/aiecode2025/sha256/add62d9c7d8f398b99ef052f721d1c41d6a2b5905692831b29b1e9dc0ce7029e.webp)

A PRECEDENT

A map is a recording. GPS is alive.

RECORDING
The paper map
It is accurate, beautiful, and completely fixed, telling you where things are but nothing about what is happening right now.

→

REAL-TIME
Live location
The dot moves with you, and the map starts responding to the world as it actually changes around you.

→

NEW CATEGORY
On-demand everything
Uber, delivery, and live navigation were none of them possible on paper, because real-time location was the thing that unlocked them all.

### You can't create what you can't see in real time

Ahres argues that live viewfinders let creators adjust shots as they record, helping pave the way for Instagram and TikTok.

[3:29](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=209s) [A photography precedent slide shows a card about sending film away for development.](https://assets.ai.engineer/sites/aiecode2025/sha256/d9b3ded18d9cba99d8f0c9d0ebcd400fb370303f0b8eb02c71953a1e9e42ca57.webp)

A PRECEDENT, CLOSER TO HOME

You can't create what you can't see in real time.

RECORDING
Film you sent away
You shot the photo blind and waited days for it to develop, never quite sure whether you had captured the moment at all.

→

→

[4:00](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=240s) [Three cards trace a progression from developed film to a live viewfinder to TikTok and Instagram.](https://assets.ai.engineer/sites/aiecode2025/sha256/7b177db9d8e362b9d37eb7f04f8baa80bb49a8b6abe575a74c5e516dd8e86af7.webp)

A PRECEDENT, CLOSER TO HOME

You can't create what you can't see in real time.

RECORDING
Film you sent away
You shot the photo blind and waited days for it to develop, never quite sure whether you had captured the moment at all.

→

REAL-TIME
The live viewfinder
The screen shows the shot as you frame it, so you can adjust the angle and the light in the moment instead of guessing.

→

NEW CATEGORY
TikTok and Instagram
Seeing in real time is what turned everyone into a creator, and that is the foundation entire platforms were eventually built on.

### When video becomes programmable

Live-generated video can be changed through an API. The slide contrasts a fixed, read-only file with scene commands that change weather, place a product, and rewind.

[4:25](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=265s) [Text explains live video as software, alongside a panel contrasting a finished file with programmable scene commands.](https://assets.ai.engineer/sites/aiecode2025/sha256/fabc6e824f0d5695194c23220a7fd9d8e036fc2ef65d83cd520ae4ab9c4d3162.webp)

THE DEEPER SHIFT

When video becomes programmable.

Once pixels are generated live, video stops being a finished asset and starts behaving like software.

You can address it, condition it, and change what is on screen through an API, and anything that becomes programmable ends up being used in ways nobody planned for.

A FINISHED FILE
scene.mp4
fixed · 00:08 · read-only

A LIVE SURFACE
scene.set("weather", "storm");
scene.place(product, here);
scene.rewind("2s");

### 3 kinds of models we are seeing

The talk turns to three kinds of models for programmable video, some familiar and others less familiar.

[4:37](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=277s) [Section 03 title: 3 kinds of models we are seeing.](https://assets.ai.engineer/sites/aiecode2025/sha256/c8416e3018e7d20a012011c457419f463f6692cec98cc8c71507795484b3a07d.webp)

3 kinds of models we are seeing

03
/ 03 — 3 KINDS OF MODELS

### Veo and Sora, but live and interactive

Helios is presented as a video stream that keeps generating, can be edited or rewound, and responds in real time. A paused puppy clip introduces the demo.

[4:46](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=286s) [The slide describes infinite, interactive, real-time video generation beside a paused image of a puppy.](https://assets.ai.engineer/sites/aiecode2025/sha256/83663df61a33148d1dba265f1d60419e15af7c5ad73d2f04d440feeeb473305a.webp)

MODEL TYPE 01
AT REACTOR · HELIOS

Veo and Sora, but live and interactive.

The familiar text-to-video generator stops being a slot machine you prompt and wait on, and becomes a stream you steer as it plays.

INFINITE
The stream does not stop after 20 or 30 seconds, it keeps generating for as long as you want it to.

INTERACTIVE
You can edit what is happening on screen and rewind to change a moment you did not like.

REAL TIME
There is no waiting for a render, you see the output the instant you ask for it.

### Live video demo: a cat appears

Ahres describes prompting a cat to appear in a real-time video generated from a dog image. A cat appears beside the puppy and walks into the foreground.

[5:10](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=310s) [A puppy sits outside a house as a cat appears beside it in the video panel.](https://assets.ai.engineer/sites/aiecode2025/sha256/cea96da05f13ae5672fe8987a512028796a452ce26663fa9f3924ebb8d5e3afe.webp)

MODEL TYPE 01
AT REACTOR · HELIOS

Veo and Sora, but live and interactive.

The familiar text-to-video generator stops being a slot machine you prompt and wait on, and becomes a stream you steer as it plays.

INFINITE
The stream does not stop after 20 or 30 seconds, it keeps generating for as long as you want it to.

INTERACTIVE
You can edit what is happening on screen and rewind to change a moment you did not like.

REAL TIME
There is no waiting for a render, you see the output the instant you ask for it.

[5:21](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=321s) [Slide describing infinite, interactive, real-time video beside a puppy and cat.](https://assets.ai.engineer/sites/aiecode2025/sha256/7b223900d9e275ddf12921baad5ef3773a046f0d20f581917b42e3ebefb1587f.webp)

MODEL TYPE 01
AT REACTOR · HELIOS

Veo and Sora, but live and interactive.

The familiar text-to-video generator stops being a slot machine you prompt and wait on, and becomes a stream you steer as it plays.

INFINITE
The stream does not stop after 20 or 30 seconds, it keeps generating for as long as you want it to.

INTERACTIVE
You can edit what is happening on screen and rewind to change a moment you did not like.

REAL TIME
There is no waiting for a render, you see the output the instant you ask for it.

### Programmable content, and real control

Ahres argues that real-time feedback gives creators more control over generated content, ending the “slot machine” mentality of prompting and waiting.

[5:46](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=346s) [Slide explaining that instant feedback gives creators control over generated content.](https://assets.ai.engineer/sites/aiecode2025/sha256/03eeacdb25fcdc7082acfcf528e1e72390b330169de1aff75bcb6a84529f575b.webp)

WHAT TYPE 1 UNLOCKS
Programmable content, and real control.

CONTROL
The end of the slot machine

Great content has always come from instant feedback, and that is exactly what creators lack when they prompt and pray. Real time gives them the level of control the medium has been missing.

### A world you can walk into

A dragon-riding view illustrates a generated world the viewer can steer through. Ahres says these models typically take an image and text and let users control a character.

[7:04](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=424s) [Slide describing a steerable generated world beside a fantasy scene viewed from a dragon.](https://assets.ai.engineer/sites/aiecode2025/sha256/f47c5655b40e1d87d8f76eb2700fc5f018a79743993aea40e4837dcdd3e6fa4c.webp)

MODEL TYPE 02
AT REACTOR · LINGBOT

A world you can walk into.

This kind of model generates a world with a character that moves through it, the way Genie-style models do. You are not watching a scene from the outside, you are inside it, steering, and that makes it far more immersive than any clip.

Interface text:
W
A S D

### Far more than games

Type 2 models could generate worlds as players explore, simulate robot actions for training, and let students step into lessons such as historical moments.

[7:27](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=447s) [Heading introducing uses of the second model type beyond games.](https://assets.ai.engineer/sites/aiecode2025/sha256/5085988f448e7adbebdbc9ac4819661eb7450014a8183924f3aaf3bfb83f1b7b.webp)

WHAT TYPE 2 UNLOCKS
Far more than games.

[8:25](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=505s) [Three cards describe interactive experiences, robotics simulation, and education.](https://assets.ai.engineer/sites/aiecode2025/sha256/b8c5eec1fa037c3e31f2b203a5403ceebca657a088216481a29cd63e2c24d92e.webp)

WHAT TYPE 2 UNLOCKS
Far more than games.

EXPERIENCES
New interactive experiences
The world generates itself around the player as they explore, instead of being a level someone built by hand ahead of time.

ROBOTICS
Simulation as training data
Teams generate simulation and training data so a robot can try out a physical action and judge the outcome before it ever moves.

EDUCATION
Step into the lesson
Learn electricity alongside a character you love, or walk through a historical moment as it unfolds around you, instead of reading about it.

### Avatars that finally feel real

Ahres sees live, interactive avatar models emerging in research previews. He expects applications in customer support, training and sales, though he says existing avatars still feel off.

[8:54](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=534s) [An avatar appears beside text about live conversation, customer support, training, and sales.](https://assets.ai.engineer/sites/aiecode2025/sha256/778b883217789f4d66fd0502955d3c7c477cf9f2343aac4bb99925fb504b6449.webp)

MODEL TYPE 03

Avatars that finally feel real.

People have talked about avatars for over a decade, and they always sat in the uncanny valley. Real-time interactive avatars are finally crossing that line, and once one can hold a live conversation, a lot of everyday products change.

Customer support
Training
Sales

### What our users are building today

Reactor’s private beta users are building livestreams where viewers vote on what happens next, alongside medical and cooking simulations and video editing. Ahres says editing quality is still limited.

[9:42](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=582s) [A private beta example shows an interactive livestream in a generated world.](https://assets.ai.engineer/sites/aiecode2025/sha256/3edc75b77a76cd3422a950875da0c6ccd9fd2739f01c0a8a804324d088c74c33.webp)

FROM THE PRIVATE BETA
What our users are building today.

INTERACTIVE LIVESTREAM
You generate an image and start navigating inside the world that grows around you as you move.

Interface text: [illegible]

[10:31](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=631s) [Four private beta examples: interactive livestream, medical simulation, cooking simulation, and video editing.](https://assets.ai.engineer/sites/aiecode2025/sha256/308058cae99d231e164088012005ccabcec02e824e7148c39db4fa32a141dda8.webp)

FROM THE PRIVATE BETA
What our users are building today.

INTERACTIVE LIVESTREAM
You generate an image and start navigating inside the world that grows around you as you move.

MEDICAL
Teams build interactive training simulations and visualize procedures live as they unfold.

COOKING SIMULATION
Learners step inside a live cooking class, following each step in a kitchen that reacts to what they do in real time.

VIDEO EDITING
Editors work with footage that regenerates and responds to their direction as they cut the sequence.

Interface text: [illegible]

### The world, behind an API

Reactor introduces an API for adding real-time video to products without managing GPUs or building a streaming stack.

[10:56](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=656s) [Section slide introducing real-time video through an API without managing GPUs or a streaming stack.](https://assets.ai.engineer/sites/aiecode2025/sha256/5c177fe946ae4e6a4b3245dfb571d07aafdc464f033d06048c4f3de9bebb1206.webp)

04

/ 04 -------------------------------------- HOW TO BUILD IT

The world, behind an API.

No GPUs to manage and no streaming stack to build. We take the hard part off your plate, so you are a few lines away from real-time video inside your product.

### 4 models, 1 platform

Reactor’s lineup spans real-time video generation, navigable worlds, multi-shot films, and text-guided video editing. LingBot starts from a seed image; SANA-Streaming edits a clip or webcam feed in place.

[11:14](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=674s) [Lineup slide showing Helios, LingBot, and LongLive-2.0, with descriptions and technical details.](https://assets.ai.engineer/sites/aiecode2025/sha256/802aedbce1773c5b856fb54af2022437e95e4c9ea5e9e8460e0ab7b2e2fad321.webp)

THE LINEUP
4 models, 1 platform.

Helios  INTERACTIVE VIDEO
Infinite text-to-video and image-to-video, generated and streamed in real time.
14B diffusion transformer · chunked

LingBot  NAVIGABLE WORLDS  FLAGSHIP
Walk through a generated world with WASD and look controls, anchored by a single seed image.
16 fps · 1664×960 · < 1 s

LongLive-2.0  MULTI-SHOT FILM
Direct one continuous take across many scenes with soft shots and hard cuts, live or storyboarded.
24 fps · 1280×704 · multi-scene

[11:28](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=688s) [Four cards describe Helios, LingBot, LongLive-2.0, and SANA-Streaming.](https://assets.ai.engineer/sites/aiecode2025/sha256/bb4ccf18a9f1ff90444213c705541d928a80d9c7349c6318c2a756aa7c6e5021.webp)

THE LINEUP
4 models, 1 platform.

Helios  INTERACTIVE VIDEO
Infinite text-to-video and image-to-video, generated and streamed in real time.
14B diffusion transformer · chunked

LingBot  NAVIGABLE WORLDS  FLAGSHIP
Walk through a generated world with WASD and look controls, anchored by a single seed image.
16 fps · 1664×960 · < 1 s

LongLive-2.0  MULTI-SHOT FILM
Direct one continuous take across many scenes with soft shots and hard cuts, live or storyboarded.
24 fps · 1280×704 · multi-scene

SANA-Streaming  LIVE VIDEO EDITING
Describe a change in plain text and it edits your clip or webcam, leaving everything else untouched.
1280×704 · edit in place

### Serving a world is not like serving a model

Regular inference can queue requests and return finished files. A real-time world keeps a stateful connection open as inputs arrive and frames stream out, each with a deadline.

[11:49](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=709s) [A comparison of request-and-response inference with continuous real-time world sessions.](https://assets.ai.engineer/sites/aiecode2025/sha256/be8efa8efb07397c7c798d72773e370927dd7dc3ef49f8da3ad0b5d72f6d4b16.webp)

UNDER THE HOOD

Serving a world is not like serving a model.

REGULAR INFERENCE
Request, then response
You send a prompt, a job runs somewhere, and a finished file comes back. Any GPU can serve any request, so you batch and queue freely to keep utilization high and hide the wait.

REAL-TIME WORLDS
A session that never stops
The connection stays open and stateful, frames stream out while input streams in, and every frame lands on a deadline you cannot push. Latency is not a number you optimize, it is the product itself.

### Streaming instead of requests

A persistent connection carries input in and generated frames out. Each frame has a tight deadline and ships as soon as it is generated, leaving no room for batching.

[12:21](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=741s) [A live session diagram shows input and generated frames flowing over a persistent connection.](https://assets.ai.engineer/sites/aiecode2025/sha256/2b358e8ed7998ed74ef165a77c300f7a706fe6449e16b4fbec5a89d8ef78df4e.webp)

REAL-TIME INFRA · 01

Streaming instead of requests.

There is no final file to wait for. You hold one connection open, with input flowing in and generated frames flowing back out, many times a second for as long as the world stays alive.

01 A bidirectional transport carries input up and frames down on the same persistent channel.
02 Every frame has a tight budget before the world starts to stutter and feel broken.
03 Frames ship the instant they are generated, so there is no batching to fall back on.

LIVE SESSION
INPUT
FRAMES
frame after frame
real time

### Every world is a live session

A world’s state stays pinned to one GPU. Sessions stay warm through reconnects, then expire when idle to free the GPU. Ahres notes that maintaining memory remains a challenge for real-time models.

[12:36](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=756s) [A session lifecycle diagram shows opening, keeping warm, resuming, and expiring a world.](https://assets.ai.engineer/sites/aiecode2025/sha256/b05e2478ff8feccdb71f589f2ccb7b6092fa9d313f5042473d69c7c068329202.webp)

REAL-TIME INFRA · 02

Every world is a live session.

A world has memory. As you move through it the model holds the state of where you have been, so the session is pinned to one GPU and cannot be load-balanced away mid-stream the way a stateless call can.

01 State is pinned to a single GPU, because the world cannot follow you to another machine mid-stream.
02 Sessions stay warm and resume cleanly, so a dropped connection does not reset the world.
03 Idle worlds expire on a timer, handing the GPU back for the next session to claim.

SESSION LIFECYCLE
GPU: gpu-07
OPEN — world created
KEEP WARM — streaming live
RESUME — on reconnect
EXPIRE — idle, gpu freed

### A real-time experience, everywhere

Reactor geo-routes sessions to nearby GPUs to keep round trips short. The diagram pairs four cities with regional compute.

[13:04](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=784s) [A diagram maps cities to nearby GPU regions for real-time sessions.](https://assets.ai.engineer/sites/aiecode2025/sha256/ac6c2c18e44380158dcbf950e2600f0a409fa4c79a9419a4c92bcfb8dfaf5714.webp)

REAL-TIME INFRA · 03

A real-time experience, everywhere.

Real-time only feels real-time when the compute is close, because distance is latency. We run GPUs in regions all over the world and geo-route every session to the nearest available one, so you deploy once and your users feel it everywhere.

01 Compute is available across regions worldwide, not pinned to a single data center.
02 Each session connects to the closest GPU, so the round trip stays short wherever the user is.
03 You ship one application and reach a global audience without managing any of it.

GEO-ROUTED SESSIONS
nearest GPU
New York — us-east
London — eu-west
Singapore — ap-southeast
São Paulo — sa-east

every session takes the shortest path to compute

### A few calls to a living world

The example creates a Reactor model, attaches streamed frames to a video element, and starts a scene from a seed image and prompt. Ahres calls the example simplified.

[13:33](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=813s) [Developer-first slide with a JavaScript example for starting a real-time world.](https://assets.ai.engineer/sites/aiecode2025/sha256/cbcf553be5bb7913bb9e101d095f3b7fe94991f4b747b3c988691f0df1414a5a.webp)

A few calls to a living world.

DEVELOPER-FIRST

Connect, anchor the world with a seed image and a prompt, then stream frames and steer the camera. The session, transport, and inference loop are handled for you.

import { Reactor } from "@reactor-team/js-sdk";

const reactor = new Reactor({ modelName: "lingbot" });

// show frames as they stream in
reactor.on("trackReceived", (n, _t, s) => (video.srcObject = s));

// set the scene, then start
await reactor.setImage(seedImage);
await reactor.setPrompt("A misty forest at dawn.");
await reactor.start();

Interface text:
app.ts

### Start building on the frontier

Reactor invites developers to get an API key through the QR code. Ahmed says promo code AIE2026 provides $75 in credits.

[13:55](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=835s) [Closing slide with a landscape, a QR code and a promotional offer.](https://assets.ai.engineer/sites/aiecode2025/sha256/6cbf75aa8042075a6c5cc5cf2b39d1411cae744dd8b2b6e7edafe0c853f6e554.webp)

THE FRONTIER IS OPEN

Start building on the frontier.

The platform is live today. Get an API key and build the category nobody else can build yet.

PROMO CODE: AIE2026

## Full transcript

[0:00](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=0s) [upbeat music] Hi, everyone. Uh, welcome to the talk. First of all, thank you all for making the time.

[0:16](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=16s) I know it's the last talk of the day probably, or I think the last one is at, uh, three forty-five. But, uh, yeah, thank you all for your time.

[0:22](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=22s) I, I know you're all probably very busy. Um, today I'm gonna be talking about something that is a little bit slightly futuristic, though not for San Francisco, and that's World models.

[0:31](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=31s) Um, I know here it's written real-time interactive video, but the way we think about World models is really in the real-time interactive video, and I'll explain why. Um, and in today's world, I think World models is a little bit of a marketing term that people think about it from a Gaussian splatting standpoint or others from video.

[0:47](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=47s) Uh, but the way we define World models is really real-time interactive video, and I have strong evidence or, like, beliefs that this will actually change everything in how we produce and consume content.

[0:59](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=59s) Oops. What happened? Sorry. [clears throat] Sorry about that. Cool. [clears throat] So if you think about video, video has always been something passive. Before, people used to produce videos and movies, and then we would watch it.

[1:19](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=79s) And in today's world, we have these models, the Veo 3, the Seedance 2, and what they do is you prompt them, you get back a file, you watch, and good luck.

[1:28](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=88s) It's a slot machine. You cannot change it. You cannot do anything about it. So there's a question that, um, we like to think about in our company is what happens when video becomes programmable like software?

[1:39](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=99s) And what happens when pixels can be generated in real time? Once this happens, it actually changes completely how we think about consuming content and even producing content, and I'll be talking about how in history we've seen that real time has always been the future and the co- kind of applications that it unfolded and how you can get

[1:56](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=116s) started today. Quick, quick background here. Um, so my name is Ahmed. I'm the head of go-to-market at Reactor. My background is in computer vision and machine learning. Um, and I state machine learning because this is the time where we used to actually train our models.

[2:12](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=132s) Um, I built and shipped games on iOS, uh, on iOS and Android for fun. Um, I was a founder, um, and today, I'm the head of go-to-market at Reactor.

[2:21](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=141s) And who we are, quickly, is we're a Series A company building the platform for these real-time World models. So, so far, main-- most of them have been still models, but we are building the infrastructure and the developer platform to make them usable so that anyone can integrate these real-time interactive video, and we can democratize access to this

[2:40](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=160s) technology. I'll start with a problem. We can today generate pretty much anything, but we just can't change it, right? A generated video, as I mentioned earlier, is still a recording.

[2:52](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=172s) You get it back. You can't do anything about it. And real-time changes what the medium is. It doesn't just make it faster.

[2:59](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=179s) And I'm gonna talk about two examples that actually show us what real time has unlocked in the past. Before, in the nineteen fifties and even before, we used to look at a map to know where we are.

[3:10](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=190s) Someone produces a map, you look at where you are, and that's it. You cannot do anything about it. Then GPS came. GPS made it real time. Suddenly, I can know where, where I am at the instant, and I can, you know, track it.

[3:21](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=201s) Now, you think GPS has just made it a bit faster to know where I am, but actually, Uber would not exist if we did not have the GPS. Another example, which is even a bit more powerful, I'd say.

[3:34](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=214s) Before we used to d- to use the film to produce content, right? We had a film. Someone shoots something. They can't see what they're shooting. They go somewhere. They produce that film, and then you can see it.

[3:45](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=225s) And then it became digital. You can start seeing what you're shooting. If today you pick up your iPhone and you start recording a video, then you can see what's going on, and that's why we can produce high-quality content.

[3:56](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=236s) It's because you are able to see what's going on in the screen and adapt accordingly. That gave rise to In- Instagram and TikTok. Instagram and TikTok would not exist if we could not produce high-quality content, and the only reason why we're able to produce high-quality content, among many reasons, is because we can see in real time what's

[4:14](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=254s) happening. It's not a slot machine. We can actually just edit and see, and that's what unlocks all of these new use cases.

[4:24](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=264s) So when video becomes programmable, you can address it, you can condition it, you can change it. I can show you on the screen whatever I wanna show you on the screen, and it becomes programmable a little bit like software or like anything that is programmable in the world.

[4:39](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=279s) And in, in the market today, we are seeing three kinds of models that do this. Some of them you will be familiar with, others you will not be familiar with.

[4:48](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=288s) The first one is these are Veo-- think about Veo or Sora, but real-time and interactive, meaning that, first of all, they're infinite. So they don't stop after five, ten, or thirty seconds.

[5:00](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=300s) They actually continue forever. They're interactive, meaning you can change what's happening on the screen,

[5:06](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=306s) and they're in real time, so you don't need to wait to see what's going on. And assuming this works. So this is an example of a, of a video that I passed an image with a dog, and this was all generated in real time.

[5:17](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=317s) And at some point, I'm gonna prompt, "A cat shows up," and you will see that a cat showed up in the, in the video. This would not be possible in the existing batch regular video generation models because you would get back the video, and you cannot do anything about it.

[5:30](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=330s) I could have added anything. I could have gone on to create an entire story with it. I could have said the ca-- the dog starts running, starts jumping. A ca-- a dragon shows up.

[5:38](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=338s) It goes to, I don't know, to the World Cup. All of this would have happened in front of you.

[5:43](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=343s) These type, these types of models pro-- like, unlock a few things. First of all, control. So if you think about generative media today, the big problem that content creators all have is I don't have the control I need.

[5:55](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=355s) Like, yes, it's great to use Seedance 2 or Veo 3 to generate videos, but I just don't have the control. And this is always the thing that any filmmaker or movie producer or any content creator will tell you.

[6:07](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=367s) And so real-time actually ends the slot machine type of mentality and actually gives you the cr- the control that you need. And a big saying I like to say is, "Instant feedback is the ultimate level of control," and you-- we will never be able to have this level of control if we don't have real-time.

[6:24](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=384s) The second thing it unlocks which, you know, among other things, which is a field I'm not particularly fond of, but I think is gonna be big, is advertising. If I can know what you looked for a minute ago, why can't I insert the logo of whatever you've been looking for?

[6:39](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=399s) Why can't I produce an ad in real time in front of you? We don't need to produce, pre-produce anything. Now granted, this is gonna take some time because, you know, brands afraid of AI, afraid of, uh, you know, if their logo has one pixel that is white instead of dark.

[6:55](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=415s) But it will happen eventually. And so-- And I think at the moment that happens, we will not be to-- need to produce any ads anymore. Everything will be happening in front of you in real-time.

[7:06](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=426s) The second type of model is the one that probably you're most familiar with. It's the Genie 3 like from Google. These are models where you can pass an image and a text typically, and you can control a character.

[7:18](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=438s) They're fun. The first thing that you think about when you think about this is games, right? It's a character, it's a world, you can generate anything. But actually--

[7:28](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=448s) It actually goes way far, way beyond games.

[7:32](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=452s) It creates entire new interactive experiences where, combined with the first types of models that I talked about, we've already been seeing people in our community building a mix of games and, and movies.

[7:42](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=462s) If you've ever watched Bandersnatch from Netflix, which is the ga-- the movie that you can pick your next scene, this is one of those things that gets, uh, that, that, that becomes possible, that you can control a character, you can control what's happening and create entire new types of interactive experiences that were not possible.

[8:00](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=480s) The second thing is robotics. So because you can simulate and you can control, you can actually create as much training data as, as you want. And robotics-- World models in robotics is actually a giganormous market today.

[8:12](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=492s) Um, I cannot tell you the number of robotics labs that, um, are training and building these models. But because you can control whatever you wanna control in any environment, this creates a new opportunity to generate infinite amount of data for robotics.

[8:27](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=507s) And finally, something I like to think about, this is more maybe a passionate thing that I have, is education. Um,

[8:33](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=513s) because you can step into anything, who-- With today's world in AI, I don't actually believe that edu- in the future of education is LLM-based or textbook-based. If you can put any, any kid in the situation, for example, in a history lesson, that enables entire new types of edu-- experiences that, uh, can be educational.

[8:56](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=536s) The third type of model is probably the type of model that, you know, is more, let's say, um, co- something that we've been seeing before, which is avatars, but live and interactive.

[9:06](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=546s) The thing with avatars though is it hasn't actually been cracked. They're still all kinda weird. If you speak to an avatar in any customer support or anything, it's still kinda off, right?

[9:16](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=556s) Um, and these types of models, and we're seeing a rise of these live and interactive avatar models in research preview, that combined with Model one and Model two is actually gonna be, I believe, a, a big change in what we've been seeing so far.

[9:30](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=570s) And this will be applied to things like customer support, training, sales, gaming, streaming services, et cetera.

[9:39](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=579s) And so ju-just to give you a glimpse of what our users are building today at Reactor with these types of models, some of them are building interactive livestream, right?

[9:47](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=587s) A livestream where people are watching, and then the users can type what happens next, and then they vote. Why? Because pixels can be generated in real-time. So there's no reason why I cannot put a livestream on X, YouTube, or Twitch and enable users to pick what happens next.

[10:02](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=602s) Something that was surprising to me is a little bit on, on the medical simulation. So we've seen users create applications where you generate a world, and then you simulate what happens next.

[10:12](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=612s) What if I put this medicine? What if I remove this medicine, right? And this creates-- can be a training playground for people wanting to become doctors.

[10:21](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=621s) The third one, which is also kinda surprising, is cooking simulation. So people are building applications where you can simulate cooking and what happens if you put this ingredient.

[10:32](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=632s) And finally, video editing. With video-to-video models, video editing becomes very interesting because I'm able to just add visual effects in real-time, and we've seen people build entire video edit-editing platforms.

[10:46](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=646s) Now granted, they're not very good yet, just because of the quality of the models, but it's a new paradigm once you're able to v-- edit videos just via prompting or via talking to it or via clicking.

[10:59](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=659s) And now for the final part, how do you actually do all of this? And this is why I like to say the world behind an API.

[11:07](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=667s) At, at Reactor, we have four types of models today. First one is called Helios, which is the interactive video model that I talked about. This one is from ByteDance.

[11:15](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=675s) LingBot, which is a world model like Genie 3, trained by Alibaba.

[11:20](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=680s) LongLive 2 from NVIDIA, which is multi-shot film. You can prompt things in advance and create a consistent story over time.

[11:30](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=690s) And SANA-Streaming, also from NVIDIA, which is a model that does video-to-video editing. So people are already using this, for example, by shooting something or creating something on Seedance 2, uploading it, and then adding visual effects, removing people, adding background.

[11:44](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=704s) And this be-- gets very interesting in previsualization, for example, for Hollywood movies.

[11:51](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=711s) And under the hood, when we talk about infrastructure,

[11:54](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=714s) the thing that I think I like to drive home is building infrastructure for regular video generation models is very different from real-time. Because in regular video generation models, you're talking about requests.

[12:06](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=726s) You just send a request, a job gets run in the cloud, and I'm oversimplifying here, but you know, a job runs in the cloud, and it gives you back a file.

[12:14](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=734s) With real-time, it's a different ballgame. Uh, you cannot just take what works for batch inference and apply to real-time inference. For example, you need to r-think about streaming, right?

[12:25](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=745s) Once you need to think about streaming, um, pixels, uh, from a server to the client, um, it adds entire new-- entire complexities that batch generation does not have to think about.

[12:37](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=757s) The second one is that everything is a live session, so everything runs constantly, and there's memory to be kept into account. Now, granted, one of the things that live vi-- live real-time models struggle with is memory.

[12:49](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=769s) If you've seen demos from Genie 3, for example, we've all seen that the character can look back and then not remember what-what's going on. So there is a lot of work that needs to be going into maintaining that context window so that you can remember what happened if you turned your character left and right.

[13:06](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=786s) And finally, global scale. If you th-if you think about real time, it needs to be sub one hundred millisecond latency anywhere you are. And if you're deploying applications in the world, then someone based in India or someone based in Japan should be routed to a GPU that is based in India or Japan, or as close as possible

[13:25](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=805s) to it. If not, if you don't have the compute worldwide, then the experiences are not real time anymore, and it breaks completely the medium.

[13:35](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=815s) And with Reactor, this is as easy as it gets to integrate these real-time models. Okay, I kind of maybe oversimplified it a little bit here, but it really is maybe ten lines of code.

[13:44](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=824s) Um, and we have docs to do all of this. But essentially, you can just load the model with an API key and just start integrating it in whatever video, image, plugin, anything that you're building.

[13:57](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=837s) And if you wanna get started, there's a QR code there, and I've added a promo code, AIE2026, which will give you seventy-five dollars off. Well, seventy-five dollars worth of credits, which is, um, significant amount of compute, uh, in our case because we make the models extremely cheap.

[14:15](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=855s) Thank you very much. [audience clapping] I'm happy to take questions if anybody has a question.

[14:25](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=865s) Oh. Hi.

[14:28](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=868s) So I saw the sixteen FPS was the stated, uh, frame per second on the video game generator. What would it take to get that to something more like doable thirty FPS?

[14:39](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=879s) Uh, well, one thing that actually we do is multi-GPUs. So we use multiple GPUs, um, optim-optimizing the model weights, applying quantization techniques. So there are ways, it's just a matter of priorities, but it is, uh, there are ways around it.

[14:56](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=896s) Yeah. Good question, though. Hi. Yeah.

[15:08](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=908s) Uh, I'm, I'm, I'm wondering if you are gonna be showcasing something at IBC in Amsterdam?

[15:15](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=915s) Sorry?

[15:16](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=916s) Are you aware of what the IBC is?

[15:18](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=918s) Uh, no.

[15:19](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=919s) The International Broadcasting Convention.

[15:21](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=921s) Okay.

[15:21](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=921s) There is, uh, I was wondering if you're gonna be presenting some showcasing regards of the, uh, next generation.

[15:27](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=927s) I wasn't, but now I'm gonna look at it. Yeah. [laughing]

[15:31](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=931s) Yeah. Yeah.

[15:35](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=935s) Yeah. How do you feel like about comparing, uh, some deterministic engines too inside-

[15:41](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=941s) Yeah

[15:42](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=942s) ... of the traditional 3D Russell? Can we get a lack of feedback maybe?

[15:45](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=945s) Yeah.

[15:46](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=946s) Do, do you guys experiment with that? Can you share something?

[15:49](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=949s) When you say deterministic engines, what do you mean exactly?

[15:53](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=953s) Oh, any, any kind of, like, deterministic rule sets that you check against maybe, so the simulation stays, uh, grounded. I would, that's how I would describe it.

[16:03](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=963s) Hmm. So we don't do any of that today. Um, the reason why also we build a developer platform, and but we've seen people build that on top of us.

[16:11](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=971s) Um, building the infra for this is already a lot of work. Um, and I think we, we were seeing already developers building it and then open sourcing it, and then we reuse it.

[16:20](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=980s) Um, but so the community is doing it for us, which is even better. Yeah.

[16:25](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=985s) Is that a question? Yeah.

[16:28](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=988s) How do you measure and evaluate the visual

[16:32](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=992s) consistency?

[16:33](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=993s) Uh, you're asking a question that the entire research community in world models has not answered. There are evals for real time and consistencies, uh, and fidelity. Well, fidelity is easy.

[16:43](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=1003s) It's just like pixels, right? But, um, evaluation for these real-time models is an unsolved problem. So today, it's literally just look at it and

[16:54](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=1014s) human judgment. That's what it is today. And this is including, by the way, G-DeepMind and everything. Nobody has solved this problem yet.

[17:03](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=1023s) So what are you guys working on?

[17:04](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=1024s) Uh, we're working on it. We have a research team. Yes. [laughing]

[17:11](https://www.youtube.com/watch?v=5dCAmSDOAjI&t=1031s) Awesome. Cool. Well, thank you everyone. Thanks for your time. [outro jingle]
