← All speakers

Alex Volkov is the founder and host of ThursdAI, a weekly AI podcast and newsletter running since 2023, and an AI evangelist at Weights & Biases by CoreWeave. His work focuses on a central problem in AI engineering: how developers retain meaningful oversight as models generate more software and agents operate more independently.

Volkov spent nearly a decade at Fundbox before leaving in late 2022 to build AI products. His earlier Extensionizr simplified browser-extension scaffolding; later projects included a directory of AI image-generation tools, a Colab-based Stable Diffusion setup and an early ChatGPT Telegram bot.

He founded Targum.video, an AI video-translation venture, after experimenting with translating clips shared on social media. His account of the transition traces his departure from Fundbox and the development of Targum using Cloudflare infrastructure.

ThursdAI began as a live conversation on X and expanded into a podcast and newsletter covering model releases, open-source projects and practical AI development. Volkov subsequently joined Weights & Biases as an AI evangelist, continuing the show alongside his work in developer education. His editorial instincts favor technical substance over marketing: he has challenged implausible token-capacity claims and highlighted privacy-preserving agent navigation built around accessibility data instead of screenshots.

  • Production tracing and evaluation. Volkov treats observable execution as a prerequisite for trustworthy AI applications. His work on LLM evaluation emphasizes versioned prompts, retrieval and agent traces, continuous assessment, and application-specific evaluation criteria. He distinguishes programmatic checks, human review and model-based judging, stressing that automated evaluators require their own bias checks. He also favors improving prompts and retrieval before committing to expensive fine-tuning.
  • Vendor-neutral MCP observability. External Model Context Protocol tools can obscure what an agent actually does across independently operated services. Volkov created the Observable.tools initiative and demonstrated MCP tracing with Benjamin Eckel, advocating OpenTelemetry-compatible instrumentation and trace propagation across tools, programming languages and observability platforms.
  • The Z/L Continuum. Volkov’s framework for reviewing AI-generated code argues that oversight should match the risk of each change. Authentication, permissions, financial operations and irreversible data warrant close inspection; lower-risk work can rely more heavily on tests, traces, shadow deployments and rollback. He emphasizes independent verification: an agent that writes code, creates its tests and grades its own output has not eliminated review; it has concealed the conflict. As model capabilities improve, human judgment shifts toward defining tasks, designing safeguards and deciding what evidence a change requires.

Read the topics behind these talks

3 conference talks

▶ Watch ↗

AI Engineer World's Fair 202418:39

Judging LLMs

Read the full talk →

Key ideas

Scroll to read ↓

A chat-with-PDF prototype becomes a production problem when prompt edits break existing features. Tracing, layered evaluation, and application-specific criteria make those failures easier to catch.

  • When a prototype starts charging customers
    0:15 ↗
  • Improve the prompt and application before training
    3:57 ↗
  • Keep model choices connected to the changing landscape
    6:07 ↗
  • Build a dataset, run the model, score the answers
    8:02 ↗
  • Use code for properties that code can check
    10:08 ↗
  • Scale review without removing human judgment
    11:01 ↗
  • Combine the methods, then inspect the judge
    12:59 ↗
  • Inspect generated interfaces, not just aggregate grades
    14:47 ↗
  • Turn expectations into a rubric
    16:06 ↗

Key ideas

Scroll to read ↓

MCP tools can hide the work behind an agent’s calls. OpenTelemetry context propagation connects those calls to server execution, while shared conventions make the resulting traces portable.

  • When adding tools makes an agent harder to observe
    0:33 ↗
  • A visible tool call can still hide its implementation
    2:39 ↗
  • Traces, spans, and a portable destination
    4:24 ↗
  • Following a fetch into the server
    6:17 ↗
  • Carrying context through MCP metadata
    8:14 ↗
  • Sending the TypeScript trace to Weave
    10:02 ↗
  • A coding agent checks its own instrumentation
    11:23 ↗
  • Extending exports to profiles and tasks
    13:10 ↗
  • Making traces understandable across platforms
    14:01 ↗

Key ideas

Scroll to read ↓

Agent-generated code makes implementation cheaper, but review remains scarce. The useful question is which changes need human inspection—and which need stronger systems of proof.

  • Cheap code, scarce attention
    0:15 ↗
  • Two talks, one engineering anxiety
    3:06 ↗
  • The limits of classifying engineers
    6:11 ↗
  • More output does not establish stability
    8:02 ↗
  • Generation accelerates into a review bottleneck
    11:02 ↗
  • Route tasks, not personalities
    12:08 ↗
  • A routing table for proof
    13:53 ↗
  • Stronger models move the review target
    15:50 ↗
  • Loops make the placement of judgment more consequential
    18:02 ↗
  • Keep judgment as the boundary moves
    20:15 ↗

References