← All speakers

Antje Barth is a Member of Technical Staff at Amazon AGI, where she works on making advanced AI systems practical for developers and reliable enough for real-world tasks. Her career spans enterprise infrastructure, machine-learning education, generative AI, and agents that can understand interfaces, collaborate with people, and verify their own work.

From cloud infrastructure to autonomous systems

Before joining AWS, Barth worked in solutions engineering and technical evangelism at Cisco and MapR, with a focus on infrastructure, large-scale data systems, containers, and Kubernetes. She later became a principal developer advocate for generative AI at AWS and co-founded the Düsseldorf chapter of Women in Big Data and the Generative AI on AWS Meetup.

With Chris Fregly, she wrote Data Science on AWS, published in 2021, covering the practical lifecycle of machine-learning systems from data preparation through deployment and operations. In 2023, Barth, Fregly, and Shelbee Eigenbrode published Generative AI on AWS, addressing model evaluation, fine-tuning, retrieval-augmented generation, and production deployment. Its open-source companion repository supplies working examples.

Barth also co-instructed Generative AI with Large Language Models, developed with DeepLearning.AI and AWS. Her teaching frames AI engineering as an accessible discipline that nevertheless requires serious attention to model selection, privacy, security, evaluation, and responsible application design.

  • Retrieval-based tool selection: Agents with thousands of available tools cannot fit every description into a model’s context. Barth has described storing tool descriptions in a knowledge base and retrieving only those relevant to the immediate task. Her cloud-scale agent architecture also incorporates Model Context Protocol servers, serverless deployment, session management, and explicit authorization.
  • Perception agents: Reliable computer-use agents must understand rendered interfaces, detect changing application state, and assess whether their actions succeeded. Barth applies a perception-planning-action loop to software environments, allowing agents to work across applications even when dedicated APIs are unavailable.
  • Shared visual context: Browser-based annotation lets someone identify the precise interface element they want changed, giving an agent concrete visual and structural context instead of an ambiguous textual description.
  • Visual verification: Coding agents can rely on executable tests; most knowledge work offers no equivalent safeguard. Barth’s open-source perception-agent approach checks rendered output against design specifications, exercises application flows, and reports failures for human review. She has also demonstrated how spoken design discussions can trigger interface changes followed by the same verification process.

Read the topics behind these talks

3 conference talks

Key ideas

Scroll to read ↓

Antje Barth connects everyday agent experiences to the engineering underneath: model-directed tools, semantic tool retrieval, and MCP services deployed through familiar AWS infrastructure.

  • From customer requests to coordinated actions
    0:39 ↗
  • Specialized experts behind a single assistant
    3:38 ↗
  • A terminal question becomes an approved tool call
    5:15 ↗
  • Give the model a task and tools
    7:21 ↗
  • Retrieve relevant tools before choosing one
    10:23 ↗
  • Start with a local MCP dice tool
    12:00 ↗
  • Move the tool behind a cloud endpoint
    14:22 ↗
  • From tool services to agents working together
    17:16 ↗

Key ideas

Scroll to read ↓

Build on software engineering skills by learning model behavior, using AI development tools, testing models through a common API, and composing tools into agent workflows.

  • Learn what sits behind the API
    0:36 ↗
  • Use AI across the development lifecycle
    2:29 ↗
  • Move from IDE guidance to a reviewed feature change
    5:02 ↗
  • Prototype around a use case, then evaluate models
    8:26 ↗
  • Keep model invocation consistent with Converse
    11:29 ↗
  • Declare the functions a model can request
    13:06 ↗
  • Give an agent instructions and code-backed actions
    13:58 ↗
  • Compose actions to answer “Come to me”
    16:18 ↗
  • Keep learning with other builders
    17:50 ↗

Key ideas

Scroll to read ↓

An agent that can click through an application still needs to understand what changed. Antje Barth explores shared context, visual annotation and verification as foundations for reliable work.

  • The work between applications
    1:20 ↗
  • From tool capability to trustworthy delegation
    2:26 ↗
  • Why coding moved faster
    4:36 ↗
  • Shared context and a continuous feedback loop
    7:29 ↗
  • What perception adds to computer use
    11:36 ↗
  • Mark the target, then hand off the context
    13:23 ↗
  • Check both the design and the experience
    15:07 ↗
  • When the shared context is a conversation
    16:48 ↗
  • Building the rest of the loop in the open
    19:30 ↗

References