← All speakers

Bio, Work & Ideas

Olive Song

Conference affiliation: RL Lead · MiniMax · 2026

Olive Song leads reinforcement-learning research at MiniMax, overseeing the final training and release of open-weight models for coding and autonomous digital work. She focuses on making agents dependable when tools fail, environments change, tasks run for hours, and imperfect rewards invite shortcuts.

An alumna of New York University’s Courant Institute, Song lived in New York for six years before moving from academic research into industrial model development. In 2025, she helped introduce MiniMax-M2, an open-weight coding model with 10 billion active parameters. By 2026, she was leading reinforcement-learning research for MiniMax’s increasingly multimodal models, including MiniMax-M3.

  • Developer-centered reinforcement learning: Song incorporates experienced developers into task design, evaluation, and reward development. Their feedback grounds training in realistic debugging, repository refactoring, multilingual programming, and standards of work that software teams can actually trust.
  • Interleaved reasoning and tool use: Her agents alternate actions with reassessment, adapting when tool calls fail or unexpected results emerge. For extended assignments, including research reproduction and GPU-kernel optimization, she evaluates intermediate attempts and uses validation splits to distinguish genuine progress from reward hacking.
  • Robustness across agent environments: Song varies prompts, tool definitions, response formats, and surrounding agent scaffolds because familiarity with numerous tools does not guarantee reliable performance inside an unfamiliar production setup.
  • Open-weight multimodal models: With MiniMax-M3, she describes training text and visual information together from the outset, enabling agents to interpret interfaces, improve websites, navigate computers, and assist with game development. Open weights also let developers adapt models, protect sensitive data, and contribute improvements.

Song approaches alignment as an implementation problem as much as a theoretical one: one training investigation traced stalled reinforcement-learning progress to numerical precision in the language-model head. Her interests extend into GPU data layouts and shared-memory bank conflicts.

Read the topics behind these talks

3 conference talks

Key ideas

Scroll to read ↓

MiniMax’s Olive Song and Together AI’s Dan Fu connect multimodal training, useful kernel benchmarks, long-running agent evaluation and the infrastructure needed to serve them.

  • What happens between training a model and serving it?
    0:33 ↗
  • From an informal introduction to architecture work
    2:26 ↗
  • Capabilities depend on how the task is defined
    4:14 ↗
  • A benchmark whose solutions can become infrastructure
    6:01 ↗
  • Day zero starts an optimization backlog
    7:22 ↗
  • Agents change what the inference engine must optimize
    9:04 ↗
  • Train the model to see what its code produces
    10:14 ↗
  • Architecture changes, but engineering experience transfers
    11:44 ↗
  • Long research tasks need intermediate evidence
    13:59 ↗
  • The KV cache becomes a distributed storage problem
    16:11 ↗
  • Better hardware use and faster model development
    17:16 ↗

Key ideas

Scroll to read ↓

Useful coding agents need more than strong benchmark scores: they must learn from developer feedback, recover from tool failures and keep working when their surrounding scaffold changes.

  • Building a model developers can work with
    0:35 ↗
  • Scores and everyday use
    2:09 ↗
  • Scaling environments and expert feedback
    3:28 ↗
  • Reason again after the tool responds
    5:40 ↗
  • A changing market as an environment
    8:31 ↗
  • More tools did not solve scaffold changes
    9:12 ↗
  • Multiple copies working in parallel
    10:40 ↗
  • Memory, context and the next models
    11:42 ↗

Key ideas

Scroll to read ↓

Thomas Wolf and Olive Song explain how MiniMax M3 combines sparse attention, multimodal training and coding capabilities to support agents that must read, act and keep working across long interactions.

  • Agents need room for accumulating tool responses and multiple interaction rounds, as well as large initial inputs.
    4:27 ↗
  • MiniMax Sparse Attention separates context selection in an index branch from attention calculations over selected blocks.
    5:27 ↗
  • Training text and vision together from the first step avoids difficulties MiniMax encountered when introducing vision later, while requiring work to prevent training collapse.
    10:37 ↗
  • A long-video-to-tool workflow connects multimodal understanding, context capacity and agentic action; the tutorial example is a proposed application.
    3:03 ↗
  • MiniMax uses internal research harnesses to turn model capabilities into automated work, and Song reports that M3 is already helping develop M3.1.
    18:39 ↗

References