← All speakers

Brendan Rappazzo is an applied researcher at Prime Intellect developing open models, reinforcement-learning methods, and autonomous research systems. Previously a machine-learning scientist at Morgan Stanley, he helped build AlphaLab, a multi-agent platform for quantitative research that treats rigorous evaluation as the foundation of useful automation.

From environmental science to open-model research

Rappazzo studied bioengineering and biomedical engineering at the University of Maryland, College Park, before earning a master’s degree and doctorate at Cornell University. Working with Carla Gomes on computational sustainability, he contributed to Phase-Mapper, an award-winning materials-discovery system, and developed computer-vision methods for measuring eelgrass disease. His research also addressed hydropower planning in the Amazon.

His subsequent work investigated how machine-learning systems recognize and correct their own mistakes. He coauthored Critic Loss for Image Classification, which uses a learned correctness critic to improve classification and calibration with limited labeled data; the research received ICMLA’s 2024 best-paper award. He also coauthored GEM-RAG, a retrieval architecture built around graph-structured memories and higher-level summaries.

After completing his doctorate, Rappazzo joined Morgan Stanley’s machine-learning research group. There, AlphaLab combined frontier language models with domain research, evaluation construction, and large-scale experimentation. Its strategist proposes hypotheses while worker agents implement models, launch Slurm-managed compute jobs, inspect training results, and refine subsequent experiments; human researchers can intervene and compare candidates against held-out data. His AI Engineer World’s Fair presentation detailed applications spanning time-series forecasting, CUDA kernels, and language-model training.

In August 2026, Rappazzo left Morgan Stanley and joined Prime Intellect’s applied research team, advocating open-source intelligence that lets individuals and organizations train and control their own models.

  • Evaluation environments as durable expertise. Rappazzo argues that autonomous research capabilities will become widely available, while carefully constructed environments retain scarce domain knowledge. Held-out datasets, leakage-resistant scoring, containerized submissions, and qualitative research rubrics make experimentation measurable and can provide reinforcement-learning signals for improving the research system itself.
  • Critic-guided learning. His classification research uses learned estimates of prediction correctness to improve calibration and identify promising examples for human labeling, connecting model reliability with semi-supervised and active learning.
  • Open reinforcement-learning experiments. DeepSeekRL-Extended exposes a GRPO-style training loop, reward functions, and evaluation machinery for hands-on experimentation.
  • Adversarial and persistent agents. Loophole uses competing agents to probe weaknesses in legal principles, system prompts, and chatbot policies. HermitClaw explores a continuously running agent that researches topics, writes reports, and retains memory across tasks.

Read the topics behind these talks

2 conference talks

Key ideas

Scroll to read ↓

AlphaLab turns prediction tasks into parallel research campaigns, then uses the failures of that approach to make evaluation environments the foundation for improving the system itself.

  • Where more research cycles could help
    0:00 ↗
  • One harness, different starting points
    3:01 ↗
  • From a prediction request to trained models
    4:30 ↗
  • Tools for research and cluster execution
    6:34 ↗
  • Research context that survives a handoff
    8:17 ↗
  • Building an evaluation, then trying to break it
    9:43 ↗
  • A research campaign on a Kanban board
    10:43 ↗
  • Results from public tasks and internal models
    12:59 ↗
  • What the failures left unanswered
    14:20 ↗
  • A stricter contract for AlphaLab 2.0
    16:04 ↗
  • Using AlphaLab to improve AlphaLab
    16:57 ↗
  • Encoding expertise in the environment
    17:50 ↗

Key ideas

Scroll to read ↓

Brendan Rappazzo’s independent open-source project translates natural-language principles into formal rules, attacks those rules from both directions, and turns the resulting edge cases into patches—or questions only a human can answer.

  • Test formal rules in both directions: search for objectionable behavior they permit and acceptable behavior they prohibit.
    4:12 ↗
  • Automatic patches should repair an existing intention; cases that require a new value judgment belong with the user.
    4:42 ↗
  • The DNA-artifacts example shows how a restriction on source data can miss derived representations that enable the same unwanted use.
    6:22 ↗
  • The chatbot version tests both prohibited answers and false refusals, treating helpfulness failures as the counterpart to policy violations.
    8:21 ↗
  • Synthetic contract cases can expose disagreements before signing, but they do not create bargaining power or enforcement.
    9:07 ↗
  • Legislative hill climbing optimizes predictions produced by inferred profiles. Better simulated support is not the same as real political support or representative consent.
    12:28 ↗
  • When adversarial agents stop finding contradictions, the search has reached a stopping point—not a proof of moral completeness or consistency.
    15:27 ↗

References