← All speakers

Bio, Work & Ideas

Jack Morris

Conference affiliation: Cofounder · Engram · 2026

Jack Morris is an AI researcher and cofounder of Engram, which develops language models that acquire durable knowledge about the organizations using them. His work tackles a central limitation of contemporary AI: models can reason impressively about public information yet struggle to learn private documents, specialized skills, and the accumulated context of individual users.

Morris began researching natural-language processing as an undergraduate at the University of Virginia, where he helped create TextAttack, an open-source toolkit for adversarial attacks, adversarial training, and data augmentation. He became a Google Brain Resident before pursuing a doctorate at Cornell University, completed in 2025. There he worked with Alexander Rush and Vitaly Shmatikov, received an NSF Graduate Research Fellowship, and spent part of his PhD as a student researcher at Meta’s Fundamental AI Research group. He publishes academic research as John X. Morris.

His doctoral research exposed a consequential privacy problem in retrieval systems. Through embedding inversion, Morris and collaborators reconstructed text from numerical embeddings, recovering 92% of tested 32-token inputs exactly under their experimental conditions and identifying sensitive information in clinical text. The implication: embeddings cannot safely be assumed anonymous simply because their contents are unreadable to humans.

With Rush, Morris subsequently developed contextual document embeddings, which adjust a document’s representation according to surrounding documents. This helps retrieval systems distinguish material that looks similar in a general-purpose embedding space but differs meaningfully within a specialized collection. His work on language-model memorization also estimated 3.6 bits per parameter for the GPT-style models studied, giving practical definition to the finite capacity available for specialized knowledge.

  • Weight-based model memory: Information repeatedly inserted into prompts remains expensive to process and can become harder to use as context grows. Morris argues that adapting model parameters can make organizational knowledge persist across requests, while retrieval remains useful for fresh or frequently changing information. His analysis of prompting, retrieval, and model adaptation frames these as complementary tradeoffs between training-time investment and inference-time cost.
  • Learning without catastrophic forgetting: Training directly on a narrow document collection can produce nearly perfect memorization while damaging a model’s ability to answer unfamiliar questions. Morris emphasizes synthetic questions, varied training examples, and targeted parameter updates that preserve existing capabilities while helping models generalize.
  • TinyLoRA: In research on extremely small adapters, Morris and collaborators showed that reinforcement learning can improve mathematical reasoning with remarkably few trainable parameters, including experiments involving just one. The finding distinguishes compact behavioral adaptation from the more demanding task of storing substantial new factual knowledge.
  • Scaling compute on context: Morris’s approach to specialized model learning applies substantial computation to a fixed corpus through distillation, synthetic continued pretraining, and progressively harder self-improvement loops. The challenge is to keep deepening a model’s understanding after an initial synthetic training set stops yielding improvements.

Engram launched in June 2026 with $98 million in funding and announced work with Microsoft, Notion, and Harvey. Morris also experiments directly with coding agents, reporting infrastructure bugs across PyTorch, vLLM, and related tools and describing how agent-assisted development changed his thinking.

Read the topics behind these talks

2 conference talks

Key ideas

Scroll to read ↓

A model can know the public literature yet lack depth in your domain. Learning from private context requires more than fitting documents: it requires training tasks that keep improving with the model.

  • Where does depth come from?
    1:07 ↗
  • What public training leaves out
    2:27 ↗
  • Applying scale to your data
    4:33 ↗
  • A fixed corpus and a pretrained model
    7:17 ↗
  • Fitting documents is not the same as using them
    10:27 ↗
  • Keeping the effect of context in a smaller representation
    12:03 ↗
  • Training the behavior that context enables
    13:10 ↗
  • Simulating pretraining, then constructing RL tasks
    14:24 ↗
  • What happens after the model fits the training data?
    16:05 ↗
  • Making the learning tasks improve with the model
    17:26 ↗

Key ideas

Scroll to read ↓

A model can read your documents without learning to use them. Jack Morris explores what it takes to turn private knowledge into lasting capabilities—and where retrieval still belongs.

  • Why can’t ChatGPT learn the thing you need?
    0:22 ↗
  • Reading everything has a cost
    3:28 ↗
  • Accepting tokens is different from using them
    5:56 ↗
  • Embeddings are convenient, but they are not encryption
    10:44 ↗
  • When Visa and Mastercard are too similar
    14:41 ↗
  • Pay for reasoning at training time or inference time
    20:00 ↗
  • What should a model spend its capacity on?
    22:37 ↗
  • A model memorizes 3M—and fails to write a poem
    26:43 ↗
  • Generate material the model can learn from
    32:28 ↗
  • Change a small part of the model
    34:02 ↗
  • How much capacity does adaptation need?
    38:32 ↗
  • Prefixes, memory layers, and sparse learning signals
    41:14 ↗
  • Training and retrieval will coexist
    44:48 ↗
  • From proprietary documents to a shorter prompt
    50:34 ↗
  • What happens when the training data is wrong?
    55:06 ↗
  • Specialized models that can keep learning
    58:42 ↗

References