Rémi Louf

Rémi Louf is co-founder and chief executive of .txt and a creator of Outlines, the open-source library that made structured generation a practical building block for reliable AI applications. His work confronts a basic mismatch: language models produce probabilistic text, while software depends on predictable formats, typed data, and interfaces that behave consistently.

Louf began in theoretical physics, applying statistical methods to urban congestion, residential segregation, street patterns, and transportation networks in his 2015 doctoral thesis. He subsequently worked in data science and research engineering, with positions at Kering, Hugging Face, Ampersand, and Normal Computing before co-founding .txt.

His early software projects centered on Bayesian inference and computational statistics. He is the original author of BlackJAX, a modular JAX-based inference library, and co-authored its research paper. He also contributed to Aesara, a framework for mathematical computation, and created MCX, which compiles probabilistic programs for accelerated inference.

With Outlines, Louf redirected that systems-oriented background toward generative AI. Developers can specify regular expressions, JSON Schema, or Pydantic models before generation, requiring outputs such as valid IP addresses, typed flight information, three-letter airport codes, or structured descriptions extracted from images. OpenAI later credited Outlines among the projects that inspired its Structured Outputs.

• Treat model outputs as software interfaces. Malformed JSON and inconsistent fields are reliability failures, not merely disappointing answers. Louf advocates enforcing an application’s required format during generation instead of depending on elaborate prompts, retries, and downstream cleanup.

• Apply constrained decoding at the token level. Outlines excludes next-token continuations that violate the specified structure before sampling. Predetermined punctuation and field names can reduce unnecessary generation, although valid syntax does not guarantee factual accuracy, sound reasoning, or a correct answer.

• Improve open models through stronger infrastructure. Outlines integrates with inference tools including vLLM, Transformers, llama.cpp, and MLX. In an exploratory Mistral experiment, structured one-shot prompting approached the accuracy of unstructured eight-shot prompting on GSM8K, a suggestive result rather than a universal performance claim.

• Extend structure beyond JSON. Louf’s interests include context-free grammars for more expressive formats and semantic constraints that limit SQL generation to real table and column names. Such constraints can make a query executable without ensuring it answers the intended question.

More recently, Louf published zeta, an open-source agent operating system that extends his interest in dependable infrastructure for probabilistic software.