▶ Watch ↗AI Engineer World's Fair 202417:25
Conference affiliation: Mozilla · 2024
Justine Tunney created Cosmopolitan Libc and llamafile, open-source projects that package sophisticated software—including large language models—as portable executables. By combining cross-platform distribution with faster CPU inference, she makes advanced models practical on ordinary computers without complicated installation or expensive dedicated hardware.
At Google, Tunney contributed to the domain-registry platform Nomulus, the Bazel build system, TensorFlow, and TensorBoard, where she served as a technical lead. In 2016, she organized Operation Rosehub, using BigQuery to identify approximately 2,600 GitHub repositories dependent on a vulnerable Java library and coordinating roughly 50 Google employees to help submit fixes.
After leaving Google in 2018, Tunney concentrated on independent open-source development. Her Cosmopolitan C library produces native programs that run across Windows, macOS, Linux, and multiple BSD systems. Its Actually Portable Executable format combines otherwise incompatible executable conventions inside a single binary. She applied the same architecture to Redbean, a self-contained web server capable of carrying its application and assets inside the executable.
In November 2023, Tunney and Mozilla introduced llamafile, combining Cosmopolitan with llama.cpp to distribute model weights and inference software together. The open-source project lets users run compatible models locally across supported operating systems while retaining control over their data and operating without an internet connection.
▶ Watch ↗AI Engineer World's Fair 202417:25
Loading more talks and highlights…