▶ Watch ↗AI Engineer World's Fair 202620:14
Conference affiliation: VP of Kernels · Together AI · 2026
Dan Fu is an assistant professor of computer science and engineering at UC San Diego, vice president of kernels at Together AI, and a co-creator of FlashAttention, the influential algorithm that accelerated transformer models by reorganizing how GPUs access memory. His research makes AI models faster and more practical by designing algorithms, model architectures, and GPU kernels around the actual behavior of modern hardware.
Fu studied computer science at Harvard before completing doctoral research at Stanford with Christopher Ré and Kayvon Fatahalian. Earlier work spanned automatic parallelization, video analysis, and weak supervision; he also interned at Google and Argo AI and founded the Stanford MLSys Seminar in 2020. He began collaborating with Together AI as an academic partner in 2022 and now leads UC San Diego’s SandyResearch Lab alongside Together’s production-oriented kernels team.
Fu, Tri Dao, and collaborators introduced FlashAttention in 2022. Its IO-aware attention algorithm computes exact attention while reducing transfers between GPU memory and faster on-chip storage, using tiled computation and kernel fusion to improve speed without approximation. Fu subsequently helped bring the approach to Stable Diffusion and Hugging Face Diffusers.
▶ Watch ↗AI Engineer World's Fair 202620:14
Loading more talks and highlights…