▶ Watch ↗AI Engineer World's Fair 202619:48
Conference affiliation: TikTok · 2026
Salman Munaf is a reliability engineer whose work spans video infrastructure, distributed systems, and the operational problems of AI. He has worked as a lead site reliability engineer at TikTok, following software engineering work at Meta, and brings that infrastructure perspective to two connected questions: how to understand language-model systems in production, and how to control agents that can change the world outside a conversation.
Munaf earned a computer-science degree with High Distinction from LUMS, marking his graduation in a public post. His subsequent career included software engineering at Meta and reliability engineering focused on video infrastructure and distributed systems at TikTok. That progression connects building software with keeping interconnected services dependable when requests fail, information becomes stale, or parts of a workflow succeed independently of others.
His work on LLM observability and GPU inference extends this operational focus into language-model infrastructure. Variable model outputs complicate the task of understanding application behavior, while inference introduces its own performance and resource concerns: token throughput, latency, GPU utilization, memory pressure, and energy efficiency. These dimensions matter together. Understanding what an AI system produces requires attention to the infrastructure delivering those outputs, including how quickly it responds and how efficiently it uses compute.
Agents add another layer of responsibility. Once a model can issue a refund, update a record, or send a customer message, an incorrect answer can become an external state change. Munaf treats the agent as a probabilistic coordinator: it chooses actions within a workflow, but its choices vary in ways that predefined service logic does not. His approach to agent reliability places deterministic controls around those decisions, with explicit limits, authoritative state, and recovery paths.
Across inference infrastructure and agent execution, Munaf’s reliability perspective asks engineers to account for behavior beyond the model itself. Stronger models can reduce mistakes, but they cannot eliminate network failures, stale information, or adversarial input. The surrounding software must make consequential actions observable, bounded, and recoverable—even when the agent makes the wrong choice.
▶ Watch ↗AI Engineer World's Fair 202619:48
Loading more talks and highlights…