▶ Watch ↗AI Engineer Code 202516:54
Conference affiliation: Crusoe
Young Jeong’s work connects Kubernetes operations with the performance and reliability of large-scale AI workloads. As a Staff Solutions Engineer at Crusoe in his collaborative work on GB200 fine-tuning, he helped explain how GPU placement, memory constraints, and communication between accelerators shape a training system’s behavior.
At AWS, Jeong worked as a partner solutions architect focused on application modernization. His collaborative writing addressed the transition from working application code to systems that teams could deploy, debug, and operate reliably.
In 2021, he co-authored a guide to machine-learning workflows with Kubeflow and D2iQ Kaptain. Deploying model code was only part of the problem: data scientists also needed reproducible environments, distributed training, experiment management, security, and a route into production. The guide showed how a Python interface could run parallel tuning experiments, reducing the need to switch between notebooks, container builds, Kubernetes manifests, and command-line tools.
His subsequent writing extended that operational focus to migration and debugging. With Rosemary Wang and Welly Siauw, he co-authored a 2023 Consul service-mesh implementation that let services move gradually from Amazon ECS to Lambda while maintaining controlled communication across both environments. With Eran Kinsbruner and Shakthi Dakuri, he developed a guide to live troubleshooting on Amazon EKS, addressing developers’ difficulty understanding application behavior after deployment to remote clusters.
His work at Crusoe applies that operational perspective to distributed AI, where GPU memory, high-speed interconnects, scheduler placement, and communication libraries must work together. In the Llama 3.1 fine-tuning collaboration with Zoom engineers Jack Jin and Han Jin, executable Kubernetes configuration accompanies workload comparisons on GB200 NVL72. The work explains why adopting new GPUs requires attention to the whole training system, including job placement and how model state fits into memory.
▶ Watch ↗AI Engineer Code 202516:54
Loading more talks and highlights…