▶ Watch ↗AI Engineer World's Fair 202617:01
Conference affiliation: Amazon
Tarun Sunkaraneni works on the software surrounding machine-learning models: representing conversations for training, making model deployment practical, and keeping GPUs supplied with data. His multimodal training work, presented while affiliated with Amazon AGI at AI Engineer World’s Fair 2026, examines how image preparation and data movement can limit performance even when GPU capacity is available.
Sunkaraneni graduated from the University of Utah with a computer-science bachelor’s degree in 2020, working in its natural-language processing group under Vivek Srikumar. His honors thesis, Transformer-Based Observers in Psychotherapy, explored how language models could classify patient and therapist utterances in motivational interviewing to support feedback on counseling practices.
The central challenge was representing dialogue for transformers. Models pretrained on written passages needed to distinguish speakers, conversational turns, and the particular utterance being classified. Sunkaraneni tested encodings that made those distinctions explicit, alongside training approaches that combined patient and therapist classification. The unified approach improved patient-label predictions in his experiments. The accompanying bert-therapy repository contains experimental code and runtime scripts.
The thesis also examined whether better predictions came with useful explanations. Gradient-based saliency maps gave disproportionate importance to special tokens, while attention visualizations did not consistently reveal interpretable patterns. These methods offered limited insight into why the models made their classifications.
During a summer 2020 internship on Plaid’s Domestic Integrations team, Sunkaraneni worked on an internal HTTP request library intended to reduce latency, improve parallelism, and support newer networking protocols. The work addressed infrastructure for financial integrations that had to accommodate changes in partner institutions’ systems.
He subsequently joined Microsoft. His involvement in Azure Bicep, the language for describing and deploying cloud resources, included an assignment to an issue concerning misleading errors caused by commas in arrays. The issue illustrates a practical developer-tooling concern: diagnostics need to help infrastructure authors identify the actual mistake in a configuration file.
Sunkaraneni’s later projects address two different constraints on using models effectively:
His performance work also shows why an optimization must be judged at the scale where it will run. Once image preparation and transfers improved, a single machine’s network card became the limiting resource. Spreading workers across nodes and using zero-copy reads produced a further reported 50% increase in throughput. The useful lesson is to follow the bottleneck as it moves: faster model execution cannot compensate for a pipeline that fails to deliver the next batch.
▶ Watch ↗AI Engineer World's Fair 202617:01
Loading more talks and highlights…