← All speakers

Bio, Work & Ideas

Petro Junior Milan

Conference affiliation: SambaNova Systems · 2024

Petro Junior Milan is a senior solutions architect at NVIDIA specializing in large-language-model inference and agentic AI. His career spans aerospace engineering, scientific machine learning, specialized computing hardware, and enterprise generative AI.

Milan completed a doctorate in aerospace engineering and a master’s degree in computational science and engineering at Georgia Tech in 2021, following a 2020 internship at Argonne National Laboratory. His doctoral research applied deep learning to computationally intensive propulsion and fluid-dynamics problems, including neural-network approaches to calculating real-fluid properties.

He joined SambaNova Systems in 2021 to work on AI for science and coauthored research on adaptive machine learning for X-ray free-electron lasers. Selected for the National Academy of Engineering’s U.S. Frontiers of Engineering symposium in 2023, he advanced to principal AI engineer at SambaNova, where his responsibilities expanded into prompt engineering, retrieval-augmented generation, fine-tuning, and agentic workflows. He subsequently joined NVIDIA as a senior solutions architect.

Technical priorities

  • Scientific machine learning for physical systems. Milan has applied neural networks to fluid-property calculations, propulsion simulations, and scientific instruments requiring fast model adaptation.
  • Enterprise retrieval grounded in real documents. At AI Engineer World’s Fair 2024, he led the practical portion of a SambaNova workshop, building a document question-answering pipeline with PDF ingestion, configurable chunking, E5-large-v2 embeddings, ChromaDB, semantic retrieval, and Llama 3. Related examples are available in SambaNova’s company-owned AI Starter Kit.
  • Inference performance beyond token throughput. He distinguishes generation speed from time to first token and total response latency, connecting those measurements to responsive chat, live drafting, and interactive prompt development.
  • Deployment details that shape application quality. His implementation priorities include model-specific prompt formatting, generation parameters, document-parser selection, retrieval configuration, optional reranking, and whether embeddings run on conventional processors or specialized hardware.

Read the topics behind these talks

1 conference talk

Key ideas

Scroll to read ↓

Build from a single SambaStudio inference call to a retrieval pipeline, following the workshop’s expert routing, memory hierarchy, prompt formatting and PDF search examples.

  • What does fast inference make possible?
    0:17 ↗
  • Integrating the path from hardware to models
    4:24 ↗
  • Combining broad capabilities with enterprise specialists
    8:28 ↗
  • Choosing, evaluating and invoking experts
    14:38 ↗
  • Keeping many models close to compute
    18:37 ↗
  • A workout plan, then responses while typing
    21:32 ↗
  • Preparing the basic inference notebook
    26:14 ↗
  • Configuring inference and marking the assistant turn
    33:02 ↗
  • Adding document retrieval before generation
    37:31 ↗
  • Preparing the PDF-processing environment
    41:57 ↗
  • Indexing the SN40L paper and asking a question
    46:40 ↗
  • The harder test: retrieving from a table
    52:38 ↗

References