Learn how to scale real-time model serving with GPU optimization, dynamic batching, and latency tuning to maximize ML inference performance
FEB 12, 2026|8 min read
Vivek Alamuri
Vivek Alamuri is a Software Engineer on the Model Serving team, focused on the intersection of machine learning infrastructure, performance, and LLM serving. He previously worked on inference, retrieval, and model training through his various research experiences. Vivek earned his Bachelor’s degree in Computer Engineering from the University of Waterloo in 2025. Outside of work, you’ll find him at a volleyball court, or making ML related videos on his social media.
