Skip to content
Blog/Juncheng Yang

Juncheng Yang

Research Scientist
Juncheng is a visiting research scientist working on LLM inference optimizations.
MAY 29, 2025Gen AI

Arctic Inference with Shift Parallelism: The Fastest Open Source Inference System for Enterprise AI

Samyam Rajbhandari
Samyam Rajbhandari +8
MAY 29, 2025Gen AI

Scaling vLLM for Embeddings: 16x Throughput and Cost Reduction

Charles Xu +6