Learn how we increased embedding throughput 3x in Snowflake Cortex—and 16x vs. vLLM—through smarter serialization, tokenization, and GPU optimization.
MAY 29, 2025|8 min read
Jerry Luo
Jerry works on the LLM Inference Platform at Snowflake, specializes in AI systems and serving infrastructure.
