Snowflake's ALST enables scalable training of long-context models with up to 15 million tokens using Hugging Face and DeepSpeed, all without custom modeling code.
JUN 24, 2025|10 min read
Arctic Inference with Shift Parallelism: The Fastest Open Source Inference System for Enterprise AI
Built by Snowflake AI Research, Arctic Inference uses Shift Parallelism, SwiftKV, and speculative decoding to power the fastest open-source enterprise AI.
MAY 29, 2025|15 min read
Low-Latency and High-Throughput Inference for Long Context with Sequence Parallelism (aka Arctic Ulysses)
Ulysses, a novel sequence parallelism technique, boosts long-context LLM inference performance with 3.4x lower latency and better GPU efficiency.
APR 03, 2025|14 min read
SwiftKV from Snowflake AI Research Reduces Inference Costs of Meta Llama LLMs up to 75% on Cortex AI
SwiftKV optimizes Meta Llama LLMs on Snowflake Cortex AI, reducing inference costs by up to 75% while maintaining accuracy for enterprise AI solutions.
JAN 16, 2025|5 min read
