No more separation of streaming and batch pipelines. Unified ingestion and transformation in a single system.
Unify stream and batch processing pipelines in just one architecture. Stream and process data at low latency exactly where your historical data is. Processing streaming data is as easy as writing a CTAS (Create Table As Select) SQL query — with Snowflake Dynamic Tables (public preview), customers can use simple, ubiquitous SQL to create low latency, incremental pipelines for an array of streaming use cases.
Streaming ingest for rowsets is as much as 50% cheaper than file ingestion at the same volume. Dynamic Tables help you avoid wasted compute by providing performance guidance with incremental or full refresh for more efficient transformations.
Since streaming capabilities are deeply integrated with the Data Cloud, you can still enjoy the security and governance capabilities you’ve come to rely on through Snowflake Horizon.
Snowflake helps you handle both streaming and batch data ingestion and transformation in a single system.
Stream row-set data in near real time with single-digit latency using Snowpipe Streaming, or auto-ingest files with Snowpipe. Both options are serverless so you can scale more easily and manage costs more effectively.
With Dynamic Tables1, you can use SQL or Python to declaratively define data transformations. Snowflake will manage the dependencies and automatically materialize results based on your freshness targets. Dynamic Tables only operate on data that has changed since the last refresh, making high data volumes and complex pipelines simpler and more cost-efficient.
Easily adapt to evolving business needs by making a batch pipeline into a streaming pipeline — with a single latency parameter change.
1 In Public Preview
Snowflake is helping us fulfill our vision to centralize data and is quickly becoming our enterprise data platform across the city.”
Chief Technology Officer, Department of Technology
City and County of San Francisco
Faster data refresh operations with 18x more data.
Faster data refresh in Tableau dashboards
Follow along with Snowflake's Quickstart Tutorials or join an upcoming webinar to get up and running with Snowflake Dynamic Tables.
Try Snowflake free for 30 days and experience the Data Cloud that helps eliminate the complexity, cost and constraints inherent with other solutions.