BUILD: The Dev Conference for AI & Apps (Nov. 4-6)

Hear the latest product announcements and push the limits of what can be built in the AI Data Cloud.

SNOWFLAKE CERTIFIED SOLUTION

Data Connectivity with Snowflake Openflow

If custom, include snippet:

SELECT PARSE_JSON(
  SNOWFLAKE.CORTEX.SEARCH_PREVIEW(
    '<openflow_db>.<openflow_schema>.<<SLACK_CORTEX_SEARCH>',
    '{
      "query": "What is my vacation carry over policy?",
      "columns": ["text","channel","ts","username"],
      "filter": {"@contains": {"memberemails": "[email protected]"}},
      "limit": 10
    }'
  )
)['results'] AS results;

Overview

Snowflake Openflow is an open, extensible, managed multi-modal data integration service that makes data movement effortless between data sources and destinations, supporting all data types including structured and unstructured, batch and streaming.

Openflow revolutionizes data movement directly with Snowflake, enabling ETL for AI. All data integration is unified in one platform with limitless extensibility and interoperability to connect to any data source, and facilitates any data architecture, with enterprise-grade reliability and governance. 

With Snowflake Openflow, you can move data effortlessly and scale with confidence for all your integration needs, in one single platform.

Use Case

Change Data Capture (CDC) from OLTP Databases for Operational Analytics

Get real-time insights from your most critical business applications without risking application performance or building complex pipelines. With Openflow, you can turn your OLTP data into a powerful analytical asset in minutes, not months, and empower your business with near real-time operational intelligence.

Openflow Connectors for MySQL, PostgreSQL, or SQL Server managed connectors stream changes directly from the source database's logs into Snowflake, creating a near real-time replica of the operational data without impacting the source system's performance.

Fig1: Openflow Connectors for MySQL, PostgreSQL, or SQL Server are a simple, low-impact solution.

Use Case

Near real-time analytics on streaming systems like Kafka and Kinesis

Build faster real-time analytics applications on your streaming pipelines (Kafka, Kinesis) at lower cost and complexity of your current environment. Eliminate infrastructure management entirely and empower your teams to focus on business logic and insights. Write the insights generated in Snowflake back to Kafka for triggering downstream actions.

Compared to other solutions, streaming connectors on Openflow are easy to use (no-code), interoperable with Iceberg support, support in-flight transformations and automatically scale according to your throughput so you only pay for what you use.

Fig 2: Openflow streaming connectors including Openflow Connector for Kafka, Openflow Connector for Kinesis and Snowflake to Kafka connector along with Snowpipe Streaming

Explore more resources for this use case

Use Case

Unlocking unstructured enterprise data for generative AI

Transform your scattered enterprise multi-modal data into a secure, centralized, and AI-ready knowledge base. Build powerful generative AI applications and search tools in days, not months, by leveraging Snowflake's single, integrated platform with both  connectivity to multi-modal data and AI. Stop building complex pipelines and start innovating with your most valuable data.

Instead of building complex, manual pipelines to extract text, parse documents, chunk content, and then generate embeddings, use Snowflake Openflow to extract directly from source systems with built-in processors to parse and chunk documents leveraging Snowflake Cortex.

Fig 3: An enterprise's most valuable proprietary knowledge is often trapped in unstructured formats—  PDFs, presentations, images, audio and video files—scattered across systems like SharePoint and Google Drive.

Explore more resources for this use case

SNOWFLAKE CERTIFIED SOLUTION

This solution was created by an in-house Snowflake expert and has been verified to work with current Snowflake instances as of the date of publication.

Solution not working as expected? Contact our team for assistance.

EXPLORE USE CASES
  • CDC from OLTP databases
  • Near real-time analytics on streaming systems
  • Unlock unstructured enterprise data for generative AI
SNOWFLAKE FEATURES USED
  • Data Governance
  • Secure Data Sharing
  • Openflow
SHARE SOLUTION

what’s next?

Explore more developer content and build your skills.