Build Data Engineering Pipelines Using Snowpark in Snowflake Notebooks

Get started building data engineering pipelines using Snowpark in Snowflake Notebooks. In this session, you'll learn how to build a pipeline with Python in Snowflake and then manage and deploy that notebook through an automated CI/CD.

In this session, we’ll show you how to build:
 

• A data share from the Snowflake Marketplace to access weather data
• A data engineering pipeline with a Notebook to ingest Excel files into Snowflake
• A data engineering pipeline with a Notebook to transform and aggregate data
• A DAG (or Directed Acyclic Graph) of Tasks to orchestrate/schedule the pipelines
• A CI/CD pipeline to deploy the Notebooks to production