How Do You Get There?
Use the Snowpark Migration Accelerator
The Snowpark Migration Accelerator has been developed by Snowflake to help you understand the Spark code you have, and get you up and running in Snowpark faster and more efficiently. There are two components to this tool: an assessment and code conversion. There is an initial assessment based on code files, libraries, and spark references present in any codebase written in Python or Scala. The output allows you to understand what you have and what can be converted to Snowpark. From that assessment, the accelerator can automatically convert some references from the Spark API to the Snowpark API.
The Snowpark Migration Accelerator is available for free with zero obligation. You can download the installer by using the links below depending on your OS:
How does it work?
The Snowpark Migration Accelerator is a free tool that you can download and run on a local machine or in a container. This tool takes in code files or notebooks as an input. (It does not connect to any source platform; it only scans files.) The files will be scanned and an assessment report will be created locally that indicates the “readiness” level of your Spark workload for Snowpark.
Once the assessment is created, the Snowpark Migration Accelerator can convert some references from the Spark API to the Snowpark API based on the functional equivalence between the source and the target. What the tool cannot convert will be inventoried and tagged with comments in the output code to indicate the next steps.
For more information on installing and using this accelerator, visit the getting started section of the Snowpark Migration Accelerator documentation.