Data Engineering Guide

Articles about important cloud data engineering topics, including ETL, data integration, and JSON.

Data Science Pipeline

Learn how data science pipelines automate the processes of data validation; extract, transform, load (ETL); machine learning and modeling.

ETL vs ELT

Discover the key differences in ETL vs. ELT as well as some of the benefits in preparing data for analysis and additional processing..

What is a CI/CD Pipeline?

Learn about CI/CD pipelines, which is an end-to-end software delivery process used to deploy new and updated software safely.

ETL Pipeline

An ETL pipeline is the set of processes used to move data from a source or multiple sources into a database such as a data warehouse. Learn more.

What is ETL (Extract, Transform, Load)?

Learn what is ETL (extract, transform, load) process and how it compares against more modern data movement processes.

What is Data Modeling?

Data modeling is the process of organizing and mapping data using simplified diagrams, symbols, and text to represent data associations and flow. Learn more here.

Big Data Engineering

Big data engineering is the process of managing the ingestion and transformation of high volume data sets from various disparate sources.

Data Integration

Learn more about data integration, the process of combining data from multiple sources into a unified view to provide users actionable info.

Internet of Things (IoT) Architecture for Actionable IoT Analytics

In this article, we examine why IoT data is so valuable to companies across industries, components of an IoT architecture, and best practices for IoT analytics.