Understanding Data Engineering
Learn the role of a data engineer, the types of problems they solve and the full data workflow from sources to analytical models.
YOUR LEARNING PATH
Build pipelines and systems that collect, transform and deliver data.
A free self-paced learning path with curated external learning resources.
The role of a data engineer, typical tasks and the complete data workflow — from sources to analytical models.
Learn the role of a data engineer, the types of problems they solve and the full data workflow from sources to analytical models.
Official Google Cloud course. Some hands-on labs may require paid access, but the free content is still worth exploring.
Learn Python, clean and analyze data with pandas, and work in notebooks.
Learn Python fundamentals through short explanations and hands-on notebook exercises.
Practice selecting, filtering, grouping, combining and transforming tabular data.
Handle missing values, inconsistent formats, encodings and other common data-quality problems.
Create clear exploratory charts with Python and communicate patterns in data.
Practice Python in a free cloud-based notebook.
Retrieve, filter, aggregate and combine data, then use CTEs and window functions.
Learn SQL through short interactive lessons and browser-based exercises.
Learn SQL for data analysis from basic through intermediate and advanced topics.
Practice basic queries, GROUP BY, CTEs and JOINs using BigQuery.
Learn JOINs, UNIONs, window functions, nested data and query optimization.
Start a free database, load a CSV and write queries in the built-in SQL Editor.
Install SQLite, create a database and run queries without setting up a database server.
Data warehouse architecture, data modeling, OLAP systems and organization of analytical data.
Learn the architecture, modeling and tools used to build modern data warehouses and analytical pipelines.
Explore different data modeling approaches and techniques for building effective data architectures.
Design analytical models and build tested, documented SQL transformations.
Take dbt Labs’ free course on models, sources, tests, documentation and deployment.
Build a working dbt project by following official hands-on guides.
Study facts, dimensions and common warehouse modeling techniques.
Build reliable batch pipelines with dependencies, retries, schedules and monitoring.
Build workflows, TaskFlow DAGs and a complete data pipeline with official tutorials.
Take free courses on Airflow fundamentals, DAG authoring and operations.
Follow an open course covering ingestion, orchestration, warehouses and streaming.
Containerize data services, version your code and automate quality checks.
Learn images, containers, volumes, networks and multi-container applications.
Read the free official Git book and learn branches, remotes and collaboration.
Create a free CI workflow that runs whenever your repository changes.
Apply the skills from this learning path by building complete data pipelines with Docker, cloud infrastructure, orchestration, dbt and modern data engineering tools.
Follow an open course covering ingestion, orchestration, warehouses and streaming.