Fundamentals of Apache Airflow

Name: Fundamentals of Apache Airflow
Price: 9 USD
Availability: InStock

2h 21m 18s

English

Paid

October 18, 2025

Course description

This practical course starts with the basics and step by step guides you to building real orchestration scenarios - from task retries to integration with Spark and loading external data.

Moving data from point A to point B is only a small part of the task. It is important that data is delivered accurately, reliably, and automatically - and this is where Apache Airflow comes to the rescue.

You will learn how to transform chaotic, manually configured pipelines into well-organized workflows. We'll begin with understanding the architecture of Airflow and its key components, followed by mastering more advanced techniques: setting up retries, handling failures, using sensors, working with Apache Spark, and automatically loading data from external sources into a data lake.

The course is suitable for both beginner data engineers and those who want to improve their orchestration skills. You will receive real practical tools for creating scalable and reliable data processing systems.

Watch Online

Watch Online Fundamentals of Apache Airflow

0:00

#1: Introduction

All Course Lessons (27)

#	Lesson Title	Duration
1	Introduction Demo	07:20
2	What Is Apache Airflow?	05:19
3	AirflowвЂ™s Architecture	03:15
4	[Optional] What Is a Virtualenv?	06:37
5	[Optional] What Is Docker?	11:03
6	Installing Spark	05:51
7	Installing Airflow	06:33
8	Defining an Airflow DAG	08:03
9	Errors Handling	03:38
10	Idempotent Tasks	04:54
11	Creating a DAG - Part 1	04:58
12	Creating a DAG - Part 2	04:42
13	Handling Failed Tasks	04:09
14	[Exercise] Data Validation	04:31
15	[Exercise] Data Validation - Solution	03:27
16	Spark with Airflow	03:02
17	Using Spark with Airflow - Part 1	07:39
18	Using Spark with Airflow - Part 2	05:52
19	Sensors In Airflow	04:46
20	Using File Sensors	04:08
21	Data Ingestion	05:50
22	Reading Data From Postgres - Part 1	06:03
23	Reading Data from Postgres - Part 2	05:40
24	[Exercise] Average Customer Review	03:53
25	[Exercise] Average Customer Review - Solution	04:33
26	Advanced DAGs	04:26
27	Let's Keep Learning Together!	01:06

Unlock unlimited learning

Get instant access to all 26 lessons in this course, plus thousands of other premium courses. One subscription, unlimited knowledge.

Learn more about subscription

Comments

0 comments

Want to join the conversation?

Similar courses

SQL & Database Design A-Z™: Learn MS SQL Server + PostgreSQL

Sources: udemy

Are you interested in a career in Data Science or Data Analytics? In that case, inevitably you are going to encounter databases in your work. But how do you int

12 hours 32 minutes 7 seconds

Becoming a Better Data Engineer

Sources: Andreas Kretz

Data engineering is not just about moving information from one place to another. It is about creating reliable, scalable, and efficient systems that...

1 hour 46 minutes 10 seconds

Time Series Analysis, Forecasting, and Machine Learning

Sources: udemy

Let me cut to the chase. This is not your average Time Series Analysis course. This course covers modern developments such as deep learning, time series classif

22 hours 47 minutes 45 seconds

Complete Machine Learning and Data Science: Zero to Mastery

Sources: udemy, zerotomastery.io

This is a brand new Machine Learning and Data Science course just launched January 2020 and updated this month with the latest trends and skills! Become a complete Data Scientis...

43 hours 22 minutes 23 seconds

Apache Iceberg Fundamentals

Sources: David Reger

Modern data platforms need the flexibility of data lakes and the reliability of warehouses. Apache Iceberg combines both approaches. In this course, you will...

33 minutes 32 seconds