Skip to main content

Fundamentals of Apache Kafka

2h 33m 26s
English
Paid

Learn the Basics of Apache Kafka from Scratch and Master Building Reliable, Scalable Real-time Data Processing Systems.

Course Overview

In this course, you will become familiar with Kafka's architecture, the principles of producers and consumers, ensuring reliability of stream processing, message delivery semantics, and tools from the Kafka ecosystem—such as Kafka Connect and Schema Registry.

Apache Kafka is at the core of real-time data processing systems used by the most innovative companies in the world. If you want to understand how massive data streams are processed "on the fly," this course will be an excellent starting point.

What You Will Learn

Understanding Kafka Architecture

Gain practical insights into how Kafka is structured and why this is important. You'll explore the system's architecture and its key components.

Building Producers and Consumers

Learn to create robust producers and consumers for data streams, crucial for processing real-time information effectively.

Data Processing and Delivery Methods

Understand the trade-offs between different data delivery methods and how Kafka ensures reliable data processing.

Tools in the Kafka Ecosystem

  • Kafka Connect: Discover how to integrate Kafka with other systems using connectors.
  • Schema Registry: Learn about managing and validating data formats in Kafka pipelines.

Course Outcomes

By the end of the course, you won't just understand how Kafka works—you will be able to use it to build reliable, scalable real-time data processing systems, equipped to handle real-world challenges.

About the Author: zerotomastery.io

zerotomastery.io thumbnail
Whether you are just starting to learn to code or want to advance your skills, Zero To Mastery Academy will teach you React, Javascript, Python, CSS and more to help you advance your career, get hired and succeed at some of the top companies in the world.

Watch Online 26 lessons

This is a demo lesson (10:00 remaining)

You can watch up to 10 minutes for free. Subscribe to unlock all 26 lessons in this course and access 10,000+ hours of premium content across all courses.

View Pricing
0:00
/
#1: Introduction
All Course Lessons (26)
#Lesson TitleDurationAccess
1
Introduction Demo
08:21
2
What Is Apache Kafka?
07:00
3
[Optional] What Is a Virtualenv?
06:37
4
[Optional] What Is Docker?
11:03
5
Partitioning Data
08:56
6
Kafka API
07:42
7
Kafka Architecture
03:15
8
Set Up Kafka
05:53
9
Writing to Kafka
06:07
10
Reading from Kafka
07:37
11
Data Durability
06:39
12
Kafka vs Queues
02:11
13
[Exercise] Processing Records
03:44
14
[Exercise] Processing Records - Solution
02:59
15
Delivery Semantics
05:53
16
Kafka Transactions
04:34
17
Log Compaction
03:23
18
Kafka Connect
06:59
19
Using Kafka Connect
09:44
20
Outbox Pattern
04:31
21
Schema Registry
08:01
22
Using Schema Registry
08:10
23
Tiered Storage
03:28
24
[Exercise] Track Order Status Changes
04:27
25
[Exercise] Track Order Status Changes - Solution
05:06
26
Let's Keep Learning Together!
01:06
Unlock unlimited learning

Get instant access to all 25 lessons in this course, plus thousands of other premium courses. One subscription, unlimited knowledge.

Learn more about subscription