Apache Flink

8h 31m 38s
English
Paid

Course description

Apache Flink is a distributed system and computational engine for stateful big data streaming. That was a mouthful. In plain English, Flink is an library that allows you to process big data at scale, as it arrives, in almost real time. Flink gives you a variety of APIs that allow you to do plain functional programming on streaming data, and low-level APIs to give you ultimate control. Plus connectors to everything popular, including Kafka, JDBC, Cassandra, Pulsar, S3 and all sorts of data processors and storage systems. In this course, you'll learn how to be productive with Flink, and you'll grow as a data engineer.

Read more about the course

First of all, this course will give you everything you need to be productive with Flink:

  • You'll deeply understand the Flink streaming engine and how it works
  • You'll use functional programming on data streams
  • You'll process any kind of data in real time, at scale
  • You'll master complex transformations such as window functions
  • You'll be able to run stateful computations, which is the main strength of Flink
  • You'll know how to connect Flink to the most popular message buses, data streaming and data storage systems
  • You'll be able to design your own connectors
  • You'll be able to deploy Flink applications to a cluster
  • You'll be able to troubleshoot and find relevant information in the Flink UI

After this course, you'll be able to process data in any way you need using Flink.

But most importantly, you'll develop timeless skills that you'll carry with you for your entire career, regardless of which data streaming tool you'll end up using:

  • You'll deeply understand the practical benefits of streaming data in general
  • You'll be able to work with event time and processing time
  • You'll internalize the implications and tradeoffs of choosing latency vs throughput
  • You'll understand the need for data consistency and persistence

Watch Online

This is a demo lesson (10:00 remaining)

You can watch up to 10 minutes for free. Subscribe to unlock all 30 lessons in this course and access 10,000+ hours of premium content across all courses.

View Pricing

Watch Online Apache Flink

0:00
/
#1: Welcome

All Course Lessons (30)

#Lesson TitleDurationAccess
1
Welcome Demo
11:59
2
Scala Recap
31:05
3
Flink: First Principles
16:42
4
DataStreams
14:15
5
DataStreams: Exercise
15:07
6
DataStreams: Explicit Transformations
14:57
7
Handling Late Data: Watermarks
05:22
8
Window Functions
28:56
9
Window Functions, Part 2
26:33
10
Window Functions: Exercise
12:48
11
Time Based Transformations
33:15
12
Triggers
16:38
13
Handling Multiple Streams
33:36
14
Partitions
14:33
15
State First Principles
03:55
16
Rich Functions
22:05
17
Keyed State
24:10
18
Keyed State, Part 2
19:21
19
Checkpoints
20:16
20
Broadcast State
18:35
21
Integrations: Kafka
25:07
22
Integrations: JDBC
12:11
23
Integrations: Cassandra
09:44
24
Custom Sources
24:11
25
Custom Sinks
16:47
26
Side Outputs
08:07
27
How Flink Runs on a Cluster
07:17
28
Managing and Submitting Applications
13:48
29
Managing Applications in the Flink UI
09:47
30
You Rock!
00:31

Unlock unlimited learning

Get instant access to all 29 lessons in this course, plus thousands of other premium courses. One subscription, unlimited knowledge.

Learn more about subscription

Books

Read Book Apache Flink

#Title
1Book 1
2Book 2
3Book 3
4Book 4
5Book 5
6Book 6
7Book 7
8Book 8
9Book 9
10Book 10
11Book 11

Comments

0 comments

Want to join the conversation?

Sign in to comment

Similar courses

Build an app with ASPNET Core and Angular from scratch

Build an app with ASPNET Core and Angular from scratch

Sources: udemy
Have you learnt the basics of ASP.NET Core and Angular? Not sure where to go next? This course should be able to help with that. In this course we start from nothing and incr...
29 hours 51 minutes 36 seconds
DuckDB - The Ultimate Guide

DuckDB - The Ultimate Guide

Sources: udemy
Why should you study DuckDB? DuckDB is one of the fastest-growing technologies, with the number of search queries increasing by 1200% over the past two years!
5 hours 56 minutes 13 seconds
Streaming Databases

Streaming Databases

Sources: oreillymedia
Real-time applications are becoming the norm. However, for the model to function properly, it is necessary to obtain data in real time...
PostgreSQL High Performance Tuning Guide

PostgreSQL High Performance Tuning Guide

Sources: udemy
PostgreSQL is one of the most powerful and convenient database management systems. It is actively supported by the community and receives new releases every...
2 hours 41 minutes 14 seconds