Skip to main content

Distributed Tasks Demystified with Celery, SQS & Python

4h 27m 50s
English
Paid

Course description

This course teaches beginners to industry professionals the fundamental concepts of Distributed Programming in the context of python & Django.  We look at how to build applications that increase throughput and reduce latency.  In this course, we will take a dive intially in the irst part of the course and build a strong foundation of asynchronous parallel tasks using python-celery a distributed task queue framework. We will explore AWS SQS for scaling our parallel tasks on the cloud.

Read more about the course

These fundamentals will aid you in building scalable Python solutions for virtually any python project. By the end of this course, you will have learnt how to use popular distributed programming frameworks for python and Django. Through concepts learnt, you will discover the world of distributed computing with Python and how easy it is to build distributed components into your python or Django projects.


Watch Online

This is a demo lesson (10:00 remaining)

You can watch up to 10 minutes for free. Subscribe to unlock all 39 lessons in this course and access 10,000+ hours of premium content across all courses.

View Pricing
0:00
/
#1: Introduction

All Course Lessons (39)

#Lesson TitleDurationAccess
1
Introduction Demo
05:13
2
Prepping up your environment
07:24
3
Blocking vs non blocking (part 1)
06:11
4
Blocking vs non blocking (part 2)
05:01
5
Concurrency Consumer & Producer problem a deep dive
06:38
6
Solving Consumer producers problem with Mutual Exlusion
06:19
7
Controlling threads with conditions (Part 1)
02:24
8
Controlling threads with conditions (Part 2)
08:17
9
Controlling threads with conditions (Part 3)
03:51
10
Daemon threads by example (Part 4)
02:06
11
Consumer producer a thread safe FIFO queue
05:57
12
Getting started with Celery
05:53
13
Celery backends & Asyncresult by example
08:45
14
Python exception handling back to the basics
13:43
15
Exception handling in Celery Explained
09:24
16
Celery scheduled periodic tasks (Part 1)
04:45
17
Celery scheduled periodic tasks (Part 2)
04:43
18
Celery scheduled periodic tasks How to apply Mutex (Part 3)
10:39
19
Celery scheduled periodic tasks solar schedules
01:21
20
Introduction to distributed tasks with AWS SQS
14:00
21
Creating your first AWS SQS Queue with your AWS Console
05:21
22
How to create a AWS SQS background worker in python (Part 1)
08:04
23
How to create a AWS SQS background worker in python (Part 2)
09:43
24
Dead-letter Queues the theory
07:12
25
Dead-letter Queues illustrated
10:17
26
How to bypass AWS SQS (Simple Queue Service) 256kb payload limit
10:33
27
Introduction Project #1
01:05
28
Real world examples of data ingestors
04:00
29
Creating a twitter developer application and Authentication Token
06:17
30
Building your first social ingestor twitter (Part 1)
01:23
31
Building your first social ingestor twitter (Part 2)
03:35
32
Building your first social ingestor twitter Rate Limits (Part 3)
08:53
33
Building your first social ingestor twitter Handle (Part 4)
12:11
34
Building your first social ingestor twitter Handle (Part 5)
07:53
35
Basic fundamentals of SMTP and transactional email Services
04:21
36
Creating your first background email worker (Part 1)
11:49
37
Creating your first background email worker (Part 2)
11:23
38
Creating your first background email worker (Part 3)
03:21
39
Quick start guide: Getting started with PyCharm IDE (Mac)
07:55

Unlock unlimited learning

Get instant access to all 38 lessons in this course, plus thousands of other premium courses. One subscription, unlimited knowledge.

Learn more about subscription

Comments

0 comments

Want to join the conversation?

Sign in to comment

Similar courses

Python 3: Deep Dive (Part 2 - Iteration, Generators)

Python 3: Deep Dive (Part 2 - Iteration, Generators)

Sources: udemy
I will show you exactly how iteration works in Python - from the sequence protocol, to the iterable and iterator protocols, and how we can write our own sequence and iterable da...
34 hours 42 minutes 47 seconds
The Complete Guide to Django REST Framework and Vue JS

The Complete Guide to Django REST Framework and Vue JS

Sources: udemy
Hi! Welcome to The Complete Guide to Django REST Framework and Vue JS course! In this course you will learn how to create professional REST APIs with Python and Django REST Fram...
13 hours 40 minutes 40 seconds
100 Days of Code - The Complete Python Pro Bootcamp for 2023

100 Days of Code - The Complete Python Pro Bootcamp for 2023

Sources: udemy
Welcome to the 100 Days of Code - The Complete Python Pro Bootcamp, the only course you need to learn to code with Python. With over 100,000 reviews and a 4.8 a
58 hours 35 minutes 40 seconds
The Complete Python Programming Course for Beginners

The Complete Python Programming Course for Beginners

Sources: codewithmosh (Mosh Hamedani)
Python is the most popular programming language in the world. It's used by big companies like Google, Facebook, Dropbox, Reddit, Spotify, Quora, etc. Mathematicians, scientists,...
11 hours 56 minutes 40 seconds
Async Techniques and Examples in Python

Async Techniques and Examples in Python

Sources: Talkpython
Python's async and parallel programming support is highly underrated. In this course, you will learn the entire spectrum of Python's parallel APIs. We will start with covering t...
5 hours 2 minutes 11 seconds