Distributed Tasks Demystified with Celery, SQS & Python

4h 27m 50s
English
Paid

Course description

This course teaches beginners to industry professionals the fundamental concepts of Distributed Programming in the context of python & Django.  We look at how to build applications that increase throughput and reduce latency.  In this course, we will take a dive intially in the irst part of the course and build a strong foundation of asynchronous parallel tasks using python-celery a distributed task queue framework. We will explore AWS SQS for scaling our parallel tasks on the cloud.

Read more about the course

These fundamentals will aid you in building scalable Python solutions for virtually any python project. By the end of this course, you will have learnt how to use popular distributed programming frameworks for python and Django. Through concepts learnt, you will discover the world of distributed computing with Python and how easy it is to build distributed components into your python or Django projects.


Watch Online

This is a demo lesson (10:00 remaining)

You can watch up to 10 minutes for free. Subscribe to unlock all 39 lessons in this course and access 10,000+ hours of premium content across all courses.

View Pricing

Watch Online Distributed Tasks Demystified with Celery, SQS & Python

0:00
/
#1: Introduction

All Course Lessons (39)

#Lesson TitleDurationAccess
1
Introduction Demo
05:13
2
Prepping up your environment
07:24
3
Blocking vs non blocking (part 1)
06:11
4
Blocking vs non blocking (part 2)
05:01
5
Concurrency Consumer & Producer problem a deep dive
06:38
6
Solving Consumer producers problem with Mutual Exlusion
06:19
7
Controlling threads with conditions (Part 1)
02:24
8
Controlling threads with conditions (Part 2)
08:17
9
Controlling threads with conditions (Part 3)
03:51
10
Daemon threads by example (Part 4)
02:06
11
Consumer producer a thread safe FIFO queue
05:57
12
Getting started with Celery
05:53
13
Celery backends & Asyncresult by example
08:45
14
Python exception handling back to the basics
13:43
15
Exception handling in Celery Explained
09:24
16
Celery scheduled periodic tasks (Part 1)
04:45
17
Celery scheduled periodic tasks (Part 2)
04:43
18
Celery scheduled periodic tasks How to apply Mutex (Part 3)
10:39
19
Celery scheduled periodic tasks solar schedules
01:21
20
Introduction to distributed tasks with AWS SQS
14:00
21
Creating your first AWS SQS Queue with your AWS Console
05:21
22
How to create a AWS SQS background worker in python (Part 1)
08:04
23
How to create a AWS SQS background worker in python (Part 2)
09:43
24
Dead-letter Queues the theory
07:12
25
Dead-letter Queues illustrated
10:17
26
How to bypass AWS SQS (Simple Queue Service) 256kb payload limit
10:33
27
Introduction Project #1
01:05
28
Real world examples of data ingestors
04:00
29
Creating a twitter developer application and Authentication Token
06:17
30
Building your first social ingestor twitter (Part 1)
01:23
31
Building your first social ingestor twitter (Part 2)
03:35
32
Building your first social ingestor twitter Rate Limits (Part 3)
08:53
33
Building your first social ingestor twitter Handle (Part 4)
12:11
34
Building your first social ingestor twitter Handle (Part 5)
07:53
35
Basic fundamentals of SMTP and transactional email Services
04:21
36
Creating your first background email worker (Part 1)
11:49
37
Creating your first background email worker (Part 2)
11:23
38
Creating your first background email worker (Part 3)
03:21
39
Quick start guide: Getting started with PyCharm IDE (Mac)
07:55

Unlock unlimited learning

Get instant access to all 38 lessons in this course, plus thousands of other premium courses. One subscription, unlimited knowledge.

Learn more about subscription

Comments

0 comments

Want to join the conversation?

Sign in to comment

Similar courses

Python 3: Deep Dive (Part 4 - OOP)

Python 3: Deep Dive (Part 4 - OOP)

Sources: udemy
Python object oriented programming (OOP).
35 hours 15 minutes 32 seconds
OpenAI API with Python Bootcamp: ChatGPT API, GPT-4, DALL·E

OpenAI API with Python Bootcamp: ChatGPT API, GPT-4, DALL·E

Sources: udemy
Welcome to the best resource for learning the OpenAI API with Python and for integrating the latest OpenAI models into your applications. This OpenAI API with
9 hours 8 minutes 16 seconds
The Ultimate Django Series: Part 1

The Ultimate Django Series: Part 1

Sources: codewithmosh (Mosh Hamedani)
Have you always wanted to learn Web development with Python but didn't know where to start? Tired of lengthy, confusing, and outdated courses? Look no further.
4 hours 49 minutes 19 seconds
Python for Financial Analysis and Algorithmic Trading

Python for Financial Analysis and Algorithmic Trading

Sources: udemy
Welcome to Python for Financial Analysis and Algorithmic Trading! Are you interested in how people use Python to conduct rigorous financial analysis and pursue algorithmic tradi...
16 hours 54 minutes 20 seconds
Django for Beginners/APIs/Professionals

Django for Beginners/APIs/Professionals

Sources: leanpub
Django for Professionals Once you have learned the basics of Django there is a massive gap between building simple "toy apps" and what it takes to build a "pro