Skip to main content

Distributed Tasks Demystified with Celery, SQS & Python

4h 27m 50s
English
Paid

Course description

This course teaches beginners to industry professionals the fundamental concepts of Distributed Programming in the context of python & Django.  We look at how to build applications that increase throughput and reduce latency.  In this course, we will take a dive intially in the irst part of the course and build a strong foundation of asynchronous parallel tasks using python-celery a distributed task queue framework. We will explore AWS SQS for scaling our parallel tasks on the cloud.

Read more about the course

These fundamentals will aid you in building scalable Python solutions for virtually any python project. By the end of this course, you will have learnt how to use popular distributed programming frameworks for python and Django. Through concepts learnt, you will discover the world of distributed computing with Python and how easy it is to build distributed components into your python or Django projects.


Watch Online

This is a demo lesson (10:00 remaining)

You can watch up to 10 minutes for free. Subscribe to unlock all 39 lessons in this course and access 10,000+ hours of premium content across all courses.

View Pricing
0:00
/
#1: Introduction

All Course Lessons (39)

#Lesson TitleDurationAccess
1
Introduction Demo
05:13
2
Prepping up your environment
07:24
3
Blocking vs non blocking (part 1)
06:11
4
Blocking vs non blocking (part 2)
05:01
5
Concurrency Consumer & Producer problem a deep dive
06:38
6
Solving Consumer producers problem with Mutual Exlusion
06:19
7
Controlling threads with conditions (Part 1)
02:24
8
Controlling threads with conditions (Part 2)
08:17
9
Controlling threads with conditions (Part 3)
03:51
10
Daemon threads by example (Part 4)
02:06
11
Consumer producer a thread safe FIFO queue
05:57
12
Getting started with Celery
05:53
13
Celery backends & Asyncresult by example
08:45
14
Python exception handling back to the basics
13:43
15
Exception handling in Celery Explained
09:24
16
Celery scheduled periodic tasks (Part 1)
04:45
17
Celery scheduled periodic tasks (Part 2)
04:43
18
Celery scheduled periodic tasks How to apply Mutex (Part 3)
10:39
19
Celery scheduled periodic tasks solar schedules
01:21
20
Introduction to distributed tasks with AWS SQS
14:00
21
Creating your first AWS SQS Queue with your AWS Console
05:21
22
How to create a AWS SQS background worker in python (Part 1)
08:04
23
How to create a AWS SQS background worker in python (Part 2)
09:43
24
Dead-letter Queues the theory
07:12
25
Dead-letter Queues illustrated
10:17
26
How to bypass AWS SQS (Simple Queue Service) 256kb payload limit
10:33
27
Introduction Project #1
01:05
28
Real world examples of data ingestors
04:00
29
Creating a twitter developer application and Authentication Token
06:17
30
Building your first social ingestor twitter (Part 1)
01:23
31
Building your first social ingestor twitter (Part 2)
03:35
32
Building your first social ingestor twitter Rate Limits (Part 3)
08:53
33
Building your first social ingestor twitter Handle (Part 4)
12:11
34
Building your first social ingestor twitter Handle (Part 5)
07:53
35
Basic fundamentals of SMTP and transactional email Services
04:21
36
Creating your first background email worker (Part 1)
11:49
37
Creating your first background email worker (Part 2)
11:23
38
Creating your first background email worker (Part 3)
03:21
39
Quick start guide: Getting started with PyCharm IDE (Mac)
07:55

Unlock unlimited learning

Get instant access to all 38 lessons in this course, plus thousands of other premium courses. One subscription, unlimited knowledge.

Learn more about subscription

Comments

0 comments

Want to join the conversation?

Sign in to comment

Similar courses

100 Days of Code - The Complete Python Pro Bootcamp for 2023

100 Days of Code - The Complete Python Pro Bootcamp for 2023

Sources: udemy
Welcome to the 100 Days of Code - The Complete Python Pro Bootcamp, the only course you need to learn to code with Python. With over 100,000 reviews and a 4.8 a
58 hours 35 minutes 40 seconds
Conduct a Choice-Based Conjoint Analysis for Netflix with Python

Conduct a Choice-Based Conjoint Analysis for Netflix with Python

Sources: zerotomastery.io
Learn to use Choice-Based Conjoint Analysis to assist Netflix's growth. This project-based course explores consumer preferences using data analysis and Python.
1 hour 39 minutes 35 seconds
Building APIs with FastAPI

Building APIs with FastAPI

Sources: Andreas Kretz
API is the foundation of any modern data platform. You either provide an API for clients or use external APIs yourself. In any case, it's important to be...
1 hour 35 minutes 40 seconds
Scraping the Web for Fun and Profit

Scraping the Web for Fun and Profit

Sources: Jakob Greenfeld
This course will teach you how to use web scraping to create profitable projects. You will learn the basics of scraping using Python libraries...
6 hours 33 minutes 9 seconds
Complete Backend (API) Development with Python A-Z

Complete Backend (API) Development with Python A-Z

Sources: udemy
This course for anyone who wants to be python backend developer. You will learn what is API and some python API frameworks. You will find all the fundamentals about backend deve...
12 hours 35 minutes 9 seconds