Distributed Tasks Demystified with Celery, SQS & Python

4h 27m 50s
English
Paid

Course description

This course teaches beginners to industry professionals the fundamental concepts of Distributed Programming in the context of python & Django.  We look at how to build applications that increase throughput and reduce latency.  In this course, we will take a dive intially in the irst part of the course and build a strong foundation of asynchronous parallel tasks using python-celery a distributed task queue framework. We will explore AWS SQS for scaling our parallel tasks on the cloud.

Read more about the course

These fundamentals will aid you in building scalable Python solutions for virtually any python project. By the end of this course, you will have learnt how to use popular distributed programming frameworks for python and Django. Through concepts learnt, you will discover the world of distributed computing with Python and how easy it is to build distributed components into your python or Django projects.


Watch Online

This is a demo lesson (10:00 remaining)

You can watch up to 10 minutes for free. Subscribe to unlock all 39 lessons in this course and access 10,000+ hours of premium content across all courses.

View Pricing
0:00
/
#1: Introduction

All Course Lessons (39)

#Lesson TitleDurationAccess
1
Introduction Demo
05:13
2
Prepping up your environment
07:24
3
Blocking vs non blocking (part 1)
06:11
4
Blocking vs non blocking (part 2)
05:01
5
Concurrency Consumer & Producer problem a deep dive
06:38
6
Solving Consumer producers problem with Mutual Exlusion
06:19
7
Controlling threads with conditions (Part 1)
02:24
8
Controlling threads with conditions (Part 2)
08:17
9
Controlling threads with conditions (Part 3)
03:51
10
Daemon threads by example (Part 4)
02:06
11
Consumer producer a thread safe FIFO queue
05:57
12
Getting started with Celery
05:53
13
Celery backends & Asyncresult by example
08:45
14
Python exception handling back to the basics
13:43
15
Exception handling in Celery Explained
09:24
16
Celery scheduled periodic tasks (Part 1)
04:45
17
Celery scheduled periodic tasks (Part 2)
04:43
18
Celery scheduled periodic tasks How to apply Mutex (Part 3)
10:39
19
Celery scheduled periodic tasks solar schedules
01:21
20
Introduction to distributed tasks with AWS SQS
14:00
21
Creating your first AWS SQS Queue with your AWS Console
05:21
22
How to create a AWS SQS background worker in python (Part 1)
08:04
23
How to create a AWS SQS background worker in python (Part 2)
09:43
24
Dead-letter Queues the theory
07:12
25
Dead-letter Queues illustrated
10:17
26
How to bypass AWS SQS (Simple Queue Service) 256kb payload limit
10:33
27
Introduction Project #1
01:05
28
Real world examples of data ingestors
04:00
29
Creating a twitter developer application and Authentication Token
06:17
30
Building your first social ingestor twitter (Part 1)
01:23
31
Building your first social ingestor twitter (Part 2)
03:35
32
Building your first social ingestor twitter Rate Limits (Part 3)
08:53
33
Building your first social ingestor twitter Handle (Part 4)
12:11
34
Building your first social ingestor twitter Handle (Part 5)
07:53
35
Basic fundamentals of SMTP and transactional email Services
04:21
36
Creating your first background email worker (Part 1)
11:49
37
Creating your first background email worker (Part 2)
11:23
38
Creating your first background email worker (Part 3)
03:21
39
Quick start guide: Getting started with PyCharm IDE (Mac)
07:55

Unlock unlimited learning

Get instant access to all 38 lessons in this course, plus thousands of other premium courses. One subscription, unlimited knowledge.

Learn more about subscription

Comments

0 comments

Want to join the conversation?

Sign in to comment

Similar courses

Python Django - The Practical Guide

Python Django - The Practical Guide

Sources: Academind Pro
Learn how to build web applications and websites with Python and the Django framework. Python is the most popular programming language of the world - it's versatile, easy to lea...
22 hours 54 minutes 38 seconds
[Full Stack] Airbnb Clone Coding

[Full Stack] Airbnb Clone Coding

Sources: Nomad Coders
In this series, we make an AirBnb clone. We will develop a complete stack that runs the entire loop, including front + back + distribution. As a result, after this course you w...
29 hours 47 minutes 6 seconds
The Automation Bootcamp: Zero to Mastery

The Automation Bootcamp: Zero to Mastery

Sources: zerotomastery.io
Become an automation expert with hands-on projects using Python. No experience needed to automate boring tasks. Learn advanced tools and tricks.
22 hours 39 minutes 15 seconds
Machine Learning: Natural Language Processing in Python (V2)

Machine Learning: Natural Language Processing in Python (V2)

Sources: udemy
Welcome to Machine Learning: Natural Language Processing in Python (Version 2). NLP: Use Markov Models, NLTK, Artificial Intelligence, Deep Learning, Machine Le
22 hours 4 minutes 2 seconds
Grokking Python Fundamentals

Grokking Python Fundamentals

Sources: DesignGurus.io
Learn Python from scratch or enhance your programming skills. The course is designed for beginners and professionals, with no programming experience required.