CF

Sidekiq in Practice

1h 4m 45s
English
Paid

Are you using Sidekiq to process your background jobs, but are struggling as your application scales? Sidekiq can scale to 5,000 jobs per second with just a little effort and knowledge. In Sidekiq in Practice, I'll show you how.

Course Overview

Sidekiq in Practice takes a step-by-step approach towards building a complex, real-world application that handles a massive volume of jobs through Sidekiq. This course aims to equip you with the knowledge to efficiently scale your applications.

Course Contents

  • How to understand scaling: Learn how many processes and servers you need, and how to autoscale them efficiently.
  • Idempotency: Increase your scalability by discarding "unique jobs" and instead use basic computer science to make jobs work regardless of the number of times they are enqueued.
  • Memory Bloat: Discover how to diagnose and reduce memory problems that result in massive server bills.
  • Concurrency Settings: Explore thread safety, queue design, database pool sizes, and more.

What You'll Receive

  • An interactive workshop, driven by a command-line experience. Try it now: gem install skp && skp list
  • 9 hands-on exercises that show you how to put the course principles into real practice.
  • 60 minutes of HD video discussing additional topics on scaling Sidekiq.
  • A 100-page reference of the text content from the workshop, available in multiple formats for your convenience.

Note: Sidekiq Pro and/or Enterprise are not required. The workshop mostly covers features available in Sidekiq OSS.

About the Author: Nate Berkopec

Nate Berkopec thumbnail

Nate Berkopec is a US Ruby on Rails performance specialist and the founder of Speedshop — a Rails performance consultancy whose paid course material is the canonical reference on Rails app performance, caching, and Sidekiq job-queue optimisation.

His CourseFlix listing carries Sidekiq in Practice. Material is paid and aimed at Rails engineers running production background-job workloads who need to understand the operational side of Sidekiq deeply.

Watch Online 9 lessons

This is a demo lesson (10:00 remaining)

You can watch up to 10 minutes for free. Subscribe to unlock all 9 lessons in this course and access 10,000+ hours of premium content across all courses.

View Pricing
0:00
/
#1: Reducing Redis Load
All Course Lessons (9)
#Lesson TitleDurationAccess
1
Reducing Redis Load Demo
06:27
2
Multi-Server Setups
06:54
3
Amdahl's Law
06:37
4
Jobs are Cheaper
07:03
5
Load Shedding
06:56
6
Scaling Redis... with SQL
07:42
7
Managing SQL Load
07:12
8
Multi-Threading Inside a Job
07:47
9
Memory Profiling
08:07
Unlock unlimited learning

Get instant access to all 8 lessons in this course, plus thousands of other premium courses. One subscription, unlimited knowledge.

Learn more about subscription

Books

Read Book Sidekiq in Practice

#TitleTypeOpen
1sidekiq_in_practice PDF

Related courses

Frequently asked questions

What prerequisites should I have before taking this course?
Before enrolling in the course, you should have a basic understanding of Ruby and how to use Sidekiq for background job processing. Familiarity with server management and scaling concepts will be beneficial, although not strictly necessary, as the course covers these topics in depth.
What projects or applications will I build during the course?
During the course, you'll work on building a complex, real-world application designed to handle a massive volume of jobs through Sidekiq. This includes practical exercises like reducing Redis load, managing SQL load, implementing multi-server setups, and utilizing concurrency settings effectively.
Who is the primary target audience for this course?
The course is designed for developers and software engineers who are currently using Sidekiq and need to optimize their applications for better scalability and performance. It is especially valuable for those struggling with scaling issues as their application grows.
How does this course compare to other courses on Sidekiq or background job processing?
This course focuses specifically on scaling Sidekiq for high-volume job processing, offering a hands-on, command-line-driven workshop experience. Unlike other courses that may only cover basic Sidekiq usage, this course delves into advanced topics like memory profiling, idempotency, and load shedding.
What specific tools or platforms does the course cover?
The course covers tools and platforms directly related to optimizing Sidekiq performance. Key topics include concurrency settings, load management using Redis and SQL, and memory profiling techniques to reduce server costs. The course does not require Sidekiq Pro or Enterprise.
What topics are not covered in this course?
The course does not cover Sidekiq Pro or Enterprise features, as they are not required for the workshop. Additionally, the course focuses specifically on Sidekiq and related scaling techniques, so it does not delve into other background job processing tools or frameworks.
How much time should I expect to commit to this course?
The course includes 60 minutes of HD video content, along with 9 hands-on exercises and a 100-page reference guide. While the video content is concise, the exercises are designed to reinforce learning, so it may take additional time to work through the practical components and fully grasp the concepts.