DjangoCon US 2023: Mixing reliability with Celery for delicious async tasks

Celery is the most popular and mature solution for asynchronous task queues in Python’s ecosystem, but running Celery tasks with high reliability is a challenge. The settings are tricky, tasks can be lost in multiple ways, task code has opaque limitations, proper monitoring isn’t trivial, and more. In this talk, we’ll share what we learned to be necessary for running Celery reliably after years of running it in production.