Sign up or log in to watch the video
Celery on AWS ECS - the art of background tasks & continuous deployment
Jan Giacomelli - 11 months ago
Running async tasks is challenging by itself. Require continuous zero-downtime deployment, and it gets even harder. This talk presents battle-tested techniques and approaches to run your Celery workers on top of AWS ECS with Fargate while being able to deploy tens of times per day. This talk presents techniques, approaches, and practical configuration examples that allow you to run your Celery workers on top of AWS ECS with Fargate. It starts by presenting the problems you encounter when dealing with async tasks. Next, we'll take a look at ECS and its configuration examples - which parameters to tweak to achieve the best result. After that, we'll check Celery configuration examples that comply with ECS requirements. We'll finish by overviewing techniques for implementing tasks in a way that supports ECS + Celery configuration while allowing continuous deployment all the time.
Jobs with related skills
Field Application Engineer (FAE) (m/w/d)
Lauterbach GmbH
·
13 days ago
Höhenkirchen-Siegertsbrunn, Germany
Senior Software Engineer für Datenprojekte
inovex GmbH
·
1 month ago
Munich, Germany
+7
Hardware Entwickler/Test Ingenieur (m/w)Embedded Systems
ABUS Security Center GmbH & Co. KG
·
1 month ago
Affing, Germany
Hybrid
AI Engineer
GEMESYS GmbH
·
1 month ago
Bochum, Germany
Related videos