Celery

Open Collective is our community-powered funding platform that fuels Celery's ongoing development. Your sponsorship directly supports improvements, maintenance, and innovative features that keep Celery robust and reliable. The maintainers of celery and thousands of other packages are working with Tidelift to deliver commercial support and maintenance for the open source dependencies you use to build your applications. Save time, reduce risk, and improve code health, while paying the maintainers of the exact dependencies you use. Learn more. CloudAMQP is an industry leading RabbitMQ as a service provider. If you need highly available message queues, a perfect choice would be to use CloudAMQP. With 24,000+ running instances, CloudAMQP is the leading hosting provider of RabbitMQ, with customers all over the world. Upstash offers a serverless Redis database service, providing a seamless solution for Celery users looking to leverage serverless architectures. Upstash's serverless Redis service is designed with an eventual consistency model and durable storage, facilitated through a multi-tier storage architecture. Dragonfly is a drop-in Redis replacement that cuts costs and boosts performance. Designed to fully utilize the power of modern cloud hardware and deliver on the data demands of modern applications, Dragonfly frees developers from the limits of traditional in-memory data stores. A task queue's input is a unit of work, called a task, dedicated worker processes then constantly monitor the queue for new work to perform. A Celery system can consist of multiple workers and brokers, giving way to high availability and horizontal scaling. This is the last version of Celery which will support Python 3.9. Celery v5.7.x will work on Python 3.10 or newer versions. Celery is usually used with a message broker to send and receive messages. The RabbitMQ, Redis transports are feature complete, but there's also experimental support for a myriad of other solutions, including using SQLite for local development. If this is the first time you're trying to use Celery, or you're new to Celery v5.6.x coming from previous versions then you should read our getting started tutorials: First steps with Celery Tutorial teaching you the bare minimum needed to get started with Celery. Next steps You can also get started with Celery by using a hosted broker transport CloudAMQP. The largest hosting provider of RabbitMQ is a proud sponsor of Celery. Celery is easy to use and maintain, and does not need configuration files . A single Celery process can process millions of tasks a minute, with sub-millisecond round-trip latency (using RabbitMQ, py-librabbitmq, and optimized settings). Flexible Almost every part of Celery can be extended or used on its own, Custom pool implementations, serializers, compression schemes, logging, schedulers, consumers, producers, broker transports, and much more. The integration packages aren't strictly necessary, but they can make development easier, and sometimes they add important hooks like closing database connections at fork . The latest documentation is hosted at Read The Docs, containing user guides, tutorials, and an API reference. You can install Celery either via the Python Package Index (PyPI) or from source. Celery also defines a group of bundles that can be used to install Celery and the dependencies for a given feature. You should probably not use this in your requirements, it's here for informational purposes only. For discussions about the usage, development, and future of Celery, please join the celery-users mailing list. Come chat with us on IRC. The celery channel is located at the Libera Chat network. This project exists thanks to all the people who contribute. Development of celery happens at GitHub: You're highly encouraged to participate in the development of celery . If you don't like GitHub (for some reason) you're welcome to send regular patches. This software is licensed under