A Rust implementation of Celery for producing and consuming asyncronous tasks with a distributed message queue.

Inspired by, well... Celery, but also batch-rs especially for it's awesome macro implementation.

Features

• Send tasks from Python to Rust or vice versa ↔️
• Use provided brokers and backends or implement your own 🔧
• Natural async / await interface 🎇
• Easily customizable with callbacks ☎️
• High performance and safe 🔥 🔥 🔥

Examples

The ./examples directory contains a simple Celery app that is implemented in both Python and Rust using an AMQP broker. Before running the examples you'll need to set the environment variable AMQP_ADDR to your broker URL. I also recommend setting RUST_LOG=debug.

Then send a task from Python to Rust by running the script

bash ./examples/python_to_rust.sh

Similary, send a task from Rust to Python by running

bash ./examples/rust_to_python.sh

Missing features

Rusty Celery is still in the early stages and therefore there are several features of the Celery protocol that are still missing. To see what's currently missing search for issues with the label "Protocol Feature".

Contributing

We welcome contributors! If you're interesting in contributing, a good place to start would be any issue marked with the label "Status: Help Wanted".

For more information on our guidelines please refer to CONTRIBUTING.md.

Team

Rusty Celery is an open source project backed by Structurely. Structurely is a start-up building customizable AI inside sales agents that has been using Celery in production back to circa 2017.