A Rust implementation of Celery for producing and consuming asyncronous tasks with a distributed message queue.

We welcome contributions from everyone regardless of your experience level with Rust. For complete beginners, see HACKING_QUICKSTART.md.

If you already know the basics of Rust, the Rusty Celery Book is the best place to start. If you're coming from Python you may also be interested to know what's different. And if you've never heard of Celery, the official Celery Project is a great source of tutorials and overviews.

Quick start

Define tasks by decorating functions with the task attribute.

```rust

[celery::task]

fn add(x: i32, y: i32) -> i32 { x + y } ```

Create an app with the app macro and register your tasks with it:

rust let my_app = celery::app!( broker = AMQP { std::env::var("AMQP_ADDR").unwrap() }, tasks = [add], task_routes = [ "*" => "celery", ], );

Then send tasks to a queue with

rust my_app.send_task(add::new(1, 2)).await?;

And consume tasks as a worker from a queue with

rust my_app.consume().await?;

The ./examples directory contains a simple Celery app that is implemented in both Rust (celeryapp.rs) and Python (celeryapp.py) using an AMQP broker.

If you already have an AMQP broker running you can set the environment variable AMQP_URL to your broker's URL. Otherwise simply run the helper script:

bash ./scripts/brokers/amqp.sh

This will download and run the official RabbitMQ image (RabbitMQ is a popular AMQP broker). Then from a separate terminal run the script:

bash ./examples/python_to_rust.sh

This sends a series of tasks from the Python app to the Rust app. You can also send tasks from Rust to Python by running:

bash ./examples/rust_to_python.sh

Road map and current state

✅ = Supported and mostly stable, although there may be a few incomplete features.
⚠️ = Partially implemented and under active development.
🔴 = Not supported yet but on-deck to be implemented soon.

Core

| | Status | Tracking | | ---------------- |:-------:| --------- | | Protocol | ⚠️ | | | Producers | ✅ | | | Consumers | ✅ | | | Brokers | ✅ | | | Backends | 🔴 | | | Beat | 🔴 | | | Baskets | 🔴 | |

Brokers

| | Status | Tracking | | ----- |:------:| -------- | | AMQP | ✅ | | | Redis | 🔴 | |

Backends

| | Status | Tracking | | ----------- |:------:| -------- | | RPC | 🔴 | | | Redis | 🔴 | |

Team

Rusty Celery is an open source project backed by Structurely. Structurely is a start-up building customizable AI inside sales agents that has been using Celery in production back to circa 2017.