Requirements

Until we stabilize things we will use: * LLVM 13 * CLang as CC * gold as linker

By changing the default .cargo/config you can pass use ld or lld without any problem.

Rust MSRV

We are using: nightly-x86_64-unknown-linux-gnu (default) rustc 1.61.0-nightly (1eb72580d 2022-03-08)

Running

With Docker Compose - Nerdctl Compose

1. You need to have docker installation locally. With containerd backend, if you want to bring single node Kafka replacement use: shell $ nerdctl compose up If you want to bring Confluent Kafka single node. You can: shell $ nerdctl compose -f docker-compose.kafkasn.yml If you want to bring full blown Confluent Kafka cluster. Use: shell $ nerdctl compose -f docker-compose.kafkacluster.yml

Mind that nerdctl command is interchangeable with docker.

With K8S

1. You need to have K8S installation locally. shell $ cd k8s && kubectl apply -f . && kubectl port-forward svc/redpanda 9092:9092

2. Now you can run the producers in Python. shell $ virtualenv venv $ source venv/bin/activate $ which pip3 # check that it is pointing to venv $ pip3 install aiokafka -U $ python examples/producer.py

3. Now you can spawn the double agent example (without durability). shell $ RUST_LOG="info,rdkafka::client=warn" RUST_BACKTRACE=full cargo run --example double-agent

Environment variables passed above is optional, but suggested for development.