Redpanda-rs

Rust crate for interfacing with Redpanda message brokers.

Built on top of the librdkafka C library and its rust bindings.

Provides a layer of abstraction to make using Redpanda (and other Kafka-like) message brokers easier in Rust.

docker exec -it redpanda-0 bash

Change segment size:

rpk topic alter-config <topic> --set segment.bytes=<segment_size> rpk topic alter-config simple --set segment.bytes=1000000

Start local Redpanda and MinIO cluster

docker-compose up

Check the broker status on Redpanda Console

http://localhost:8080

Set up S3 Archiving

Archive all the topics in your cluster to local S3 storage using MinIO!

Run ./configure_cluster.sh in the config directory.

References

librdkafka docs:

• librdkafka wiki
• librdkafka discussion
• Manually set consumer start offset