Question 1

How to implement at-least-once delivery with rust-rdkafka?

Accepted Answer

Refer to the at-least-once delivery example in the repository, which shows careful offset commit after message processing to prevent loss. This involves committing offsets only once processing is complete to handle failures gracefully, as explained in the README.

Question 2

rust-rdkafka vs kafka-rust: which should I use?

Accepted Answer

rust-rdkafka is based on librdkafka and offers higher performance and more Kafka features, while kafka-rust is a pure Rust implementation that is simpler but less mature. Choose rust-rdkafka for production-grade throughput or kafka-rust for minimal dependencies.

Question 3

How to use rust-rdkafka with async-std instead of Tokio?

Accepted Answer

Disable default features and implement the AsyncRuntime trait for async-std, as shown in the runtime-async-std example. This allows integration without the Tokio dependency, though it requires custom shim code.

Question 4

Does rust-rdkafka support Kafka transactions for exactly-once semantics?

Accepted Answer

Yes, it supports transactional producers and read-committed consumers for exactly-once semantics, as documented in the producer transactions section. This enables atomic message delivery in read-process-write scenarios.

Question 5

What are the performance benchmarks for rust-rdkafka?

Accepted Answer

Benchmarks in the README show over 1 million messages per second for small messages and high throughput for larger payloads. For more details, check the kafka-benchmark project linked in the documentation.

rust-rdkafka

What is rust-rdkafka?

Overview

Use Cases

Best For

Related Projects

Found a gem we're missing?

Not Ideal For

Pros & Cons

Pros

Cons

Frequently Asked Questions