Question 1

How to set up SSL connections with Kafka-node?

Accepted Answer

Configure the sslOptions in KafkaClient with TLS settings, such as { rejectUnauthorized: false }, and for SASL/PLAIN, use the sasl object with username and password. Details are in the KafkaClient options section.

Question 2

Kafka-node vs kafkajs: which is better for Node.js?

Accepted Answer

Kafka-node is more mature and feature-rich with administrative APIs and stream support, but kafkajs is newer, written in pure JavaScript, and often preferred for simpler setups and TypeScript. Choose based on feature needs versus modernization.

Question 3

How to handle consumer group rebalancing in Kafka-node?

Accepted Answer

Use ConsumerGroup with sessionTimeout and protocol options, and the onRebalance callback for custom logic before rebalance finishes. The README provides examples and configuration tips for smooth transitions.

Question 4

Troubleshooting snappy installation errors in Kafka-node?

Accepted Answer

Install with --no-optional flag to skip snappy, or ensure system dependencies for node-gyp are met. Snappy is optional but required for snappy compression; errors are common on Windows, as noted in the FAQ.

Question 5

How to produce and consume binary data in Kafka-node?

Accepted Answer

Set encoding to 'buffer' in consumer options, and for producers, pass messages as Buffer objects. Avoid TypedArrays; convert them to Buffer, as explained in the troubleshooting section for binary data.

Question 6

Best practices for error handling in Kafka-node consumers?

Accepted Answer

Always listen to the 'error' event on consumers and clients. Use the debug module with DEBUG=kafka-node:* for logs, and refer to the troubleshooting guide for issues like offsetOutOfRange or stuck partitions.

kafka-node

What is kafka-node?

Overview

Use Cases

Best For

Related Projects

Found a gem we're missing?

Not Ideal For

Pros & Cons

Pros

Cons

Frequently Asked Questions