Open-Awesome
CategoriesAlternativesStacksSelf-HostedExplore
Open-Awesome

© 2026 Open-Awesome. Curated for the developer elite.

TermsPrivacyAboutGitHubRSS
  1. Home
  2. Tags
  3. Kafka

Kafka

109 projects

Showing 36 of 109 projects

Secor
SecorJava

A fault-tolerant service that persists Kafka log data to cloud storage like S3, GCS, Azure Blob Storage, and OpenStack Swift.

#distributed-systems#data-archiving#hadoop-ecosystem
Stars1.9k
Forks536
Last commit14 days ago
RobustMQ
RobustMQRust

A unified messaging engine built in Rust that supports MQTT, Kafka, NATS, AMQP, and mq9 protocols on a single shared storage layer.

#message#message-queue#queue
Stars1.8k
Forks262
Last commit2 days ago
Oryx 2
Oryx 2Java

A lambda architecture framework on Apache Spark and Kafka for building and deploying real-time large-scale machine learning applications.

#apache-spark#large-scale-ml#classification
Stars1.8k
Forks399
Last commit5 years ago
Zilla
ZillaJava

A stateless, multi-protocol proxy that bridges web apps, IoT devices, and microservices directly to Apache Kafka via declarative APIs.

#api-gateway#rest#event-driven-architecture
Stars1.7k
Forks147
Last commit1 day ago
Quix Streams
Quix StreamsPython

A Python framework for building real-time data pipelines and event-driven microservices on Apache Kafka using a Streaming DataFrame API.

#stream-processing#streaming-data-processing#event-driven-architecture
Stars1.6k
Forks116
Last commit
gnomock
gnomockGo

Integration testing toolkit that spins up ephemeral Docker containers for dependencies, eliminating the need for mocks.

#ephemeral-containers#postgres#integration-testing
Stars1.5k
Forks80
Last commit6 months ago
FiloDB
FiloDBScala

A distributed, Prometheus-compatible, real-time, in-memory time series database designed for massive scalability and low-latency operational metrics.

#database#distributed#grafana
Stars1.5k
Forks239
Last commit3 days ago
kafka-rust
kafka-rustRust

A pure Rust client library for Apache Kafka with consumer, producer, and client APIs.

#stream-processing#message-queue#producer
Stars1.5k
Forks152
Last commit3 months ago
Reactive Kafka
Reactive KafkaScala

A Reactive Streams connector for Apache Kafka built on Akka Streams, enabling back-pressured integration for Java and Scala.

#stream-processing#akka#kafka-connector
Stars1.4k
Forks369
Last commit18 days ago
aiokafka
aiokafkaPython

asyncio client for kafka

#asyncio#kafka#kafka-client
Stars1.4k
Forks279
Last commit2 days ago
Honeytrap
HoneytrapGo

An extensible open-source framework for running, monitoring, and managing honeypots to detect and analyze cyber threats.

#honeypot#splunk#kafka
Stars1.3k
Forks183
Last commit3 years ago
ArkFlow
ArkFlowRust

A high-performance Rust stream processing engine with integrated AI capabilities for real-time data processing and intelligent analysis.

#stream-processing#event-driven#ai-integration
Stars1.3k
Forks47
Last commit1 day ago
pmacct
pmacctC

A lightweight suite of passive network monitoring tools supporting NetFlow, sFlow, IPFIX, libpcap, and BGP telemetry.

#traffic-analysis#libpcap#ipfix
Stars1.3k
Forks284
Last commit3 days ago
vFlow
vFlowGo

A high-performance, scalable, and reliable enterprise network flow collector for IPFIX, sFlow, and Netflow protocols.

#cisco#network-traffic#ipfix
Stars1.2k
Forks232
Last commit2 years ago
Hazelcast Jet
Hazelcast JetJava

An open-source, in-memory, distributed batch and stream processing engine for Java applications.

#stream-processing#event-processing#hacktoberfest
Stars1.1k
Forks203
Last commit1 year ago
librdkafka
librdkafkaC

A high-performance C/C++ client library for Apache Kafka, supporting producers, consumers, and admin operations.

#stream-processing#c-library#high-performance
Stars1.1k
Forks3.3k
Last commit1 day ago
summer-rs
summer-rsRust

A high-performance Rust application framework inspired by Spring Boot, emphasizing convention over configuration.

#axum#plugin-system#high-performance
Stars1.0k
Forks61
Last commit2 days ago
zerocode
zerocodeJava

A no-code automated testing framework for microservices APIs, Kafka data streams, databases, and load testing using JSON/YAML.

#declarative#load-testing#api
Stars1.0k
Forks453
Last commit27 days ago
brooklin
brooklinJava

An extensible distributed system for reliable nearline data streaming at scale

#linkedin#change-data-capture#distributed-systems
Stars970
Forks144
Last commit2 months ago
Nakadi
NakadiJava

A distributed event bus broker providing a RESTful API abstraction over Kafka-like queues for real-time data streaming.

#event-driven-architecture#distributed-systems#rest-api
Stars965
Forks290
Last commit2 years ago
jedisct1/flowgger
jedisct1/flowggerRust

A fast, secure, and standalone log collector written in Rust that parses, validates, and forwards log data.

#graylog#syslog#observability
Stars879
Forks61
Last commit1 year ago
camus
camusJava

LinkedIn's previous generation Kafka to HDFS pipeline for batch data ingestion.

#batch-processing#linkedin#kafka
Stars878
Forks451
Last commit6 years ago
tbmq
tbmqJava

A distributed MQTT broker built on Kafka, handling 100M+ connections and 10M+ messages/sec with industrial-grade persistence.

#platform#iot#thingsboard
Stars772
Forks96
Last commit5 days ago
Apache StreamPipes
Apache StreamPipesJava

A self-service IoT toolbox enabling non-technical users to connect, analyze, and explore industrial IoT data streams.

#stream-processing#iot#mqtt
Stars752
Forks243
Last commit3 days ago
Nussknacker
NussknackerScala

A low-code visual tool for domain experts to build, run, and monitor real-time decision algorithms on streaming data.

#apache-flink#stream-processing#touk
Stars743
Forks104
Last commit18 days ago
SlimMessageBus
SlimMessageBusC#

A lightweight, extensible messaging framework for .NET supporting pub/sub and request-response patterns with multiple broker integrations.

#azure-event-hubs#redis#kafka
Stars658
Forks88
Last commit1 month ago
RIG
RIGElixir

A gateway that enables reactive, event-driven communication between frontend clients and stateless microservices.

#live-data#event-driven#kinesis
Stars602
Forks67
Last commit6 months ago
Streamiz
StreamizC#

A .NET stream processing library for Apache Kafka, providing a Kafka Streams-like API for building real-time applications.

#stream-processing#event-driven#kafka-streams-dotnet
Stars544
Forks82
Last commit25 days ago
Streamiz
StreamizC#

A .NET stream processing library for Apache Kafka, providing a Kafka Streams-like API for building real-time applications.

#stream-processing#event-driven#kafka-streams-dotnet
Stars544
Forks82
Last commit25 days ago
kafkat
kafkatRuby

Simplified command-line administration tool for Kafka brokers, providing essential management operations.

#devops#command-line-tool#kafka
Stars502
Forks81
Last commit7 years ago
Tributary
TributaryPython

A Python library for constructing reactive dataflow graphs and streaming computations as data models.

#real-time-processing#data-modeling#python-data-streams
Stars466
Forks39
Last commit3 months ago
DM
DMGo

A unified data replication platform for TiDB, providing MySQL/MariaDB migration and change data capture to downstream systems.

#tidb#change-data-capture#data-replication
Stars463
Forks313
Last commit3 days ago
CloudEvents.io Java SDK
CloudEvents.io Java SDKJava

A Java SDK for creating, manipulating, and transporting CloudEvents across various protocols and formats.

#http-binding#hacktoberfest#event-driven-architecture
Stars447
Forks173
Last commit5 days ago
Schema Registry UI
Schema Registry UIJavaScript

A web UI for managing Avro schemas in Confluent Schema Registry, enabling creation, viewing, searching, evolution, and configuration.

#confluent-platform#kafka#docker
Stars425
Forks111
Last commit2 years ago
Ziggurat
ZigguratClojure

A Clojure framework for building stateless stream processing applications on Kafka with built-in retry mechanisms.

#stream-processing#event-driven#message-queue
Stars408
Forks70
Last commit7 days ago
Sentry Relay
Sentry RelayRust

A proxy service that offloads event processing, normalization, and ingestion from Sentry SDKs and server.

#event-processing#error-monitoring#observability
Stars402
Forks131
Last commit2 days ago
PreviousPage 2 of 4Next

Related Tags

Community-curated · Updated weekly · 100% open source

Found a gem we're missing?

Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.

Submit a projectStar on GitHub
4 days ago
#Apache Kafka37
#Stream Processing33
#Distributed Systems30
#Message Queue28
#Microservices25
#Event Driven18
#Data Pipeline18
#Go17
#Rust15
#Java14
#Event Streaming13
#Data Streaming12