Open-Awesome
CategoriesAlternativesStacksSelf-HostedExplore
Open-Awesome

© 2026 Open-Awesome. Curated for the developer elite.

TermsPrivacyAboutGitHubRSS
  1. Home
  2. Tags
  3. Kafka

Kafka

109 projects

Showing 36 of 109 projects

Pathway
PathwayPython

A Python ETL framework for stream processing, real-time analytics, and building live LLM/RAG pipelines, powered by a scalable Rust engine.

#stream-processing#batch-processing#machine-learning-algorithms
Stars62.1k
Forks1.7k
Last commit
Apache Kafka Streams
Apache Kafka StreamsJava

A distributed event streaming platform for building high-performance data pipelines, streaming analytics, and data integration.

#stream-processing#message-queue#data-integration
Stars34.1k
Forks15.6k
Last commit8 hours ago
Telegraf
TelegrafGo

A plugin-driven agent for collecting, processing, aggregating, and writing metrics, logs, and arbitrary data.

#plugin-system#observability#logs
Stars17.9k
Forks5.8k
Last commit9 hours ago
Telegraf PostgreSQL plugin
Telegraf PostgreSQL pluginGo

A plugin-driven agent for collecting, processing, aggregating, and writing metrics, logs, and arbitrary data.

#plugin-system#observability#logs
Stars17.9k
Forks5.8k
Last commit9 hours ago
Sogou Workflow
Sogou WorkflowC++

A C++ parallel computing and asynchronous networking framework for building high-performance, high-concurrency backend services.

#parallel-computing#high-performance#redis
Stars14.4k
Forks2.6k
Last commit2 months ago
Debezium (k)
Debezium (k)Java

A low-latency platform for change data capture (CDC) that streams row-level changes from databases to applications.

#database#event-driven-architecture#cqrs
Stars13.2k
Forks3.1k
Last commit12 hours ago
Redpanda
RedpandaC++

A Kafka-compatible streaming data platform that is 10x faster, simpler to operate, and free from ZooKeeper and JVMs.

#realtime#event-driven#event-driven-architecture
Stars12.6k
Forks795
Last commit11 days ago
Redpanda (k)
Redpanda (k)C++

A Kafka-compatible streaming data platform that's 10x faster, with no ZooKeeper or JVM.

#realtime#event-driven#high-performance
Stars12.6k
Forks795
Last commit11 days ago
Redpanda
RedpandaC++

A Kafka-compatible streaming data platform that's 10x faster, with no ZooKeeper or JVM dependencies.

#realtime#event-driven#high-performance
Stars12.6k
Forks795
Last commit11 days ago
sarama
saramaGo

A Go client library for Apache Kafka with comprehensive API support and testing utilities.

#message-queue#distributed-systems#kafka
Stars12.5k
Forks1.9k
Last commit3 days ago
kafka-manager
kafka-managerScala

A web-based tool for managing Apache Kafka clusters, enabling cluster inspection, topic management, and partition operations.

#devops#distributed-systems#kafka
Stars11.9k
Forks2.5k
Last commit3 years ago
AutoMQ
AutoMQJava

AutoMQ is a cloud-native, diskless Kafka alternative that uses S3 for storage, offering 10x cost savings, autoscaling in seconds, and single-digit ms latency.

#stream-processing#apache-kafka-compatible#diskless
Stars10.9k
Forks798
Last commit
AutoMQ
AutoMQJava

A diskless Kafka alternative that runs on S3, offering 10x cost savings, autoscaling in seconds, and single-digit ms latency.

#diskless#kafka-alternative#message-queue
Stars10.9k
Forks798
Last commit11 hours ago
RisingWave
RisingWaveRust

An enterprise-grade event streaming platform that ingests, processes, and manages real-time event data with PostgreSQL compatibility and Apache Iceberg™ integration.

#stream-processing#etl-pipeline#database
Stars9.4k
Forks849
Last commit12 hours ago
RisingWaveLabs/RisingWave
RisingWaveLabs/RisingWaveRust

Enterprise-grade event streaming platform that continuously ingests, processes, and serves real-time data with Apache Iceberg™ integration.

#stream-processing#etl-pipeline#database
Stars9.4k
Forks849
Last commit
CAP
CAPC#

A .NET library for distributed transactions and event bus integration in microservices using the Outbox pattern.

#service-bus#event-driven-architecture#message-queue
Stars7.1k
Forks1.3k
Last commit1 day ago
Faust
FaustPython

Python Stream Processing

#stream-processing#asyncio#distributed-systems
Stars6.8k
Forks538
Last commit2 years ago
Materialize
MaterializeRust

A real-time data integration platform that creates and continually updates consistent views of transactional data using SQL.

#stream-processing#postgresql-dialect#database
Stars6.4k
Forks515
Last commit4 hours ago
hippo4j
hippo4jJava

An asynchronous thread pool framework for Java applications that supports dynamic configuration changes, monitoring, and alerting without code modifications.

#dynamic-configuration#observability#blocking-queue
Stars6.0k
Forks1.2k
Last commit7 months ago
FastStream
FastStreamPython

An asynchronous Python framework for building services that interact with Apache Kafka, RabbitMQ, NATS, and Redis event streams.

#stream-processing#asyncio#redis
Stars5.4k
Forks410
Last commit19 hours ago
AsyncAPI
AsyncAPIJavaScript

A specification for creating machine-readable definitions of asynchronous APIs, similar to OpenAPI for REST.

#event-driven#message-queue#async-api
Stars5.3k
Forks380
Last commit1 day ago
Arroyo
ArroyoRust

A distributed stream processing engine in Rust that performs stateful computations on real-time data with subsecond results.

#stream-processing#event-driven#sql-engine
Stars5.1k
Forks379
Last commit5 days ago
Seldon Core
Seldon CoreGo

An MLOps framework to package, deploy, monitor, and manage thousands of production machine learning models on Kubernetes.

#deployment#aiops#ai-pipelines
Stars4.8k
Forks863
Last commit7 months ago
Ockam
OckamRust

Orchestrate end-to-end encryption, cryptographic identities, mutual authentication, and authorization policies between distributed applications at scale.

#zero-trust#authentication#cryptographic-identities
Stars4.6k
Forks556
Last commit9 months ago
ockam
ockamRust

Orchestrate end-to-end encryption, cryptographic identities, mutual authentication, and authorization policies between distributed applications at scale.

#zero-trust#authentication#cryptographic-identities
Stars4.6k
Forks556
Last commit
Maxwell's daemon (.2k)
Maxwell's daemon (.2k)Java

A MySQL change data capture daemon that streams database changes as JSON to Kafka, Kinesis, and other platforms.

#change-data-capture#database-replication#kafka
Stars4.3k
Forks1.0k
Last commit18 days ago
Brighter
BrighterC#

A .NET command dispatcher and processor framework for building loosely coupled applications and microservices with in-process and out-of-process messaging.

#command-dispatcher#nuget#command-processor
Stars2.5k
Forks300
Last commit6 hours ago
Confluent Schema registry for Kafka
Confluent Schema registry for KafkaJava

A RESTful service for storing, retrieving, and managing Avro, JSON Schema, and Protobuf schemas in Apache Kafka ecosystems.

#schemas#data-serialization#avro-schema
Stars2.5k
Forks1.2k
Last commit
Practical.CleanArchitecture
Practical.CleanArchitectureC#

A full-stack .NET 10 reference application demonstrating Clean Architecture with support for monoliths, modular monoliths, and microservices.

#cqrs#signalr#oauth2
Stars2.5k
Forks611
Last commit6 days ago
Proton
ProtonC++

A single C++ binary SQL engine for high-performance stream processing, analytics, observability, and AI/ML pipelines.

#stream-processing#sql-engine#iceberg
Stars2.3k
Forks112
Last commit7 days ago
Karafka
KarafkaRuby

A Ruby and Rails multi-threaded framework for building efficient Kafka-based event-driven applications.

#event-processing#rails#message-queue
Stars2.3k
Forks187
Last commit12 hours ago
Enqueue
EnqueuePHP

Production-ready messaging solution for PHP with support for message queues, job queues, broadcasting, and WebSockets across multiple frameworks.

#rabbitmq-client#redis#message-queue
Stars2.2k
Forks427
Last commit1 month ago
go-streams
go-streamsGo

A lightweight and efficient stream processing library for Go, providing a declarative DSL to build data pipelines.

#stream-processing#pulsar#redis
Stars2.2k
Forks173
Last commit9 months ago
Bytewax
BytewaxPython

A Python framework and Rust-based distributed processing engine for stateful event and stream processing.

#stream-processing#event-driven#data-science
Stars2.1k
Forks112
Last commit2 days ago
rust-rdkafka
rust-rdkafkaRust

A fully asynchronous, futures-based Apache Kafka client library for Rust built on librdkafka.

#stream-processing#futures#message-queue
Stars2.0k
Forks373
Last commit3 months ago
Robinhood's Faust
Robinhood's FaustPython

A Python stream processing library that ports Kafka Streams concepts to Python, enabling scalable event processing and in-memory durable key/value stores.

#stream-processing#event-driven#asyncio
Stars1.9k
Forks205
Last commit5 days ago
Page 1 of 4Next

Related Tags

Community-curated · Updated weekly · 100% open source

Found a gem we're missing?

Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.

Submit a projectStar on GitHub
1 day ago
11 hours ago
12 hours ago
9 months ago
3 hours ago
#Apache Kafka37
#Stream Processing33
#Distributed Systems30
#Message Queue28
#Microservices25
#Event Driven18
#Data Pipeline18
#Go17
#Rust15
#Java14
#Event Streaming13
#Data Streaming12