A .NET stream processing library for Apache Kafka, providing a Kafka Streams-like API for building real-time applications.
Streamiz Kafka .NET is a .NET stream processing library for Apache Kafka that provides a Kafka Streams-like API for building real-time data processing applications. It allows developers to perform stateful operations, windowing, joins, and exactly-once processing on streaming data within the .NET ecosystem. The library enables creating complex event-driven pipelines and microservices that consume, transform, and produce data to Kafka topics.
.NET developers and teams building real-time streaming applications, data pipelines, or event-driven microservices with Apache Kafka. It's particularly valuable for organizations already using Kafka who want to leverage .NET for their stream processing needs.
Developers choose Streamiz because it brings the proven Kafka Streams paradigm to .NET without requiring Java interoperability, offering native performance and familiar C# syntax. Its comprehensive feature set, including exactly-once semantics, multiple serialization formats, and observability integrations, makes it a production-ready alternative to building custom stream processing logic.
.NET Stream Processing Library for Apache Kafka 🚀
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
Implements a Kafka Streams-like API directly in C#, allowing .NET developers to build streaming applications without Java interoperability, as emphasized in the philosophy.
Supports stateful operations with RocksDB and InMemory stores, enabling complex aggregations and joins, demonstrated in the usage example with kstream.Join.
Ensures reliable processing with exactly-once delivery guarantees, a key feature listed that is crucial for production data pipelines.
Includes serializers/deserializers for Avro, Protobuf, JSON, and Schema Registry integration via separate NuGet packages, providing flexibility in data handling.
Lacks sliding and session windows, which are available in Kafka Streams but marked as 'no plan for now' in the comparison table, limiting time-based operation options.
Only Azure remote storage is currently supported in preview, with GCP and AWS still planned, potentially delaying multi-cloud deployments as noted in the features list.
Does not support interactive queries for accessing state stores externally, a Kafka Streams feature absent here and marked as 'no plan for now', reducing real-time monitoring capabilities.