Stream Processing
Showing 36 of 188 projects
A portable C library for reading and writing streaming archives in multiple formats, with command-line tools.
A lightweight PHP library for efficient CSV parsing, writing, and transformation with a straightforward API.
A Swift framework for reactive and functional programming, providing composable primitives for streams of values over time.
A curated list of awesome streaming frameworks, applications, readings, and resources for stream processing.
A PostgreSQL extension for high-performance time-series aggregation that stores only aggregate results, not raw data.
A Node.js client for Apache Kafka 0.9 and later, providing producers, consumers, and administrative APIs.
A Scala API for Apache Beam and Google Cloud Dataflow, enabling unified batch and streaming data processing.
Asynchronous streaming communication library for Clojure providing HTTP, TCP, UDP, and WebSocket servers and clients.
A distributed service for efficiently collecting, aggregating, and moving large amounts of log-like data.
A pure C# compression library for .NET that reads and writes multiple archive formats with forward-only streaming support.
A real-time distributed analytical database built entirely on bitmaps for low-latency queries on fresh data.
An ultra-light, Go-based open source ecosystem for building event-driven serverless functions, microservices, and edge applications.
A Kubernetes-native, serverless platform for running massively parallel data and streaming jobs with exactly-once semantics.
A purely functional, effectful, and polymorphic stream processing library for Scala built on Cats and Cats-Effect.
A distributed data integration framework for big data ecosystems, handling ingestion, replication, organization, and lifecycle management for both streaming and batch data.
A distributed data integration framework for big data ecosystems, handling ingestion, replication, organization, and lifecycle management for both streaming and batch data.
A single C++ binary SQL engine for high-performance stream processing, analytics, observability, and AI/ML pipelines.
A lightweight and efficient stream processing library for Go, providing a declarative DSL to build data pipelines.
A library for writing MapReduce programs that execute on distributed platforms like Storm and Scalding using Scala/Java collection-like syntax.
A masterless, cloud-scale, fault-tolerant distributed computation system for batch and stream processing written in Clojure.
A Python framework and Rust-based distributed processing engine for stateful event and stream processing.
A fully asynchronous, futures-based Apache Kafka client library for Rust built on librdkafka.
A high-performance Scala library for composing asynchronous, event-based programs with strong functional programming influences.
An open-source LLM function calling framework for building scalable, low-latency AI agents with geo-distributed edge infrastructure.
A Python stream processing library that ports Kafka Streams concepts to Python, enabling scalable event processing and in-memory durable key/value stores.
A Go toolkit for building concurrent programs using composable, channel-based pipelines with automatic error propagation.
Reactive extensions for PHP enabling asynchronous and event-based programming using observable streams.
A lightweight IoT data analytics and stream processing engine for resource-constrained edge devices.
A lightweight IoT data analytics and stream processing engine designed for resource-constrained edge devices.
A tiny, fast reactive/iterable programming library implementing the callbag spec for unified stream processing.
A Go library of probabilistic data structures for processing continuous, unbounded data streams.
A computational parallel flow library for Elixir built on top of GenStage for parallel processing of collections.
A cloud-native streaming and complex event processing engine that executes Streaming SQL queries for real-time event processing.
Build highly concurrent, distributed, and resilient message-driven applications using Java/Scala with the Actor Model.
A Python framework for building real-time data pipelines and event-driven microservices on Apache Kafka using a Streaming DataFrame API.
A full-featured Elixir implementation of the gRPC protocol supporting unary and streaming RPCs, interceptors, and HTTP transcoding.
Related Tags
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.