Open-Awesome
CategoriesAlternativesStacksSelf-HostedExplore
Open-Awesome

© 2026 Open-Awesome. Curated for the developer elite.

TermsPrivacyAboutGitHubRSS
  1. Home
  2. Tags
  3. Stream Processing

Stream Processing

72 projects

Showing 36 of 72 projects

CSV
CSVPHP

A lightweight PHP library for efficient CSV parsing, writing, and transformation with a straightforward API.

#stream-processing#csv-filter#data-export
Stars3.5k
Forks346
Last commit5 days ago
libarchive
libarchiveC

A portable C library for reading and writing streaming archives in multiple formats, with command-line tools.

#stream-processing#c-library#gz
Stars3.5k
Forks916
Last commit3 days ago
ReactiveSwift
ReactiveSwiftSwift

A Swift framework for reactive and functional programming, providing composable primitives for streams of values over time.

#stream-processing#functional-programming#ios
Stars3.0k
Forks433
Last commit9 months ago
Streaming
Streaming

A curated list of awesome streaming frameworks, applications, readings, and resources for stream processing.

#stream-processing#message-queue#real-time-analytics
Stars3.0k
Forks313
Last commit2 months ago
PipelineDB
PipelineDBC

A PostgreSQL extension for high-performance time-series aggregation that stores only aggregate results, not raw data.

#realtime#stream-processing#realtime-analytics
Stars2.7k
Forks243
Last commit4 years ago
kafka-node
kafka-nodeJavaScript

A Node.js client for Apache Kafka 0.9 and later, providing producers, consumers, and administrative APIs.

#stream-processing#nodejs-client#backend-development
Stars2.7k
Forks617
Last commit2 years ago
Scio
ScioScala

A Scala API for Apache Beam and Google Cloud Dataflow, enabling unified batch and streaming data processing.

#stream-processing#batch-processing#batch
Stars2.6k
Forks526
Last commit11 days ago
aleph
alephClojure

Asynchronous streaming communication library for Clojure providing HTTP, TCP, UDP, and WebSocket servers and clients.

#stream-processing#http-server#web-server
Stars2.6k
Forks241
Last commit15 days ago
flume
flumeJava

A distributed service for efficiently collecting, aggregating, and moving large amounts of log-like data.

#stream-processing#apache#library
Stars2.6k
Forks1.5k
Last commit1 year ago
SharpCompress
SharpCompressC#

A pure C# compression library for .NET that reads and writes multiple archive formats with forward-only streaming support.

#stream-processing#bzip2#tar
Stars2.5k
Forks512
Last commit3 days ago
Pilosa
PilosaGo

A real-time distributed analytical database built entirely on bitmaps for low-latency queries on fresh data.

#real-time-database#stream-processing#bitmap
Stars2.5k
Forks237
Last commit2 years ago
flogo
flogoCSS

An ultra-light, Go-based open source ecosystem for building event-driven serverless functions, microservices, and edge applications.

#stream-processing#event-driven#iot
Stars2.5k
Forks294
Last commit2 years ago
Numaflow
NumaflowRust

A Kubernetes-native, serverless platform for running massively parallel data and streaming jobs with exactly-once semantics.

#stream-processing#hacktoberfest#event-driven-architecture
Stars2.5k
Forks154
Last commit2 days ago
FS2(prev. 'Scalaz-Stream')
FS2(prev. 'Scalaz-Stream')Scala

A purely functional, effectful, and polymorphic stream processing library for Scala built on Cats and Cats-Effect.

#stream-processing#functional-programming#scala-js
Stars2.4k
Forks632
Last commit7 days ago
Gobblin
GobblinJava

A distributed data integration framework for big data ecosystems, handling ingestion, replication, organization, and lifecycle management for both streaming and batch data.

#stream-processing#apache#data-lifecycle-management
Stars2.3k
Forks749
Last commit
Gobblin from LinkedIn
Gobblin from LinkedInJava

A distributed data integration framework for big data ecosystems, handling ingestion, replication, organization, and lifecycle management for both streaming and batch data.

#stream-processing#apache#data-lifecycle-management
Stars2.3k
Forks749
Last commit
Proton
ProtonC++

A single C++ binary SQL engine for high-performance stream processing, analytics, observability, and AI/ML pipelines.

#stream-processing#sql-engine#iceberg
Stars2.2k
Forks107
Last commit1 day ago
go-streams
go-streamsGo

A lightweight and efficient stream processing library for Go, providing a declarative DSL to build data pipelines.

#stream-processing#pulsar#redis
Stars2.2k
Forks173
Last commit3 months ago
summingbird
summingbirdScala

A library for writing MapReduce programs that execute on distributed platforms like Storm and Scalding using Scala/Java collection-like syntax.

#stream-processing#mapreduce#batch-processing
Stars2.1k
Forks259
Last commit4 years ago
Onyx
OnyxClojure

A masterless, cloud-scale, fault-tolerant distributed computation system for batch and stream processing written in Clojure.

#stream-processing#batch-processing#distributed
Stars2.1k
Forks202
Last commit6 years ago
Bytewax
BytewaxPython

A Python framework and Rust-based distributed processing engine for stateful event and stream processing.

#stream-processing#event-driven#data-science
Stars2.0k
Forks107
Last commit1 year ago
rust-rdkafka
rust-rdkafkaRust

A fully asynchronous, futures-based Apache Kafka client library for Rust built on librdkafka.

#stream-processing#futures#message-queue
Stars2.0k
Forks348
Last commit10 days ago
monix
monixScala

A high-performance Scala library for composing asynchronous, event-based programs with strong functional programming influences.

#stream-processing#back-pressure#functional-programming
Stars1.9k
Forks244
Last commit14 days ago
YoMo
YoMoRust

An open-source LLM function calling framework for building scalable, low-latency AI agents with geo-distributed edge infrastructure.

#realtime#stream-processing#distributed-cloud
Stars1.9k
Forks143
Last commit2 days ago
Robinhood's Faust
Robinhood's FaustPython

A Python stream processing library that ports Kafka Streams concepts to Python, enabling scalable event processing and in-memory durable key/value stores.

#stream-processing#event-driven#asyncio
Stars1.9k
Forks203
Last commit25 days ago
rill
rillGo

A Go toolkit for building concurrent programs using composable, channel-based pipelines with automatic error propagation.

#stream-processing#functional-programming#parallel-computing
Stars1.8k
Forks26
Last commit11 days ago
RxPHP
RxPHPPHP

Reactive extensions for PHP enabling asynchronous and event-based programming using observable streams.

#stream-processing#event-driven#observables
Stars1.7k
Forks142
Last commit16 days ago
ekuiper
ekuiperGo

A lightweight IoT data analytics and stream processing engine designed for resource-constrained edge devices.

#stream-processing#iot#rule-engine
Stars1.7k
Forks452
Last commit2 days ago
Kuiper
KuiperGo

A lightweight IoT data analytics and stream processing engine for resource-constrained edge devices.

#stream-processing#iot#rule-engine
Stars1.7k
Forks452
Last commit2 days ago
callbag-basics
callbag-basicsJavaScript

A tiny, fast reactive/iterable programming library implementing the callbag spec for unified stream processing.

#stream-processing#functional-programming#callbacks
Stars1.7k
Forks43
Last commit3 years ago
boomfilters
boomfiltersGo

A Go library of probabilistic data structures for processing continuous, unbounded data streams.

#probabilistic-data-structures#stream-processing#filter
Stars1.6k
Forks119
Last commit5 months ago
flow
flowElixir

A computational parallel flow library for Elixir built on top of GenStage for parallel processing of collections.

#stream-processing#functional-programming#parallel-computing
Stars1.6k
Forks89
Last commit1 year ago
Siddhi
SiddhiJava

A cloud-native streaming and complex event processing engine that executes Streaming SQL queries for real-time event processing.

#stream-processing#iot#streaming-data-processing
Stars1.6k
Forks531
Last commit14 days ago
Apache Pekko
Apache PekkoScala

Build highly concurrent, distributed, and resilient message-driven applications using Java/Scala with the Actor Model.

#stream-processing#message-driven#http-server
Stars1.6k
Forks194
Last commit2 days ago
Quix Streams
Quix StreamsPython

A Python framework for building real-time data pipelines and event-driven microservices on Apache Kafka using a Streaming DataFrame API.

#stream-processing#streaming-data-processing#event-driven-architecture
Stars1.5k
Forks105
Last commit
grpc-elixir
grpc-elixirElixir

A full-featured Elixir implementation of the gRPC protocol supporting unary and streaming RPCs, interceptors, and HTTP transcoding.

#stream-processing#elixir#distributed-systems
Stars1.5k
Forks248
Last commit5 days ago
PreviousPage 2 of 2

Related Tags

Community-curated · Updated weekly · 100% open source

Found a gem we're missing?

Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.

Submit a projectStar on GitHub
2 days ago
2 days ago
2 days ago
#Distributed Systems22
#Kafka14
#Event Driven12
#Cloud Native12
#Data Pipeline12
#Real Time Analytics12
#Streaming11
#Big Data10
#Rust10
#Message Queue10
#Data Integration10
#Golang9