Open-Awesome
CategoriesAlternativesStacksSelf-HostedExplore
Open-Awesome

© 2026 Open-Awesome. Curated for the developer elite.

TermsPrivacyAboutGitHubRSS
  1. Home
  2. Tags
  3. Stream Processing

Stream Processing

200 projects

Showing 20 of 200 projects

winnow
winnowJavaScript

Apply SQL queries and spatial filters to GeoJSON data in memory, with support for streams and Esri format conversion.

#stream-processing#spatial-query#geojson
Stars88
Forks18
Last commit2 years ago
NebulaStream
NebulaStreamC++

An end-to-end data management system for IoT, optimizing stream processing across cloud, edge, and sensor deployments.

#stream-processing#sql-engine#streamprocessing
Stars84
Forks35
Last commit1 day ago
FsCodec
FsCodecF#

F# library for serializing events in event-sourcing systems with version-tolerant converters for System.Text.Json and Newtonsoft.Json.

#stream-processing#system-text-json#discriminated-unions
Stars83
Forks18
Last commit2 months ago
ada-util
ada-utilAda

A comprehensive Ada utility library providing logging, serialization, encoding, stream composition, and concurrency tools for building robust applications.

#stream-processing#process#unit-testing
Stars82
Forks16
Last commit1 day ago
libdart
libdartC++

A high-performance C++ JSON library with a binary wire protocol, optimized for network efficiency and zero-copy parsing.

#stream-processing#binary-protocol#high-performance
Stars80
Forks9
Last commit2 years ago
IterTools TS
IterTools TSTypeScript

A TypeScript/JavaScript library providing Python-inspired iteration utilities for working with iterables, streams, and pipes.

#stream-processing#generator#functional-programming
Stars79
Forks17
Last commit4 months ago
binary-split
binary-splitJavaScript

A fast Node.js stream splitter for binary data that splits on newlines or custom delimiters without converting to strings.

#stream-processing#delimiter-parsing#npm-package
Stars79
Forks19
Last commit2 years ago
through2-concurrent
through2-concurrentJavaScript

A Node.js Transform stream that processes data chunks concurrently with configurable max concurrency.

#stream-processing#async-processing#transform-stream
Stars75
Forks11
Last commit5 years ago
LightSaber
LightSaberC++

A multi-core stream processing engine for high-throughput window aggregation with optional exactly-once fault tolerance.

#stream-processing#multi-core#window-aggregation
Stars74
Forks19
Last commit4 years ago
Kafka
KafkaOCaml

OCaml bindings for Apache Kafka, enabling Kafka client functionality in OCaml applications.

#stream-processing#functional-programming#message-queue
Stars72
Forks10
Last commit1 year ago
count-min-log
count-min-logGo

Go implementation of Count-Min-Log sketch for improved approximate counting of low-frequency events.

#probabilistic-data-structures#stream-processing#go-library
Stars70
Forks6
Last commit1 year ago
through2-map
through2-mapJavaScript

A thin wrapper around through2 that provides an Array.prototype.map-like API for transforming Node.js streams.

#stream-processing#npm-package#through2-wrapper
Stars70
Forks2
Last commit3 months ago
Scramjet Cloud Platform
Scramjet Cloud PlatformTypeScript

A runtime supervisor for deploying and running data processing programs called Sequences on Linux servers, Docker, and Kubernetes clusters.

#stream-processing#runtime-supervisor#serverless
Stars69
Forks7
Last commit
kinesis-poster-worker
kinesis-poster-workerPython

A multi-threaded Python example demonstrating how to produce and consume records from Amazon Kinesis streams.

#stream-processing#multi-threading#aws-sdk
Stars69
Forks20
Last commit11 years ago
Groovy-stream
Groovy-streamJava

A fluent builder for lazy streams and generators in Groovy, enabling functional-style data processing.

#stream-processing#functional-programming#java-library
Stars67
Forks10
Last commit7 years ago
Reactive Streams Utilities
Reactive Streams UtilitiesJava

A utilities library for Reactive Streams in the JDK, providing familiar operators like map and filter for java.util.concurrent.Flow.

#stream-processing#proposal#reactive-programming
Stars64
Forks7
Last commit
amazon-kinesis-client-net
amazon-kinesis-client-netC#

A .NET interface to the Amazon Kinesis Client Library MultiLangDaemon for building distributed streaming data applications.

#stream-processing#data-consumer#distributed-systems
Stars63
Forks67
Last commit
streamqueue
streamqueueTypeScript

A Node.js library that pipes queued streams sequentially to preserve content order.

#stream-processing#readable-streams#npm-package
Stars63
Forks4
Last commit1 month ago
pipeline
pipelineGo

A Go package providing a simplistic implementation of pipelines using goroutines for concurrent data processing.

#stream-processing#pipeline#golang-library
Stars61
Forks10
Last commit4 years ago
coast
coastScala

A simple, Kafka-inspired stream processing library for Scala with exactly-once semantics and strong ordering guarantees.

#stream-processing#distributed-systems#state-aggregation
Stars60
Forks3
Last commit9 years ago
PreviousPage 6 of 6

Related Tags

Community-curated · Updated weekly · 100% open source

Found a gem we're missing?

Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.

Submit a projectStar on GitHub
1 year ago
7 years ago
6 days ago
#Distributed Systems41
#Real Time Analytics30
#Kafka29
#Big Data27
#Data Pipeline26
#Nodejs26
#Data Pipelines25
#Functional Programming25
#Event Driven21
#Message Queue20
#Go20
#Apache Kafka20