Open-Awesome
CategoriesAlternativesStacksSelf-HostedExplore
Open-Awesome

© 2026 Open-Awesome. Curated for the developer elite.

TermsPrivacyAboutGitHubRSS
  1. Home
  2. Tags
  3. Stream Processing

Stream Processing

268 projects

Showing 36 of 268 projects

SABER
SABERJava

A window-based hybrid stream processing engine that leverages both CPU and GPU resources for high-performance data analytics.

#stream-processing#window-aggregation#opencl
Stars44
Forks13
Last commit3 years ago
dir_walker
dir_walkerElixir

A lazy, depth-first directory tree walker for Elixir that efficiently handles large filesystems.

#stream-processing#directory-traversal#elixir
Stars43
Forks14
Last commit5 years ago
s4
s4Java

A distributed platform for processing continuous unbounded streams of data with a clean API and fault tolerance.

#stream-processing#event-processing#real-time-analytics
Stars43
Forks16
Last commit7 years ago
Maki Nage
Maki NagePython

Stream Processing Made Easy

#stream-processing#reactive-systems#distributed-systems
Stars42
Forks1
Last commit4 years ago
Scramjet Node.js
Scramjet Node.jsTypeScript

A reactive stream programming framework for live data computation with concurrent asynchronous operations.

#stream-processing#asynchronous-programming#concurrent-operations
Stars41
Forks1
Last commit4 years ago
parapipe
parapipeGo

A zero-dependency non-blocking buffered FIFO-pipeline library for Go that executes steps concurrently while maintaining output order.

#stream-processing#message-queue#channels
Stars38
Forks5
Last commit1 year ago
Scramjet Python
Scramjet PythonPython

A Python reactive stream programming framework for concurrent asynchronous data transformations.

#stream-processing#functional-programming#concurrent-processing
Stars35
Forks1
Last commit2 years ago
through2-filter
through2-filterJavaScript

A thin wrapper around through2 that provides Array.prototype.filter-like functionality for Node.js streams.

#stream-processing#npm-package#through2-wrapper
Stars34
Forks4
Last commit6 months ago
ami
amiGo

A Go client for building reliable message queues using Redis Cluster Streams.

#stream-processing#reliable-queues#redis
Stars34
Forks9
Last commit6 years ago
csvlixir
csvlixirElixir

A CSV reading and writing library for Elixir that operates on files or strings.

#stream-processing#elixir#csv-reading
Stars33
Forks4
Last commit7 months ago
Delphi-Kafka
Delphi-KafkaPascal

High-performance Delphi client for Apache Kafka based on the librdkafka C library with full protocol support.

#stream-processing#event-driven#message-queue
Stars33
Forks14
Last commit8 years ago
SPQR
SPQRJava

A dynamic framework for processing high-volume data streams with subsecond pipeline instantiation and modification latency.

#stream-processing#dynamic-framework#cluster-computing
Stars30
Forks6
Last commit10 years ago
Facade
FacadeAutoHotkey

A combinator-based functional programming language as a set of libraries for AutoHotkey, fixing its design flaws and enabling functional patterns.

#stream-processing#functional-programming#scheme-like
Stars30
Forks3
Last commit
tap-mocha-reporter
tap-mocha-reporterJavaScript

A TAP stream formatter that uses Mocha's reporter styles for test output.

#stream-processing#cli-tool#nodejs
Stars29
Forks32
Last commit10 months ago
Packrat
PackratJava

A Java library providing a comprehensive collection of Gatherer implementations for the Stream API.

#stream-processing#functional-programming#jdk-25
Stars29
Forks1
Last commit1 month ago
generic-image-decoder
generic-image-decoderAda

A standalone, portable Ada package for decoding various image formats from any data stream to any output medium.

#stream-processing#png#scientific-computing
Stars28
Forks5
Last commit2 months ago
first-chunk-stream
first-chunk-streamJavaScript

A Node.js stream that buffers and transforms the first n bytes of a stream before passing it through.

#stream-processing#transform-stream#buffering
Stars28
Forks6
Last commit2 years ago
cesso
cessoElixir

A simple Elixir library for lazy CSV parsing, optimized for handling large exported databases.

#stream-processing#elixir#database-export
Stars27
Forks7
Last commit12 years ago
tap-json
tap-jsonJavaScript

A TAP output formatter that converts test results into structured JSON for easier parsing and integration.

#stream-processing#command-line-tool#nodejs
Stars26
Forks5
Last commit6 years ago
hypex
hypexElixir

A fast HyperLogLog implementation for Elixir/Erlang that counts unique values with minimal memory usage.

#probabilistic-data-structures#stream-processing#unique-counting
Stars21
Forks3
Last commit7 months ago
threefive
threefivePython

A comprehensive Python library and CLI tool for decoding, encoding, and manipulating SCTE-35 cues in video streams.

#mpegts#stream-processing#scte-35
Stars21
Forks4
Last commit7 days ago
snake-pipe-rust
snake-pipe-rustRust

A terminal snake game built on stdin/stdout and sockets, following Unix philosophy for modular game state and rendering.

#stream-processing#unix-philosophy#unix-sockets
Stars20
Forks1
Last commit8 months ago
pletter
pletterGo

A Go library for standardizing the wrapping of protocol buffer messages in event-driven architectures.

#stream-processing#message-enveloping#event-driven-architecture
Stars20
Forks3
Last commit8 months ago
topk
topkGo

A fast Go implementation of HeavyKeeper-based top-K sketches, including sliding-window variants for real-time data streams.

#probabilistic-data-structures#stream-processing#heavy-keeper
Stars20
Forks3
Last commit1 year ago
pipelines
pipelinesGo

A Go library providing generic functions for building concurrent processing pipelines with fan-out/fan-in patterns.

#stream-processing#pipelines#concurrent-processing
Stars19
Forks0
Last commit2 months ago
livejq
livejqRust

A Rust-based jq alternative for continuous JSON parsing that doesn't crash on invalid input, with configurable filtering.

#parsing#stream-processing#jq-alternative
Stars18
Forks1
Last commit2 years ago
geoxform
geoxformJavaScript

A Node.js library for transforming large streams of GeoJSON data into CSV, KML, Shapefile, and other GIS formats.

#stream-processing#geojson#geospatial
Stars18
Forks1
Last commit9 years ago
ffmpeg-extract-audio
ffmpeg-extract-audioJavaScript

Extracts an audio stream from a media file using fluent-ffmpeg.

#stream-processing#ffmpeg#media-processing
Stars18
Forks5
Last commit6 years ago
nibbler
nibblerGo

A resilient, zero-dependency Go package for in-application micro-batch processing with bounded latency.

#stream-processing#event-processing#batch-processing
Stars17
Forks1
Last commit8 months ago
adap
adapElixir

A distributed data stream pipeline for querying, augmenting, and transforming data using Elixir pattern-matching rules.

#stream-processing#elixir#distributed-systems
Stars16
Forks2
Last commit9 years ago
tap-pessimist
tap-pessimistJavaScript

A TAP consumer that filters output to show only failed test assertions.

#stream-processing#test-filtering#testing-utilities
Stars16
Forks0
Last commit9 years ago
MustaPAS
MustaPASPascal

A Mustache template engine implementation in simple procedural Pascal.

#stream-processing#pascal#template-engine
Stars14
Forks3
Last commit10 years ago
pad-stream
pad-streamJavaScript

A Node.js transform stream that pads each line with a specified indent string.

#stream-processing#transform-stream#nodejs
Stars12
Forks6
Last commit3 years ago
Teknek
TeknekJava

A stream processing platform with a pluggable architecture for connecting data feeds to transformation operators.

#stream-processing#real-time-processing#distributed-systems
Stars10
Forks1
Last commit10 years ago
BSONMap
BSONMapElixir

An Elixir package for low-memory consumption iteration over large BSON files by applying a function to each document.

#stream-processing#parse#hex
Stars9
Forks6
Last commit6 years ago
gm-stream
gm-streamGame Maker Language

A fluent API for manipulating arrays, lists, queues, and stacks in GameMaker Studio 2.3+ using Java Streams concepts.

#stream-processing#ds-stack#data-structures
Stars8
Forks0
Last commit4 years ago
PreviousPage 7 of 8

Related Tags

Community-curated · Updated weekly · 100% open source

Found a gem we're missing?

Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.

Submit a projectStar on GitHub
4 years ago
Next
#Distributed Systems48
#Nodejs38
#Real Time Analytics35
#Kafka33
#Functional Programming32
#Big Data31
#Data Pipeline30
#Data Pipelines29
#Data Processing29
#Go26
#Java26
#Event Driven25