Stream Processing
Showing 36 of 268 projects
A distributed platform for processing continuous unbounded streams of data with a clean API and fault tolerance.
An Erlang library for parsing RSS and Atom feeds using a stream-based callback interface.
A lazy, depth-first directory tree walker for Elixir that efficiently handles large filesystems.
Stream Processing Made Easy
A reactive stream programming framework for live data computation with concurrent asynchronous operations.
A zero-dependency non-blocking buffered FIFO-pipeline library for Go that executes steps concurrently while maintaining output order.
A Python reactive stream programming framework for concurrent asynchronous data transformations.
A thin wrapper around through2 that provides Array.prototype.filter-like functionality for Node.js streams.
A Go client for building reliable message queues using Redis Cluster Streams.
High-performance Delphi client for Apache Kafka based on the librdkafka C library with full protocol support.
A CSV reading and writing library for Elixir that operates on files or strings.
A dynamic framework for processing high-volume data streams with subsecond pipeline instantiation and modification latency.
A combinator-based functional programming language as a set of libraries for AutoHotkey, fixing its design flaws and enabling functional patterns.
A TAP stream formatter that uses Mocha's reporter styles for test output.
A Java library providing a comprehensive collection of Gatherer implementations for the Stream API.
A Node.js stream that buffers and transforms the first n bytes of a stream before passing it through.
A standalone, portable Ada package for decoding various image formats from any data stream to any output medium.
A simple Elixir library for lazy CSV parsing, optimized for handling large exported databases.
A TAP output formatter that converts test results into structured JSON for easier parsing and integration.
A fast HyperLogLog implementation for Elixir/Erlang that counts unique values with minimal memory usage.
A comprehensive Python library and CLI tool for decoding, encoding, and manipulating SCTE-35 cues in video streams.
A terminal snake game built on stdin/stdout and sockets, following Unix philosophy for modular game state and rendering.
A Go library for standardizing the wrapping of protocol buffer messages in event-driven architectures.
A Go library providing generic functions for building concurrent processing pipelines with fan-out/fan-in patterns.
A fast Go implementation of HeavyKeeper-based top-K sketches, including sliding-window variants for real-time data streams.
A Rust-based jq alternative for continuous JSON parsing that doesn't crash on invalid input, with configurable filtering.
Extracts an audio stream from a media file using fluent-ffmpeg.
A Node.js library for transforming large streams of GeoJSON data into CSV, KML, Shapefile, and other GIS formats.
A resilient, zero-dependency Go package for in-application micro-batch processing with bounded latency.
A TAP consumer that filters output to show only failed test assertions.
A distributed data stream pipeline for querying, augmenting, and transforming data using Elixir pattern-matching rules.
A Mustache template engine implementation in simple procedural Pascal.
A Node.js transform stream that pads each line with a specified indent string.
A stream processing platform with a pluggable architecture for connecting data feeds to transformation operators.
An Elixir package for low-memory consumption iteration over large BSON files by applying a function to each document.
A fluent API for manipulating arrays, lists, queues, and stacks in GameMaker Studio 2.3+ using Java Streams concepts.
Related Tags
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.