parallel_stream
A parallelized stream implementation for Elixir that maintains order while processing with a worker pool.
What is parallel_stream?
ParallelStream is an Elixir library that provides parallelized implementations of common stream operations like map, each, filter, and reject. It solves the problem of slow sequential stream processing by distributing work across multiple concurrent workers while maintaining the original order of elements, significantly improving performance for CPU-intensive or I/O-bound tasks.
Elixir developers working with large datasets or performance-sensitive stream operations who need to leverage concurrency while preserving processing order.
Developers choose ParallelStream because it offers a simple, drop-in replacement for Elixir's standard stream functions with automatic parallelization, requiring minimal code changes while providing substantial performance improvements through its worker pool architecture.
Overview
A parallelized stream implementation for Elixir
Use Cases
Best For
- Processing large collections with CPU-intensive mapping functions
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
