Data Pipelines
76 projects
Showing 4 of 76 projects
through2-concurrentJavaScript
A Node.js Transform stream that processes data chunks concurrently with configurable max concurrency.
#stream-processing#async-processing#transform-stream
Stars75
Forks11
Last commit5 years ago
Run Parameterized Jupyter NotebooksJavaScript
A GitHub Action that executes parameterized Jupyter notebooks using Papermill and uploads outputs as artifacts.
#reproducible-research#ci-cd#jupyter-notebook
Stars74
Forks15
Last commit2 years ago
capillariesGo
A distributed batch data processing framework that handles scalability and intermediate storage, letting users focus on transforms and quality control.
#batch-processing#workflow-engine#message-queue
Stars72
Forks5
Last commit5 days ago
streamqueueTypeScript
A Node.js library that pipes queued streams sequentially to preserve content order.
#stream-processing#readable-streams#npm-package
Stars63
Forks4
Last commit1 month ago
PreviousPage 3 of 3
Related Tags
Community-curated · Updated weekly · 100% open source
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.