Pipeline
Showing 36 of 61 projects
A modern, cross-platform shell that treats data as structured tables instead of plain text.
An open-source, event-driven orchestration platform for building reliable scheduled and real-time workflows using declarative YAML.
A reactive Python notebook that's reproducible, git-friendly, and deployable as scripts or apps.
Open-source data integration platform for building ELT pipelines from APIs, databases, and files to data warehouses, lakes, and lakehouses.
A Python library for data quality testing and validation using expressive, extensible Expectations.
A Python framework for creating reproducible, maintainable, and modular data engineering and data science pipelines.
A simple, powerful, and extensible CI/CD engine designed for self-hosting.
A Go library for writing shell-like scripts with a pipeline API for file reading, subprocess execution, string matching, and more.
A fast front-end web application build tool with simple declarative config and seamless incremental compilation.
A Python tool for parameterizing, executing, and analyzing Jupyter Notebooks at scale.
Build powerful pipelines in any programming language.
A Kubernetes-native, serverless platform for running massively parallel data and streaming jobs with exactly-once semantics.
A JavaScript application framework for machine learning and its engineering, designed for Web developers.
A cross-platform, dependency-free C++ and Python DAG framework for building parallel computational graphs.
A lightweight and efficient stream processing library for Go, providing a declarative DSL to build data pipelines.
A Go toolkit for building concurrent programs using composable, channel-based pipelines with automatic error propagation.
MLBox is a powerful Automated Machine Learning python library.
A full-stack DevOps framework for simplifying microservice deployment on AWS ECS and EKS.
A scalable n:m message multiplexer written in Go for routing messages from multiple sources to multiple destinations.
A Haskell library for streaming data processing with constant memory usage, deterministic resource handling, and easy composition.
A Ruby gem that transforms plain text into HTML using a pipeline of composable filters.
Easy pipelines for pandas DataFrames.
A Go implementation of the ReactiveX spec providing a declarative and composable API for handling asynchronous data streams.
A library to define a continuous delivery pipeline as code in Clojure, enabling custom, self-hosted CI/CD.
The world's cleanest AutoML library ✨ - Do hyperparameter tuning with the right pipeline abstractions to write clean deep learning production pipelines. Let your pipeline steps have hyperparameter spaces. Design steps in your pipeline like components. Compatible with Scikit-Learn, TensorFlow, and most other libraries, frameworks and MLOps environments.
An Elixir library for elegant error handling using result monads and result tuples.
A CLI tool for processing JSON and text data with functional pipelines using Ramda, supporting both command-line and interactive browser modes.
A command-line tool for neural network inference using Unix pipeline philosophy.
A header-only C++ utility library that simplifies Vulkan graphics programming by reducing boilerplate and verbosity.
Write CI/CD pipelines in C# with local debugging, compile-time safety, and automatic parallelization.
A powerful and flexible mediator implementation for .NET that enables clean architecture by decoupling request/response handling.
A Rust crate providing generic extension methods for tapping, piping, and converting values in method chains.
An open-source machine learning solution for the Home Credit Default Risk Kaggle competition, providing reproducible code and experiments.
A Rust crate for executing and interacting with external processes and pipelines with deadlock-free communication and flexible I/O redirection.
A concurrent task runner and automation toolkit for developers, offering a modern alternative to GNU Make with human-readable YAML/JSON/TOML configurations.
A pipe-like function to write cleaner, more readable JavaScript code by transforming nested calls into vertical pipelines.
Related Tags
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.