Open-Awesome
CategoriesAlternativesStacksSelf-HostedExplore
Open-Awesome

© 2026 Open-Awesome. Curated for the developer elite.

TermsPrivacyAboutGitHubRSS
  1. Home
  2. Tags
  3. Pipeline

Pipeline

61 projects

Showing 25 of 61 projects

alf
alfElixir

A flow-based application layer framework for Elixir that implements Flow-Based Programming (FBP) to structure business logic.

#event-processing#component-architecture#elixir
Stars211
Forks6
Last commit2 years ago
Use a Jenkinsfile
Use a JenkinsfileShell

Run Jenkinsfiles inside GitHub Actions using a single-shot Jenkins master in a Docker container.

#jenkins#devops#pipeline
Stars207
Forks57
Last commit2 years ago
Dataset
DatasetPython

A Python library for building lazy data processing and machine learning workflows that handle datasets larger than memory.

#pipeline-framework#batch-processing#workflow
Stars205
Forks45
Last commit1 month ago
machine
machineGo

A Go library for building data processing workflows and pipelines with functional operations, cycles, and fan-out capabilities.

#pipeline-framework#stream-processing#functional-programming
Stars169
Forks12
Last commit3 days ago
open-solution-toxic-comments
open-solution-toxic-commentsPython

An open-source starter solution for the Kaggle Toxic Comment Classification Challenge, providing ready-to-use machine learning pipelines for detecting online harassment.

#ensemble-learning#text-classification#data-science
Stars154
Forks55
Last commit
steppy
steppyPython

A lightweight Python library for building reproducible machine learning pipelines with minimal interface constraints.

#experimentation#python-library#data-science
Stars136
Forks32
Last commit7 years ago
p-pipe
p-pipeTypeScript

Compose promise-returning and async functions into reusable pipelines for sequential execution.

#pipeline#function-composition#async
Stars131
Forks13
Last commit5 years ago
HALFpipe
HALFpipePython

ENIGMA HALFpipe is a user-friendly software that facilitates reproducible analysis of fMRI data

#pipeline#neuroimaging#meta-analysis
Stars129
Forks22
Last commit3 days ago
Sawmill
SawmillJava

A Java library for enriching, transforming, and filtering JSON documents using configurable pipelines.

#grok#java-library#user-agent
Stars123
Forks23
Last commit1 month ago
open-solution-salt-identification
open-solution-salt-identificationPython

An open-source benchmark solution for the Kaggle TGS Salt Identification Challenge using semantic segmentation.

#pipeline-framework#data-science#pipeline
Stars120
Forks44
Last commit
Datajob
DatajobPython

A Python framework for building and deploying serverless data and ML pipelines on AWS using AWS CDK.

#glue#sagemaker#stepfunctions
Stars111
Forks19
Last commit3 years ago
ok_jose
ok_joseElixir

A tiny Elixir library for piping values that match ok/error tuples or custom patterns.

#functional-programming#elixir#library
Stars101
Forks2
Last commit8 years ago
pslinq
pslinqC#

A PowerShell module providing LINQ-style operators for querying and manipulating collections.

#functional-programming#pipeline#linq
Stars76
Forks14
Last commit5 years ago
command-chain
command-chainGo

A Go library for configuring and running command chains, similar to Unix shell pipelines.

#command-pipeline#library#pipeline
Stars71
Forks3
Last commit1 year ago
pipeline
pipelineGo

A Go package providing a simplistic implementation of pipelines using goroutines for concurrent data processing.

#stream-processing#pipeline#golang-library
Stars60
Forks10
Last commit4 years ago
tasker
taskerCrystal

A high-precision scheduler for Crystal that enables scheduling tasks, CRON jobs, and asynchronous pipelines.

#task-scheduler#cron-jobs#pipeline
Stars57
Forks6
Last commit1 month ago
bistro
bistroOCaml

An OCaml library for building and executing typed, distributed scientific workflows with automatic dependency tracking.

#declarative-programming#workflow#pipeline
Stars49
Forks11
Last commit3 months ago
open-solution-googleai-object-detection
open-solution-googleai-object-detectionPython

An open-source solution for the Google AI Open Images Object Detection Challenge, providing a RetinaNet-based benchmark with experiment tracking.

#pipeline-framework#reproducible-experiments#data-science
Stars47
Forks22
Last commit
rocket-pipes
rocket-pipesTypeScript

A TypeScript library providing powerful pipes that seamlessly chain Promises and FP algebraic data types like Maybe and Either.

#compose#either#promise-chaining
Stars26
Forks0
Last commit5 months ago
steppy-toolkit
steppy-toolkitPython

A curated collection of transformers to accelerate and enhance machine learning experimentation with the Steppy library.

#experimentation#python-library#data-science
Stars23
Forks9
Last commit7 years ago
ember-pipeline
ember-pipelineJavaScript

A library for railway oriented programming in Ember.js applications, enabling composable pipelines with cancellation handling.

#workflow-management#functional-programming#async-programming
Stars19
Forks2
Last commit
pluggable
pluggableElixir

Elixir library for building Plug-like pipelines with arbitrary tokens instead of %Plug.Conn{}.

#functional-programming#elixir#library
Stars18
Forks1
Last commit23 days ago
a-shell
a-shellAda

A library for building shell-like applications and command pipelines in Ada.

#library#shell-scripting#pipeline
Stars18
Forks1
Last commit9 months ago
str
strGo

A pipeline-first string manipulation library for Go, enabling composable string transformations with zero dependencies.

#functional-programming#slug-generation#pipeline
Stars10
Forks1
Last commit5 months ago
klubok
klubokTypeScript

A TypeScript library for do-notation pipelines with automatic context passing and easy mocking for unit testing.

#functional-programming#context-passing#unit-testing
Stars2
Forks0
Last commit5 months ago
PreviousPage 2 of 2

Related Tags

Community-curated · Updated weekly · 100% open source

Found a gem we're missing?

Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.

Submit a projectStar on GitHub
4 years ago
5 years ago
4 years ago
8 years ago
#Machine Learning14
#Functional Programming13
#Data Science12
#Python12
#Golang10
#Go10
#Deep Learning10
#Stream Processing7
#Pipeline Framework7
#Workflow6
#Reproducible Research6
#Cross Platform6