Open-Awesome
CategoriesAlternativesStacksSelf-HostedExplore
Open-Awesome

© 2026 Open-Awesome. Curated for the developer elite.

TermsPrivacyAboutGitHubRSS
  1. Home
  2. Tags
  3. Parallel Processing

Parallel Processing

103 projects

Showing 36 of 103 projects

magenta.nvim
magenta.nvimTypeScript

A Neovim plugin for AI-assisted coding with transparent tool use, sub-agents, and OS-level sandboxing, focused on the Anthropic Claude models.

#ai-coding-assistant#tool-use#agentic-workflow
Stars466
Forks34
Last commit10 days ago
Invoke-Parallel
Invoke-ParallelPowerShell

A PowerShell function for simplified parallel execution using runspaces to speed up scripts.

#runspaces#batch-processing#multithreading
Stars400
Forks83
Last commit4 years ago
crabz
crabzRust

A fast, cross-platform, multi-threaded compression and decompression CLI tool written in Rust.

#multi-threading#cli-tool#gzip
Stars375
Forks13
Last commit18 days ago
parallel-lint
parallel-lintPHP

A parallel PHP syntax checker with multiple output formats and Git blame integration.

#command-line-tool#ci-cd#code-quality
Stars358
Forks26
Last commit2 months ago
rust-parallel
rust-parallelRust

A fast Rust/Tokio command-line utility for running shell commands in parallel with a GNU Parallel/xargs-like interface.

#shell-scripting#command-line-tool#tokio
Stars322
Forks13
Last commit1 day ago
s3-parallel-put
s3-parallel-putPython

A Python tool that accelerates uploading many small files to Amazon S3 by performing multiple PUT operations in parallel.

#s3-parallel#batch-upload#command-line-tool
Stars317
Forks99
Last commit6 years ago
Thumper
ThumperPHP

A PHP library that abstracts common messaging patterns for RabbitMQ, including RPC, pub/sub, and parallel processing.

#message-queue#amqp#asynchronous
Stars277
Forks62
Last commit4 years ago
ecs-lua
ecs-luaLua

A fast, ergonomic Entity Component System engine for Lua game development with no external dependencies.

#robloxlua#luau#roblox
Stars234
Forks69
Last commit2 years ago
ClojureCUDA
ClojureCUDAC

A Clojure library for GPU-accelerated computing using NVIDIA CUDA, enabling high-performance parallel processing.

#cuda#scientific-computing#high-performance-computing
Stars210
Forks12
Last commit2 months ago
neph
nephCrystal

A modern command-line job processor for parallel task execution, similar to make.

#task-automation#devops#make-alternative
Stars206
Forks7
Last commit3 years ago
aiochan
aiochanPython

A Python library implementing CSP-style concurrency with channels, inspired by Go and Clojure's core.async.

#csp#go-patterns#asyncio
Stars184
Forks9
Last commit3 years ago
gzp
gzpRust

A Rust crate for multi-threaded compression and decompression, supporting Gzip, Zlib, Snappy, BGZF, and Mgzip formats.

#mgzip#multi-threading#bgzf
Stars180
Forks15
Last commit2 months ago
errgroup
errgroupGo

A drop-in alternative to Go's sync/errgroup with configurable goroutine worker limits for rate-limited operations.

#sync-patterns#errgroup#goroutine-pool
Stars162
Forks11
Last commit3 years ago
s3-multipart
s3-multipartPython

Python utilities for parallel uploads and downloads to Amazon S3 using multipart uploads and range requests.

#cli-tool#python#file-transfer
Stars162
Forks73
Last commit11 years ago
DistributedR
DistributedRR

A scalable high-performance platform for R that enables large-scale machine learning, statistical analysis, and graph processing across clusters.

#statistical-analysis#graph-processing#high-performance-computing
Stars160
Forks50
Last commit
Photish
PhotishRuby

A fast, convention-based static photo site generator that transforms folders of images into customizable portfolios.

#static-site-generator#template-engine#photo-portfolio
Stars152
Forks10
Last commit6 years ago
fastwalk
fastwalkGo

A fast parallel directory traversal library for Go that significantly outperforms filepath.WalkDir and godirwalk.

#fast#directory-traversal#filesystem
Stars145
Forks8
Last commit2 months ago
ptags
ptagsRust

A parallel universal-ctags wrapper that accelerates tag generation for git repositories by up to 5x.

#developer-tools#source-code-navigation#performance-optimization
Stars143
Forks11
Last commit9 days ago
Kraft Physics Engine
Kraft Physics EnginePascal

An open-source Object Pascal physics engine library for 3D games with rigid body dynamics and collision detection.

#simulation#physics#gamedev
Stars133
Forks25
Last commit11 days ago
PasMP
PasMPPascal

A parallel-processing and multi-processing library for Object Pascal with lock-free data structures and synchronization primitives.

#high-performance#object-pascal#multi-threading
Stars125
Forks42
Last commit21 days ago
concurr
concurrRust

A distributed and concurrent command-line job server & client for parallel command execution across multiple systems.

#shell-scripting#job-scheduler#command-line-tool
Stars117
Forks7
Last commit8 years ago
lfarm
lfarmCommon Lisp

A Common Lisp library for distributing computational tasks across multiple machines using the lparallel API.

#ssh-tunneling#cluster-computing#cl-store
Stars111
Forks9
Last commit11 years ago
sidejob
sidejobErlang

A parallel, capacity-limited worker pool library for Erlang that provides scalable process bounding and overload protection.

#overload-protection#distributed-systems#capacity-limiting
Stars104
Forks22
Last commit3 years ago
threadpool
threadpoolGo

A simple and scalable thread pool implementation in Go for managing concurrent task execution.

#threadpool#task-queue#library
Stars103
Forks19
Last commit6 years ago
parallel_stream
parallel_streamElixir

A parallelized stream implementation for Elixir that maintains order while processing with a worker pool.

#stream-processing#functional-programming#elixir
Stars103
Forks19
Last commit4 years ago
FSharpx.Async
FSharpx.AsyncF#

A collection of asynchronous programming utilities for F#.

#functional-programming#async-programming#dotnet
Stars96
Forks27
Last commit2 years ago
worker-pool
worker-poolGo

A Go library implementing a simple asynchronous worker pool pattern for concurrent task execution.

#task-queue#async#worker-pool
Stars93
Forks13
Last commit5 years ago
gpool
gpoolGo

A generic context-aware resizable goroutines pool for bounding concurrency using semaphores in Go.

#concurrency-control#library#resource-pool
Stars89
Forks5
Last commit3 months ago
dynamodb-import-export-tool
dynamodb-import-export-toolJava

A Java tool for parallel scanning and asynchronous writing to replicate data between DynamoDB tables.

#java-library#database-tool#data-replication
Stars88
Forks36
Last commit7 years ago
goccm
goccmGo

A Go package that limits the number of goroutines allowed to run concurrently with a simple manager interface.

#concurrency-control#go-package#goroutine
Stars73
Forks13
Last commit3 years ago
nursery
nurseryGo

A Go library providing structured concurrency primitives to manage goroutines with proper error handling, cancellation, and cleanup.

#nursery#go-library#golang-library
Stars71
Forks5
Last commit5 years ago
pipeline
pipelineGo

A Go package providing a simplistic implementation of pipelines using goroutines for concurrent data processing.

#stream-processing#pipeline#golang-library
Stars60
Forks10
Last commit5 years ago
ghokin
ghokinGo

A parallelized formatter with no external dependencies for Gherkin files used in Cucumber and Behat.

#gherkin-formatter#behat#cli-tool
Stars59
Forks10
Last commit8 days ago
SwarmCI
SwarmCIPython

A Docker Swarm-based CI extension that adds parallel, distributed, and isolated build tasks to existing CI systems.

#continuous-testing#containerization#devops
Stars58
Forks6
Last commit9 years ago
insyra
insyraGo

A next-generation data analysis library for Go, offering parallel processing, data visualization, and seamless Python integration as an alternative to Pandas.

#parquet#python-integration#plot
Stars57
Forks3
Last commit1 day ago
csv2sql
csv2sqlElixir

A blazing-fast, fully-automated tool for loading large CSV files into MySQL or PostgreSQL databases with parallel processing.

#csv-reader#database#elixir
Stars57
Forks3
Last commit3 months ago
PreviousPage 2 of 3

Related Tags

Community-curated · Updated weekly · 100% open source

Found a gem we're missing?

Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.

Submit a projectStar on GitHub
11 years ago
Next
#Concurrency35
#Go27
#Golang18
#Worker Pool16
#Distributed Computing14
#Go Library14
#Command Line Tool12
#Performance12
#Goroutines11
#Python10
#Task Queue9
#Parallel9