Open-Awesome
CategoriesAlternativesStacksSelf-HostedExplore
Open-Awesome

© 2026 Open-Awesome. Curated for the developer elite.

TermsPrivacyAboutGitHubRSS
  1. Home
  2. Tags
  3. Parallel Processing

Parallel Processing

67 projects

Showing 36 of 67 projects

fd
fdRust

A simple, fast, and user-friendly command-line tool to find files and directories, designed as an alternative to the traditional 'find' command.

#search#hacktoberfest#filesystem
Stars43.3k
Forks1.1k
Last commit2 days ago
the_silver_searcher
the_silver_searcherC

A code-searching tool similar to ack, but significantly faster, with parallel search and smart file ignoring.

#silver-searcher#ack-alternative#search-in-text
Stars27.1k
Forks1.4k
Last commit2 years ago
conc
concGo

A Go library providing safer and easier structured concurrency with panic handling, goroutine management, and common concurrency patterns.

#go-library#goroutines#task-pool
Stars10.4k
Forks358
Last commit1 month ago
hyperopt
hyperoptPython

A Python library for distributed asynchronous hyperparameter optimization over complex search spaces.

#hacktoberfest#hyperparameter-optimization#bayesian-optimization
Stars7.6k
Forks1.1k
Last commit13 days ago
dua-cli
dua-cliRust

A parallel disk usage analyzer with interactive TUI for fast exploration and deletion of unwanted data.

#fast#efficient#cleaner
Stars5.9k
Forks153
Last commit3 months ago
gdu
gduGo

A fast, parallel disk usage analyzer with an interactive console interface written in Go.

#hacktoberfest#console-interface#filesystem
Stars5.7k
Forks204
Last commit6 days ago
pgbackrest
pgbackrestC

A reliable, scalable backup and restore solution for PostgreSQL databases with parallel processing, encryption, and cloud storage support.

#database-backup#database#restore
Stars4.1k
Forks373
Last commit3 days ago
s5cmd
s5cmdGo

A parallel S3 and local filesystem execution tool optimized for high-speed object storage operations.

#filesystem#data-transfer#storage
Stars4.1k
Forks338
Last commit1 year ago
tunny
tunnyGo

A goroutine pool library for Go that limits parallel processing with a synchronous API.

#goroutine-pool#go-library#worker-pool
Stars4.0k
Forks309
Last commit3 years ago
glow
glowGo

A distributed computation system written in Go for parallel and cluster processing, similar to Hadoop MapReduce and Spark.

#mapreduce#cluster-computing#go-library
Stars3.2k
Forks249
Last commit7 years ago
ComputeSharp
ComputeSharpC#

A .NET library to run C# code in parallel on the GPU through DX12 and D2D1, generating HLSL shaders dynamically.

#graphics#library#shaders
Stars3.1k
Forks147
Last commit9 months ago
JobRunr
JobRunrJava

A Java library for easy, reliable background job processing with persistent storage, using Java 8 lambdas.

#scheduled-jobs#java-scheduler#task-queue
Stars3.0k
Forks319
Last commit3 days ago
swifter
swifterPython

A Python package that automatically accelerates pandas and Modin DataFrame apply operations by choosing the fastest available method.

#parallelization#parallel-computing#data-science
Stars2.6k
Forks104
Last commit2 years ago
workerpool
workerpoolJavaScript

A JavaScript library for creating and managing pools of workers to offload CPU-intensive tasks in Node.js and browsers.

#task-queue#cpu-offloading#worker-pool
Stars2.3k
Forks164
Last commit4 days ago
StreamEx
StreamExJava

A Java library that extends the Stream API with convenient methods, better interoperability, and enhanced performance.

#code-reduction#java8#functional-programming
Stars2.3k
Forks257
Last commit9 months ago
pond
pondGo

A minimalistic, high-performance goroutine worker pool library for Go that elegantly manages concurrent tasks with automatic scaling.

#task-queue#worker-pool-factory#library
Stars2.2k
Forks82
Last commit1 month ago
Embulk
EmbulkJava

A parallel bulk data loader that transfers data between various storages, databases, NoSQL, and cloud services via plugins.

#gradle#jruby#data-transfer
Stars1.8k
Forks203
Last commit1 month ago
EnvPool
EnvPoolC++

A C++-based high-performance parallel environment execution engine for vectorized reinforcement learning simulations.

#threadpool#parallel-computing#high-performance-computing
Stars1.5k
Forks142
Last commit13 days ago
workerpool
workerpoolGo

A Go worker pool that limits concurrency of goroutine execution without blocking task submission.

#concurrency-control#task-queue#goroutine-pool
Stars1.5k
Forks149
Last commit5 days ago
go-underscore
go-underscoreGo

A collection of functional programming utilities for Go, inspired by underscore.js, designed to enhance developer productivity.

#functional-programming#developer-tools#utility-library
Stars1.3k
Forks62
Last commit3 years ago
Apache Cloudberry
Apache CloudberryC

An advanced open-source MPP database for data warehousing, large-scale analytics, and AI/ML workloads.

#ai#greenplum#database
Stars1.2k
Forks219
Last commit2 days ago
s3gof3r
s3gof3rGo

Fast, parallelized, streaming access to Amazon S3 with a CLI tool and Go library.

#amazon-s3#high-performance#data-transfer
Stars1.1k
Forks180
Last commit4 years ago
Gush
GushRuby

A parallel workflow runner for Ruby that uses Redis for storage and ActiveJob for scheduling, enabling complex job dependencies.

#activejob#parallelization#sidekiq
Stars1.1k
Forks112
Last commit6 months ago
imageproc
imageprocRust

A Rust image processing library for computer vision and graphics applications, built on the image crate.

#no-std-optional#template-matching#graphics
Stars961
Forks178
Last commit5 days ago
popsicle
popsicleRust

A Linux utility written in Rust for flashing multiple USB devices in parallel.

#bootable-media#usb-flashing#cli-tool
Stars833
Forks90
Last commit3 months ago
pixz
pixzC

A parallel, indexing version of xz that enables random access to compressed tarballs with multi-core support.

#hacktoberfest#multi-core#file-extraction
Stars780
Forks68
Last commit1 year ago
Linq_Faster
Linq_FasterC#

High-performance LINQ-like extension methods for arrays, Span<T>, and List<T> with SIMD and parallel optimizations.

#arrays#simd#memory-efficiency
Stars760
Forks35
Last commit8 months ago
grpool
grpoolGo

A lightweight goroutine pool implementation for Go that manages concurrent job execution with configurable workers and job queue size.

#goroutine-pool#go-library#lightweight
Stars736
Forks100
Last commit7 years ago
pool
poolGo

A Go library providing limited and unlimited goroutine pools for easier concurrent task handling and cancellation.

#task-queue#batch-processing#goroutine-pool
Stars724
Forks64
Last commit5 years ago
Parallel Code
Parallel CodeTypeScript

A desktop app that runs multiple AI coding agents in parallel, each in its own git worktree and branch.

#ai-coding-assistant#git-worktree#developer-tools
Stars706
Forks91
Last commit2 days ago
esprint
esprintJavaScript

A fast ESLint runner that speeds up linting by using a caching server and parallel execution across multiple threads.

#developer-tools#linter#ci-cd
Stars656
Forks28
Last commit2 months ago
PoshRSJob
PoshRSJobPowerShell

A high-performance PowerShell module for running background jobs with less overhead than PSJobs.

#runspaces#poshrsjob#runspacepool
Stars553
Forks85
Last commit5 years ago
gowp
gowpGo

A Go worker pool library that limits concurrency of goroutine execution, supports timeouts, and never blocks task submission.

#task-queue#pool#goroutine
Stars517
Forks66
Last commit1 year ago
OmniThreadLibrary
OmniThreadLibraryPascal

A simple and powerful multithreading library for Delphi, enabling easy thread management and inter-thread communication.

#win64#multithreading#thread-management
Stars507
Forks146
Last commit1 month ago
Aparapi
AparapiJava

A framework for executing native Java and Scala code on the GPU via OpenCL for data-parallel computation.

#scientific-computing#high-performance-computing#java-library
Stars479
Forks84
Last commit3 years ago
BlazorWorker
BlazorWorkerC#

A library for creating .NET Web Worker threads and enabling multithreading in client-side Blazor applications.

#web-worker#csharp#dotnet
Stars474
Forks44
Last commit5 months ago
Page 1 of 2

Related Tags

Community-curated · Updated weekly · 100% open source

Found a gem we're missing?

Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.

Submit a projectStar on GitHub
Next
#Concurrency20
#Go18
#Golang12
#Performance12
#Worker Pool11
#Command Line Tool10
#Task Queue8
#Rust8
#Goroutine Pool7
#Go Library7
#Parallel7
#Goroutines6