A distributed and concurrent command-line job server & client for parallel command execution across multiple systems.
Concurr is a distributed command execution tool written in Rust that allows users to run shell commands in parallel across multiple machines. It solves the problem of scaling command-line job processing beyond a single system by using a client-server architecture where jobs are distributed to nodes for concurrent execution.
System administrators, DevOps engineers, and developers who need to automate and parallelize command execution across clusters or multiple servers, especially those familiar with GNU Parallel.
Developers choose Concurr for its performance-focused Rust implementation, distributed capabilities that go beyond single-machine parallelism, and its familiar yet simplified syntax compared to GNU Parallel.
Performs distributed command execution, written in Rust w/ Tokio
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
Enables execution across multiple machines, scaling beyond single-system limits as described in the server's core-matching thread pools.
Uses GNU Parallel-like command syntax, reducing learning curve for users already accustomed to similar tools, per the client design.
Built on Tokio for non-blocking network communication, optimizing performance in distributed setups as highlighted in the architecture.
Spawns thread pools per server core, ensuring efficient CPU utilization during command execution, as detailed in the server workings.
Requires deploying and managing server nodes with embedded Ion shell instances, adding overhead for simple or local tasks.
Relies on Ion shell for execution, restricting use with other shells like Bash unless modifications are made, as noted in the server description.
Lacks built-in support for job retries, priority queues, or detailed monitoring compared to more mature distributed systems.
concurr is an open-source alternative to the following products: