A high-performance, multi-threaded command-line tool for Amazon S3 and S3-compatible storage with enhanced Unix-like behavior.
s4cmd is a command-line tool for efficiently managing files on Amazon S3 and S3-compatible storage services. It provides fast, multi-threaded operations for uploading, downloading, syncing, and managing large datasets, addressing performance limitations and usability quirks found in other S3 CLI tools. It solves the need for a reliable, script-friendly interface that behaves predictably like traditional Unix filesystem commands.
Developers, data engineers, and system administrators who regularly work with S3 in automated scripts or handle large-scale data transfers and need a fast, reliable command-line interface.
Developers choose s4cmd for its significant performance improvements over s3cmd, its Unix-like path handling that reduces surprises, and its robust feature set for large files and synchronization, all while maintaining a simple, pure-Python implementation.
Super S3 command line tool
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
Uses multiple connections for uploads and downloads, delivering up to 2x faster performance compared to single-threaded tools like s3cmd, as noted in the README.
Follows traditional filesystem conventions for commands like ls and cp, reducing surprises with S3's flat object model and improving script predictability.
Handles files larger than 5GB with multipart uploads and supports batch delete for up to 1000 files, making data-intensive operations significantly faster.
Offers pass-through to 36+ boto3 S3 API options, such as --API-ServerSideEncryption, enabling granular control over encryption, metadata, and other advanced features.
Lacks support for CloudFront and other S3-related services, restricting use to basic object storage operations, as admitted in the unimplemented features section.
Path matching and command semantics differ from s3cmd, such as prefix handling and sync behavior, requiring script adjustments for migration.
Support for non-Amazon S3 services like DreamHost is labeled a community-supported beta feature, which may lack stability or thorough testing.
s4cmd is an open-source alternative to the following products: