Favicon of s5cmd

s5cmd

Ultra-fast S3 and local filesystem tool with parallel operations, wildcard support, and batch command execution. 32x faster uploads, 12x faster downloads than alternatives.

s5cmd is a high-performance command-line tool designed for rapid interaction with Amazon S3 and compatible object storage services, as well as local filesystems. Built with Go, it delivers exceptional speed that significantly outpaces traditional alternatives.

Key Performance Advantages:

  • 32x faster uploads compared to s3cmd
  • 12x faster downloads than aws-cli
  • Capable of saturating 40Gbps connections (~4.3 GB/s)
  • Parallel execution of operations for maximum throughput

Core Capabilities:

  • List, upload, download, and delete objects with ease
  • Move, copy, and rename objects across locations
  • Wildcard support across all operations for batch processing
  • Command file support to execute batches of operations at high speed
  • Server-side encryption using AWS KMS
  • Access Control List (ACL) management during uploads and copies
  • Bucket creation and removal
  • Object size summarization grouped by storage class
  • SQL-based JSON record selection from objects
  • S3 Transfer Acceleration support
  • Google Cloud Storage and S3-compatible service support
  • Structured logging for output querying
  • Shell auto-completion
  • Dry-run mode for safe testing

Installation Options: Available as pre-built binaries for Linux, macOS, and Windows, via Homebrew, MacPorts, Conda, FreeBSD packages, or built from source with Go 1.19+. Docker images are also provided for containerized environments.

Credential Management: Supports AWS profiles, environment variables, EC2 IAM roles, EKS Kube IAM roles, and anonymous access with automatic region detection.

Install

Pkg
$ pkg install s5cmd

Features

JSON outputScriptable

Media

Pros

4
  • Ultra-fast S3 and local filesystem operations
  • Supports parallel operations for increased speed
  • Wildcard support for file operations
  • Batch command execution for efficiency

Related tools

Categories:

Share:

Quiet lately: No commits in 1 year — this project might not be actively maintained.

Auto-fetched .

Recent releases

Similar to s5cmd

Favicon

 

  
 
Favicon

 

  
 
Favicon