Open-Awesome
CategoriesAlternativesStacksSelf-HostedExplore
Open-Awesome

© 2026 Open-Awesome. Curated for the developer elite.

TermsPrivacyAboutGitHubRSS
  1. Home
  2. Tags
  3. S3

S3

88 projects

Showing 36 of 88 projects

Tonbo
TonboRust

An embedded database for serverless and edge runtimes, storing data as Parquet on S3 with stateless compute.

#parquet#database#offline-first
Stars1.6k
Forks100
Last commit6 days ago
Auto Archiver
Auto ArchiverPython

A Python tool to automatically archive web content (videos, images, social media) from Google Sheets and other sources in a secure, verifiable way.

#service#image-archiving#python
Stars1.1k
Forks107
Last commit2 days ago
Sync/upload a directory to an AWS S3 bucket
Sync/upload a directory to an AWS S3 bucketShell

A GitHub Action that syncs local directories with AWS S3 buckets using the AWS CLI.

#actions#deployment#aws-cli
Stars1.1k
Forks488
Last commit2 years ago
s3-lambda
s3-lambdaJavaScript

Run lambda functions over S3 objects with concurrency control for data pipelining and analytics.

#batch-processing#serverless-patterns#s3
Stars1.1k
Forks47
Last commit9 years ago
s3renity
s3renityJavaScript

Run lambda functions over S3 objects with concurrency control for data pipelining and analytics.

#cloud-storage#s3#nodejs
Stars1.1k
Forks47
Last commit9 years ago
Netflix-Priam
Netflix-PriamJava

A co-process for Apache Cassandra that automates backup/recovery, token management, and centralized configuration in AWS environments.

#token-management#backup-recovery#devops
Stars1.0k
Forks295
Last commit1 month ago
Curvine
CurvineRust

A high-performance, concurrent distributed cache system built in Rust for low-latency, high-throughput workloads.

#opendal#multi-tier-cache#ai
Stars873
Forks97
Last commit20 hours ago
Rome
RomeHaskell

A shared cache tool for Carthage that stores built frameworks on S3, Minio, Ceph, or local storage to speed up iOS/macOS development.

#apple-platforms#ios#build-optimization
Stars825
Forks54
Last commit3 years ago
aws
awsRuby

A Chef cookbook providing resources to manage Amazon Web Services infrastructure and services via Infrastructure as Code.

#hacktoberfest#devops#chef
Stars657
Forks554
Last commit15 days ago
discharge
dischargeJavaScript

A command-line tool to deploy static websites to Amazon S3 with optional CDN and HTTPS support.

#deployment#aws-cli#devops
Stars647
Forks18
Last commit5 years ago
aws-lambda-redshift-loader
aws-lambda-redshift-loaderJavaScript

An AWS Lambda function that automatically loads files from S3 into Amazon Redshift clusters with zero server administration.

#aws-cloudformation#batch-processing#serverless
Stars595
Forks161
Last commit
terraform-aws-s3-bucket
terraform-aws-s3-bucketHCL

A Terraform module for creating AWS S3 buckets with comprehensive configuration options.

#devops#aws-resources#infrastructure-as-code
Stars582
Forks3.8k
Last commit6 days ago
pg_back
pg_backGo

A PostgreSQL backup tool that dumps databases, globals, and configuration in flexible formats with encryption and cloud upload support.

#database-backup#devops#data-protection
Stars565
Forks60
Last commit1 month ago
paaster
paasterSvelte

Paaster is a secure and user-friendly pastebin application that prioritizes privacy and simplicity. With end-to-end encryption and paste history, Paaster ensures that your pasted code remains confidential and accessible.

#pastebin#paste#store
Stars552
Forks22
Last commit
s3-proxy
s3-proxyGo

A reverse proxy for S3 buckets with GET, PUT, DELETE operations and OpenID Connect/Basic Auth authentication.

#serve-static#reverse-proxy#s3-reverse-proxy
Stars480
Forks57
Last commit2 days ago
data-pipeline-samples
data-pipeline-samplesPython

Sample AWS Data Pipeline templates for automating data movement and transformation workflows.

#devops#workflow-automation#infrastructure-as-code
Stars472
Forks259
Last commit6 years ago
lambda-refarch-fileprocessing
lambda-refarch-fileprocessingPython

A serverless reference architecture for real-time parallel file processing using AWS Lambda, S3, SQS, and Amazon Comprehend.

#event-driven#lambda#serverless
Stars471
Forks176
Last commit
gulp-awspublish
gulp-awspublishJavaScript

A Gulp plugin for publishing files to Amazon S3 with gzip compression, caching, and sync capabilities.

#gulp#static-deployment#amazon-s3
Stars396
Forks83
Last commit28 days ago
afs
afsGo

A Go library providing a unified API for file operations across local, cloud, and network storage systems.

#filesystem#tar#testing-utilities
Stars390
Forks41
Last commit3 days ago
amazon-elasticsearch-lambda-samples
amazon-elasticsearch-lambda-samplesJavaScript

Sample AWS Lambda functions for streaming data from S3 and Kinesis into Amazon Elasticsearch Service.

#stream-processing#event-driven#kinesis
Stars386
Forks171
Last commit
goamz
goamzGo

A Go library for interacting with Amazon Web Services (AWS), providing packages for EC2, S3, SQS, and other AWS services.

#cloud-infrastructure#go-library#aws-sdk
Stars371
Forks138
Last commit4 years ago
terraform-provider-minio
terraform-provider-minioGo

Terraform provider for managing MinIO S3-compatible object storage buckets, IAM users, and advanced features through infrastructure as code.

#devops#backblaze-b2#object-storage
Stars336
Forks101
Last commit
s3-parallel-put
s3-parallel-putPython

A Python tool that accelerates uploading many small files to Amazon S3 by performing multiple PUT operations in parallel.

#s3-parallel#batch-upload#command-line-tool
Stars317
Forks100
Last commit5 years ago
boring-registry
boring-registryGo

An open-source Terraform and OpenTofu provider and module registry for self-hosting, supporting multiple storage backends.

#provider-registry#devops#module-registry
Stars287
Forks56
Last commit2 days ago
URL-to-PNG
URL-to-PNGTypeScript

A self-hosted URL to PNG generator with parallel rendering via Playwright and configurable storage caching.

#playwright#web-crawling#amazon-s3
Stars251
Forks37
Last commit1 day ago
aws
awsHaskell

A comprehensive Haskell library for interacting with Amazon Web Services including S3, SQS, DynamoDB, and more.

#haskell#functional-programming#aws-sdk
Stars245
Forks111
Last commit7 months ago
tf_aws_bastion_s3_keys
tf_aws_bastion_s3_keysHCL

A Terraform module for creating a resilient AWS bastion host with SSH keys managed from an S3 bucket.

#bastion-host#cloud-infrastructure#devops
Stars188
Forks113
Last commit3 years ago
pgrwl
pgrwlGo

A cloud-native PostgreSQL WAL receiver for zero-data-loss streaming, compression, encryption, and remote archiving.

#database-backup#database#recovery
Stars180
Forks9
Last commit1 day ago
Fluency
FluencyJava

A high-performance Java library for asynchronous data ingestion to Fluentd, Fluent Bit, AWS S3, and Treasure Data.

#treasuredata#observability#java
Stars167
Forks38
Last commit25 days ago
aws-pdf-textract-pipeline
aws-pdf-textract-pipelineTypeScript

Serverless data pipeline for crawling PDFs from the web and extracting structured data using AWS Textract.

#lambda#web-crawling#aws-textract
Stars165
Forks20
Last commit2 years ago
aws-codedeploy-plugin
aws-codedeploy-pluginJava

Jenkins plugin that automates deployment of applications to AWS CodeDeploy after successful builds.

#devops#aws-integration#infrastructure-as-code
Stars155
Forks131
Last commit2 years ago
splits-io
splits-ioRuby

A speedrun data store, analysis engine, and racing platform for sharing and analyzing split-by-split run history.

#highcharts#rails#redis
Stars142
Forks32
Last commit1 year ago
aws-s3-uploader
aws-s3-uploaderJavaScript

A macOS Electron app for uploading files to AWS S3 directly from the status bar via drag-and-drop.

#upload#desktop-app#storage
Stars141
Forks14
Last commit9 years ago
Cloud Storage
Cloud StorageC#

A cross-provider blob storage toolkit for .NET and ASP.NET that unifies cloud storage APIs behind a single interface.

#orleans#signalr#storage
Stars135
Forks27
Last commit2 months ago
wrestic
wresticRust

A Rust wrapper for restic that simplifies configuration and automation of secure, deduplicated backups.

#restic#local#restic-wrapper
Stars104
Forks2
Last commit1 year ago
awscr-s3
awscr-s3Crystal

A Crystal shard providing a comprehensive client library for Amazon S3 and S3-compatible object storage services.

#object-storage#s3#minio
Stars90
Forks52
Last commit5 months ago
PreviousPage 2 of 3Next

Related Tags

Community-curated · Updated weekly · 100% open source

Found a gem we're missing?

Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.

Submit a projectStar on GitHub
2 years ago
2 days ago
3 years ago
7 years ago
1 day ago
#Cloud Storage26
#Aws26
#Aws S321
#Object Storage20
#Devops17
#Go16
#Docker15
#Infrastructure As Code11
#Storage11
#Python10
#Automation10
#Self Hosted10