Data Archiving
4 projects
Showing 4 of 4 projects
SecorJava
A fault-tolerant service that persists Kafka log data to cloud storage like S3, GCS, Azure Blob Storage, and OpenStack Swift.
#distributed-systems#data-archiving#hadoop-ecosystem
Stars1.9k
Forks535
Last commit2 months ago
twarcPython
A command line tool and Python library for collecting and archiving Twitter JSON data via the Twitter API.
#python-library#data-archiving#command-line-tool
Stars1.4k
Forks254
Last commit6 months ago
pgsliceRuby
A command-line tool for easy PostgreSQL table partitioning with zero downtime and minimal app changes.
#devops#zero-downtime#data-archiving
Stars1.2k
Forks70
Last commit4 months ago
pixzC
A parallel, indexing version of xz that enables random access to compressed tarballs with multi-core support.
#hacktoberfest#multi-core#file-extraction
Stars775
Forks68
Last commit1 year ago
Related Tags
Community-curated · Updated weekly · 100% open source
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.