Data Archiving
Showing 7 of 7 projects
A fault-tolerant service that persists Kafka log data to cloud storage like S3, GCS, Azure Blob Storage, and OpenStack Swift.
A command line tool and Python library for collecting and archiving Twitter JSON data via the Twitter API.
A command-line tool for easy PostgreSQL table partitioning with zero downtime and minimal app changes.
A parallel, indexing version of xz that enables random access to compressed tarballs with multi-core support.
A command-line tool and Python library for archiving Facebook data via the Graph API, supporting recursive retrieval of nodes and edges.
A tool to archive and maintain GTFS-realtime transit data in a relational database for real-time and historical analysis.
A command-line tool that scrapes, normalizes, and archives real-time public transit (GTFS Realtime) data for historical analysis.
Related Tags
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.