Warc Indexing
3 projects
Showing 3 of 3 projects
hereJava
A toolkit for indexing and exploring web archive content from ARC and WARC files using OpenSearch/Elasticsearch.
#digital-preservation#java#warc-indexing
Stars132
Forks26
Last commit6 months ago
webarchive-discoveryJava
A toolkit for indexing and exploring web archive content from ARC and WARC files using OpenSearch/Elasticsearch.
#digital-preservation#java#warc-indexing
Stars132
Forks26
Last commit6 months ago
webarchive-indexingPython
MapReduce tools for bulk indexing of web archive WARC/ARC files into ZipNum sharded CDX clusters on Hadoop, EMR, or local systems.
#mapreduce#mrjob#zipnum-cluster
Stars46
Forks12
Last commit8 years ago
Related Tags
Community-curated · Updated weekly · 100% open source
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.