Cdx
3 projects
Showing 3 of 3 projects
Web2WarcScala
A customizable Scala crawler for creating personal web archives in WARC/CDX format.
#digital-preservation#cdx#warc
Stars26
Forks3
Last commit8 years ago
SparklingScala
A Scala/Spark library for efficient processing, extraction, and derivation of web archive data (CDX/WARC).
#apache-spark#jupyter-integration#cdx
Stars17
Forks2
Last commit1 month ago
MementoMapPython
A framework for profiling web archives to summarize their holdings using compact SURT-based maps.
#information-retrieval#python-library#digital-preservation
Stars11
Forks1
Last commit5 years ago
Related Tags
Community-curated · Updated weekly · 100% open source
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.