Webarchives
4 projects
Showing 4 of 4 projects
SquidwarcJavaScript
A high-fidelity, user-scriptable archival web crawler using Chrome/Chromium to preserve JavaScript-rendered content.
#high-fidelity-preservation#chrome#puppeteer
Stars178
Forks25
Last commit6 years ago
Archives Unleashed ToolkitScala
An open-source toolkit for analyzing web archives at scale using Apache Spark.
#apache-spark#web-archives#cultural-heritage
Stars158
Forks33
Last commit7 months ago
WarcworkerPython
A dockerized, queued web archiver using Chrome headless to create high-fidelity WARC files from URLs.
#squidwarc#high-fidelity-preservation#warc-files
Stars62
Forks9
Last commit2 years ago
WarclightRuby
A Rails engine for discovering web archives in WARC and ARC formats with faceted search and advanced discovery options.
#web-archives#rails#digital-libraries
Stars50
Forks9
Last commit3 years ago
Related Tags
Community-curated · Updated weekly · 100% open source
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.