Webarchives
3 projects
Showing 3 of 3 projects
SquidwarcJavaScript
A high-fidelity, user-scriptable archival web crawler using Chrome/Chromium to preserve JavaScript-rendered content.
#high-fidelity-preservation#chrome#puppeteer
Stars175
Forks25
Last commit6 years ago
Archives Unleashed ToolkitScala
An open-source toolkit for analyzing web archives at scale using Apache Spark.
#apache-spark#web-archives#cultural-heritage
Stars158
Forks34
Last commit6 months ago
WarcworkerPython
A dockerized, queued web archiver using Chrome headless to create high-fidelity WARC files from URLs.
#squidwarc#high-fidelity-preservation#warc-files
Stars62
Forks9
Last commit1 year ago
Community-curated · Updated weekly · 100% open source
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.