Web Archives
Showing 9 of 9 projects
Core Python Web Archiving Toolkit for replay and recording of web archives
Streaming WARC/ARC library for fast web archive IO
An Apache Spark framework for efficient data processing, extraction, and derivation from web archives and archival collections.
An open-source toolkit for analyzing web archives at scale using Apache Spark.
A Node.js library for parsing and creating Web ARChive (WARC) files with support for Chrome, Puppeteer, and Electron.
A Rails engine for discovering web archives in WARC and ARC formats with faceted search and advanced discovery options.
A prototype web archive exploration UI powered by Solr for searching and browsing archived web content.
Example notebooks for analyzing web archives using the Archives Unleashed Toolkit.
A Node.js library for parsing CDXJ files produced by web archiving tools like Pywb.
Related Tags
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.