Web Archives
3 projects
Showing 3 of 3 projects
ArchiveSparkScala
An Apache Spark framework for efficient data processing, extraction, and derivation from web archives and archival collections.
#data-lineage#apache-spark#web-archives
Stars161
Forks19
Last commit7 months ago
Archives Unleashed ToolkitScala
An open-source toolkit for analyzing web archives at scale using Apache Spark.
#apache-spark#web-archives#cultural-heritage
Stars157
Forks34
Last commit5 months ago
node-warcJavaScript
A Node.js library for parsing and creating Web ARChive (WARC) files with support for Chrome, Puppeteer, and Electron.
#stream-processing#web-archives#warc-files
Stars104
Forks22
Last commit1 year ago
Community-curated · Updated weekly · 100% open source
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.