An Apache Spark framework for easy data processing, extraction as well as derivation for web archives and archival collections, developed at Internet Archive.

Stars161

Forks19

Last commit9 months ago

Archives Unleashed Toolkit

The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.

Stars158

Forks33

Last commit7 months ago

Common Crawl Jupyter notebooks

Various Jupyter notebooks about Common Crawl data

Stars66

Forks11

Last commit20 days ago

Archives Unleashed Notebooks

Various examples of notebooks for working with web archives with the Archives Unleashed Toolkit, and derivatives generated by the Archives Unleashed Toolkit.

Stars26

Forks5

Last commit3 years ago

Archives Research Compute Hub

Overview

Related Projects

Found a gem we're missing?

Tags

Built With

Included in