Warc
3 projects
Showing 3 of 3 projects
Heritrix Q&AJava
An open-source, extensible, web-scale, archival-quality web crawler from the Internet Archive.
#webcrawling#digital-preservation#warc
Stars3.2k
Forks783
Last commit6 days ago
HeritrixJava
An open-source, extensible, web-scale, archival-quality web crawler from the Internet Archive.
#webcrawling#digital-preservation#warc
Stars3.2k
Forks783
Last commit6 days ago
grab-sitePython
A preconfigured web crawler for backing up websites, producing WARC files with a live dashboard and dynamic ignore patterns.
#archiving-tools#spider#archiving
Stars1.6k
Forks155
Last commit11 months ago
Related Tags
Community-curated · Updated weekly · 100% open source
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.