Warc Format
4 projects
Showing 4 of 4 projects
warcdbPython
WarcDB is an SQLite-based file format that makes web crawl data easier to share and query.
#data-querying#database#warc
Stars405
Forks10
Last commit1 year ago
WarclightRuby
A Rails engine for discovering web archives in WARC and ARC formats with faceted search and advanced discovery options.
#web-archives#rails#digital-libraries
Stars50
Forks9
Last commit3 years ago
html2warcPython
A Python script that converts offline web resources into a single WARC file for archiving.
#digital-preservation#offline-conversion#data-migration
Stars24
Forks3
Last commit3 years ago
webarchiveGo
A Go library for reading and parsing WARC and ARC web archive formats with specialized utilities for web archiving workflows.
#arc-format#digital-preservation#go-library
Stars20
Forks2
Last commit3 years ago
Related Tags
Community-curated · Updated weekly · 100% open source
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.