Web Archiving
80 projects
Showing 5 of 77 projects
wbipfsGo
A command-line tool and Go package for archiving webpages to IPFS with Wayback Machine integration.
#ipfs#wayback#decentralized-storage
Stars3
Forks2
Last commit4 years ago
node-cdxjJavaScript
A Node.js library for parsing CDXJ files produced by web archiving tools like Pywb.
#stream-processing#pipeline-tool#web-archives
Stars2
Forks1
Last commit9 years ago
Website-DiffPython
Intelligent web page comparison tool with Wayback Machine artifact cleaning, visual regression testing, and significance scoring.
#visual-regression-testing#web-page-comparison#web-comparison
Stars1
Forks0
Last commit2 days ago
bagnabit2warcPython
Converts bag-nabit datasets from ZIP archives into full-content WARC files for web archiving.
#digital-preservation#warc-format#metadata-preservation
Stars1
Forks0
Last commit4 months ago
WarcPartitionerJava
A Hadoop/MapReduce tool that splits and partitions web archive records in (W)ARC files by MIME type and year.
#mapreduce#data-partitioning#warc
Stars1
Forks1
Last commit9 years ago
PreviousPage 3 of 3
Related Tags
Community-curated · Updated weekly · 100% open source
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.