Open-Awesome
CategoriesAlternativesStacksSelf-HostedExplore
Open-Awesome

© 2026 Open-Awesome. Curated for the developer elite.

TermsPrivacyAboutGitHubRSS
  1. Home
  2. Tags
  3. Content Extraction

Content Extraction

9 projects

Showing 9 of 9 projects

webclaw
webclawRust

A fast, local-first web scraper and content extractor optimized for AI agents, with CLI, REST API, and MCP server.

#content-extraction#crawler#cli-tool
Stars1.7k
Forks180
Last commit11 days ago
Email Reply Parser
Email Reply ParserPHP

PHP library for parsing plain text email content to extract visible text and separate signatures and quotes.

#email-replies#content-extraction#php-library
Stars650
Forks81
Last commit3 years ago
hget
hgetHTML

A CLI and API tool that converts HTML into plain text, Markdown, or filtered HTML for terminal viewing.

#developer-tools#terminal-utility#content-extraction
Stars388
Forks13
Last commit2 years ago
read-art
read-artJavaScript

A Node.js library to automatically scrape and extract readable article content from any web page, supporting both English and Chinese.

#readability#content-extraction#crawler
Stars346
Forks36
Last commit8 years ago
readability
readabilityElixir

An Elixir library for extracting and curating the primary readable content from webpages.

#readability#hacktoberfest#elixir
Stars283
Forks64
Last commit8 months ago
Spiderless
SpiderlessJavaScript

A serverless web spider service for monitoring websites and extracting content via CSS selectors.

#vue-js#api#content-extraction
Stars185
Forks25
Last commit3 years ago
FastWARC
FastWARCRust

A collection of robust and fast Python tools for parsing, extracting, and analyzing web archive data, including a high-performance WARC parser.

#cython#batch-processing#content-extraction
Stars144
Forks18
Last commit27 days ago
goreadability
goreadabilityGo

A Go library for extracting readable content from webpages using Open Graph metadata and arc90's readability algorithm.

#readability#content-extraction#go-library
Stars69
Forks8
Last commit7 years ago
/release
/releasePython

A Python CLI tool for converting web pages to clean, readable Markdown format, optimized for feeding documentation into LLMs.

#content-extraction#crawler#python-cli
Stars6
Forks0
Last commit7 days ago

Related Tags

Community-curated · Updated weekly · 100% open source

Found a gem we're missing?

Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.

Submit a projectStar on GitHub
#Web Scraping7
#Text Processing4
#Crawler3
#Readability3