Scraping
5 projects
Showing 5 of 5 projects
collyGo
A fast and elegant scraping and crawling framework for Go, designed for extracting structured data from websites.
#spider#crawler#scraper
Stars25.3k
Forks1.8k
Last commit4 days ago
webmagicJava
A scalable Java framework for building web crawlers, covering downloading, URL management, content extraction, and persistence.
#distributed-systems#crawler#html-parsing
Stars11.7k
Forks4.1k
Last commit4 months ago
MechanizeRuby
A Ruby library for automating web interaction, handling cookies, redirects, forms, and navigation.
#form-submission#cookies#ruby-gem
Stars4.4k
Forks478
Last commit2 months ago
Symfony PantherPHP
A PHP and Symfony library for browser testing and web scraping using real browsers via the WebDriver protocol.
#hacktoberfest#selenium-webdriver#chromedriver
Stars3.1k
Forks236
Last commit3 months ago
EmbedPHP
A PHP library to extract metadata, embed codes, and structured data from any web page using multiple protocols.
#embeds#social-media#metadata-extraction
Stars2.1k
Forks319
Last commit2 months ago
Related Tags
Community-curated · Updated weekly · 100% open source
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.