Showing 4 of 4 projects
A versatile Ruby web spidering library for crawling sites, domains, or specific links with extensive filtering and callback support.
A fast, Unix-style command-line web crawler that extracts links, resources, and API endpoints from web pages.
A fast, powerful, and extensible web crawling and scraping framework for Go, inspired by Scrapy.
A serverless web spider service for monitoring websites and extracting content via CSS selectors.
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.