Showing 5 of 5 projects
A Python library and CLI tool for web crawling, scraping, and extracting main text, metadata, and comments from web pages.
A lightweight, efficient, and fast high-level web crawling and scraping framework for .NET.
A framework-agnostic Ruby gem for generating XML sitemaps with Rails integration and support for multiple sitemap extensions.
A high-level Ruby API for controlling Chrome/Chromium browsers directly via the Chrome DevTools Protocol.
A Python security analysis tool that automatically discovers and reports comprehensive information about a given domain.
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.