Scraper
Showing 20 of 20 projects
A system for building agents that perform automated tasks online, like a self-hosted IFTTT or Zapier.
A system for building agents that monitor the web and automate tasks, giving you full control over your data.
The fast, flexible, and elegant library for parsing and manipulating HTML and XML.
A fast and elegant scraping and crawling framework for Go, designed for extracting structured data from websites.
A high-level Go driver for Chrome DevTools Protocol, designed for web automation and scraping.
A Slack bot that reads and summarizes webpages, documents, and videos using ChatGPT, with voice chat capabilities.
A lightweight Ruby web crawler and scraper with an elegant DSL for extracting structured data from web pages.
A high-level web crawling and scraping framework for Elixir, designed for data extraction and processing.
Write web scrapers in Ruby using a clean, AI-assisted DSL that caches selectors for fast, LLM-free extraction.
A high-performance web crawler and scraper built in Elixir with worker pooling and rate limiting.
A versatile Ruby web spidering library for crawling sites, domains, or specific links with extensive filtering and callback support.
A Java API for controlling Chrome and Firefox browsers via DevTools and WebDriver-bidi protocols.
A high-performance, multithreaded command-line tool for downloading images from webpages.
A Go web scraping framework that extracts structured data from websites using CSS selectors, including JavaScript-rendered pages.
A Multi-User Selfhosted price tracker for Amazon, Aliexpress, ebay and many more along with custom stores. Get notified when price matches one or more criterias set by the user
An unofficial Node.js API for programmatically accessing HLTV's Counter-Strike esports data, including matches, teams, players, and live scores.
A Go library for extracting readable content from webpages using Open Graph metadata and arc90's readability algorithm.
A Go library for scraping recipe data from websites using Schema.org and custom scrapers.
A Go library for seamlessly fetching paginated data from any source with built-in API scraping and parallel processing.
Scrapes PocketBase documentation and generates LLM-optimized variations for different development contexts.
Related Tags
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.