Web Scraping
Showing 10 of 190 projects
A tool for capturing and managing web content to prevent information loss when links break or content disappears.
A Common Lisp library for generating random User-Agent strings and full browser profiles.
An Elixir API client for accessing Dublin Bus real-time passenger information (RTPI) by scraping the rtpi.ie website.
Elixir library for accessing the Genius (Rap Genius) API, supporting multiple music genres.
A .NET Core console application for importing image assets from Excel, XML sitemaps, and URLs into Sitecore Content Hub.
A Node.js package to fetch player profile data from the Super Mario Maker bookmark site using Nintendo IDs.
Intelligent web page comparison tool with Wayback Machine artifact cleaning, visual regression testing, and significance scoring.
An MCP server that provides AI agents with unified access to 40+ developer APIs including geolocation, crypto, screenshots, scraping, and code execution.
A CLI tool for downloading Royal Road novels as Markdown files, preserving original formatting.
A cross-platform implementation of dart:html for parsing, manipulating, and querying HTML/XML documents across browsers, mobile, desktop, and server-side environments.
Related Tags
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.