micawber

MITPython

680 stars90 forks0 contributors

Overview

a small library for extracting rich content from urls

Community-curated · Updated weekly · 100% open source

Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.

5 days ago

CreatedSince 2012

Auto-fetched 16 hours ago

🌐 Make websites accessible for AI agents. Automate tasks online with ease.

🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN

Scrapy, a fast high-level web crawling & scraping framework for Python.

Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML