scrapy

BSD-3-ClausePython2.19.0

64.9k stars12.0k forks0 contributors

Overview

Scrapy, a fast high-level web crawling & scraping framework for Python.

Related Projects

Community-curated · Updated weekly · 100% open source

Found a gem we're missing?

Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.

Submit a project Star on GitHub

17 hours ago

CreatedSince 2010

Links & Resources

Website

Included in

Python290.8k Beginner-Friendly Projects84.2k

Auto-fetched 11 hours ago

browser-use

Open-source Python library for AI browser agents, plus Browser Use Cloud: stealth browsers and a hosted agent API.

Stars118,794

Forks13,198

Last commit2 days ago

PyTorch - Tensors and Dynamic neural networks in Python with strong GPU acceleration

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Stars104,977

Forks32,521

Last commit10 hours ago

FastAPI

FastAPI framework, high performance, easy to learn, fast to code, ready for production

Stars103,363

Forks10,075

Last commit18 hours ago

crawl4ai

Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf

Stars85,999

Forks8,941

Last commit21 hours ago