dataflowkit
A Go web scraping framework that extracts structured data from websites using CSS selectors, including JavaScript-rendered pages.
What is dataflowkit?
Dataflow kit is a web scraping framework for Go that extracts structured data from websites using CSS selectors. It solves the problem of programmatically collecting data from both static and dynamic JavaScript-driven web pages, providing a full pipeline from fetching to parsing and encoding.
Go developers and data engineers who need to build scalable, efficient web scrapers for data mining, processing, or archiving tasks.
Developers choose Dataflow kit for its speed, ability to handle JavaScript-rendered content, and modular design that supports large-scale scraping with flexible storage and output options.
Overview
Extract structured data from web sites. Web sites scraping.
Use Cases
Best For
- Extracting product data from e-commerce websites with pagination
- Scraping dynamic content from JavaScript-heavy single-page applications
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
