xidel
A command-line tool to extract data from HTML/XML pages and JSON APIs using CSS, XPath, XQuery, JSONiq, and pattern matching.
What is xidel?
Xidel is a command-line tool for downloading and extracting data from HTML, XML, and JSON sources, including web pages and REST APIs. It supports multiple query languages like CSS selectors, XPath, XQuery, and JSONiq, allowing users to scrape, transform, and generate structured documents. It solves the problem of programmatically accessing and processing web data without relying on browser automation or complex scripting.
Developers, data engineers, and researchers who need to automate web scraping, extract data from APIs, or transform web content into structured formats from the command line.
Xidel stands out by supporting a wide range of query languages in a single tool, offering dependency-free binaries for major platforms, and enabling complex data extraction and transformation workflows with simple commands.
Overview
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
Use Cases
Best For
- Scraping data from websites using CSS selectors or XPath
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
