Kimurai
Write web scrapers in Ruby using a clean, AI-assisted DSL that caches selectors for fast, LLM-free extraction.
What is Kimurai?
Kimurai is a Ruby web scraping framework that uses AI to automatically generate and cache selectors for data extraction. It combines traditional scraping capabilities with LLM-powered intelligence, allowing developers to describe what data they want rather than writing complex XPath/CSS selectors manually. The framework supports multiple browsers and provides a clean DSL for building robust, maintainable scrapers.
Ruby developers who need to build web scrapers for data collection, particularly those working with JavaScript-rendered websites or seeking to reduce selector maintenance overhead. It's ideal for data engineers, researchers, and developers building data pipelines.
Kimurai uniquely combines AI-powered selector generation with traditional scraping tools, offering the intelligence of LLMs without the per-request costs. Its caching mechanism means you get AI accuracy during development but pure Ruby performance in production, making it both powerful and cost-effective.
Overview
Write web scrapers in Ruby using a clean, AI-assisted DSL. Kimurai uses AI to figure out where the data lives, then caches the selectors and scrapes with pure Ruby. Get the intelligence of an LLM without the per-request latency or token costs.
Use Cases
Best For
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
