dyer
A reliable, flexible, and fast Rust framework for web crawling and request-response services.
What is dyer?
Dyer is a Rust framework for building reliable, flexible, and fast request-response based services, particularly optimized for web crawling and data processing. It provides high-level APIs and an event-driven architecture to automate complex crawling tasks while maximizing system resource efficiency.
Rust developers building web crawlers, data scrapers, or any high-performance request-response services that require concurrency, flexibility, and reliability.
Developers choose Dyer for its combination of speed, ease of use, and comprehensive features—offering async concurrency, event-driven automation, and modular functionality without compromising performance, all within a Rust-native ecosystem.
Overview
Dyer is designed for reliable, flexible and fast web crawling, providing some high-level, comprehensive features without compromising speed.
Use Cases
Best For
- Building high-performance web crawlers in Rust
- Scraping large-scale websites with concurrent requests
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
