crawley

Uses Go's x/net/html for high-speed HTML parsing, enabling efficient link extraction without loading the entire DOM into memory, as highlighted in the README's focus on performance.

Incorporates lexical parsers to extract URLs from JavaScript code and CSS url() properties, useful for discovering API endpoints and embedded resources, a key feature mentioned in the description.

Outputs unique results to stdout for easy piping into tools like grep or wget, aligning with its design for composable command-line workflows, as emphasized in the philosophy section.

Supports depth limits, robots.txt policies, subdomain crawling, and tag filtering via flags, allowing fine-grained control over the crawling process, as detailed in the usage examples.