A next-generation web scanner that identifies websites and their technologies using over 1800 plugins with configurable aggression levels.
WhatWeb is a next-generation web scanner that identifies websites and the technologies they use. It answers the question "What is that Website?" by recognizing content management systems, blogging platforms, JavaScript libraries, web servers, and embedded devices. The tool helps security professionals and system administrators gather intelligence and fingerprint web technologies efficiently.
Security professionals, penetration testers, system administrators, and developers who need to identify web technologies, perform reconnaissance, or conduct security assessments.
Developers choose WhatWeb for its extensive plugin library (over 1800 plugins), configurable aggression levels that balance speed and thoroughness, and flexible output formats. Its ability to be both stealthy and aggressive makes it a versatile tool for various scanning scenarios.
Next generation web scanner
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
With over 1800 plugins, WhatWeb can detect a vast range of web technologies, versions, and details like email addresses, making it highly thorough for reconnaissance. The plugins use multiple methods including text strings, regular expressions, and MD5 hashes.
Users can balance speed and stealth with aggression levels from 1 (stealthy, one request) to 4 (heavy, many requests), allowing tailored scans for public websites or penetration tests. This flexibility is highlighted in the Aggression section of the README.
WhatWeb supports multiple log formats like JSON, XML, MongoDB, and ElasticSearch, enabling easy integration with other tools and databases for analysis. The README lists various --log-* options for different use cases.
The tool offers controls for concurrent threads, timeouts, and output buffering, with auto-optimization based on thread count for efficient large-scale scans. The Performance & Stability section details --max-threads and --output-buffer-size settings.
Features like MongoDB logging and character set detection require separate installation steps (e.g., bundle install --with mongo), adding setup overhead. The README notes this in the Optional Dependencies section, which can deter quick deployment.
Enabling character set detection for JSON or MongoDB logging dramatically decreases performance by increasing CPU usage, as admitted in the README. This limits efficiency in high-volume scans when full logging is needed.
The wiki links for plugin development, such as 'How to Develop WhatWeb Plugins', are noted as 'not up to date', potentially hindering custom plugin creation and maintenance. This is mentioned in the Writing Plugins section.