A Playwright reporter that generates JSON test reports compliant with the CTRF open standard.
Playwright JSON Test Results Report is a custom reporter for the Playwright testing framework that produces JSON test reports following the Common Test Report Format (CTRF). It solves the problem of inconsistent test report formats by generating standardized, structured JSON output that includes test summaries, individual test details, environment information, and custom metadata. This allows teams to programmatically analyze and compare test results across different projects and tools.
Developers and QA engineers using Playwright for test automation who need standardized, machine-readable test reports for integration into CI/CD pipelines, dashboards, or custom analysis tools.
Developers choose this reporter because it provides a standardized, CTRF-compliant JSON output from Playwright tests, enabling consistent report parsing and tooling across different testing frameworks. Its rich configurability and support for detailed metadata, screenshots, and parallel test merging offer deeper insights compared to basic built-in reporters.
A Playwright JSON test results reporter that follows the CTRF schema
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
Outputs CTRF-compliant JSON, ensuring consistent validation and analysis across different testing tools and frameworks, as emphasized in the README's focus on interoperability.
Offers extensive options like customizable output files, minimal reports, and inclusion of screenshots or annotations, allowing teams to tailor reports to specific needs.
Supports detailed environment data, browser information, and custom runtime metadata via the 'extra' field, enabling deeper test insights and traceability.
Designed for test sharding with reports that can be merged using ctrf-cli, facilitating efficient handling of large, distributed test suites.
Including screenshots or browser metadata requires additional code in Playwright tests or custom fixtures, adding complexity compared to plug-and-play reporters.
Enabling screenshots can drastically increase report size due to base64 encoding, necessitating careful quality management, as warned in the README's size considerations.
Merging parallel reports relies on the separate ctrf-cli tool, introducing an extra step and potential dependency issue in CI/CD pipelines.