How to run json-schema-benchmark to test my own schemas?

Clone the repository and follow the contribution guidelines to set up the benchmark suite. You'll need Node.js installed and can run the tests to compare validators on your specific schemas by modifying the test configurations.

Ajv vs @exodus/schemasafe: which should I choose?

Based on the benchmarks, Ajv is faster (100% relative speed), but @exodus/schemasafe has slightly better spec compliance (8 vs 10 failing tests). Consider trade-offs between speed and correctness for your project, as Ajv is best for performance-critical apps, while @exodus/schemasafe offers better safety with minimal side-effects.

Does json-schema-benchmark include the latest validator versions?

No, it uses specific versions listed in the README, such as ajv 6.12.6. For up-to-date comparisons, check the GitHub repository for recent updates or contribute your own benchmarks, as the project relies on community contributions.

How to interpret the side-effects summary in json-schema-benchmark?

The side-effects summary shows validators that modify input data or schemas during validation. Avoid validators with high side-effect counts, like revalidator with 818, to prevent unintended data corruption in sensitive applications.

What JSON-schema drafts are supported by json-schema-benchmark?

It supports draft4, draft6, and draft7. Links are provided in the README for each version, but newer drafts like 2019-09 are not covered, so it may not be suitable for projects using the latest specifications.

Can I use json-schema-benchmark for browser validators?

No, it's focused on Node.js validators only. For browser-based validation, you'll need to look for other benchmarking tools or adapt the tests yourself, as the setup is specific to Node.js environments.

Open-Awesome

json-schema-benchmark

MITJavaScript

Performance benchmark and test suite for Node.js JSON-schema validators, evaluating speed, spec compliance, and side-effects.

GitHub

387 stars39 forks0 contributors

What is json-schema-benchmark?

json-schema-benchmark is a benchmarking and testing suite for Node.js JSON-schema validators. It evaluates validators based on performance, compliance with the official JSON-schema test suite, and absence of side-effects, helping developers choose the most suitable validator for their needs.

Target Audience

Node.js developers, backend engineers, and teams working with JSON-schema validation who need to compare validator performance, correctness, and safety for data validation tasks.

Value Proposition

It provides objective, comprehensive benchmarks that go beyond speed to include spec compliance and side-effect checks, offering a holistic view of validator quality that isn't available in individual validator documentation.

Overview

Benchmarks for Node.js JSON-schema validators

Use Cases

Best For

Comparing performance of JSON-schema validators for high-throughput applications
Ensuring validator compliance with official JSON-schema specifications
Identifying validators that avoid side-effects on input data
Evaluating validator options for draft4, draft6, and draft7 schema versions
Making data-driven decisions when selecting validation libraries
Testing validator correctness against comprehensive test suites

Not Ideal For

Projects requiring validation in browsers or other non-Node.js environments
Teams needing benchmarks for JSON-schema drafts beyond draft7 (e.g., 2019-09, 2020-12)
Developers looking for a quick, subjective 'best validator' recommendation without data analysis

Pros & Cons

Pros

Comprehensive Performance Metrics

Measures relative speed and test runs per second for over 20 validators, with clear charts and tables showing Ajv as the fastest at 17000 tests/sec.

Spec Compliance Verification

Tests against the official JSON-schema test suite for draft6, identifying failing tests, with @exodus/schemasafe having only 8 failures.

Side-Effect Safety Check

Detects validators that alter input data or schemas, highlighting risks with libraries like revalidator which caused 818 side-effects.

Multi-Draft Support

Covers draft4, draft6, and draft7 versions, allowing developers to benchmark validators across common schema standards.

Cons

Potentially Outdated Data

Uses specific validator versions (e.g., ajv 6.12.6) that may not reflect latest updates, and updates depend on community contributions.

Limited Feature Coverage

Admits it doesn't account for advanced validator features like custom keywords or async validation, which could be crucial for some use cases.

Node.js Only Focus

Exclusively benchmarks Node.js validators, ignoring browser-based or other language implementations, limiting its scope.

Frequently Asked Questions

Related Projects

ajv

The fastest JSON schema Validator. Supports JSON Schema draft-04/06/07/2019-09/2020-12 and JSON Type Definition (RFC8927)

Stars14,780

Forks1,003

Last commit2 months ago

jsonschema

An implementation of the JSON Schema specification for Python

Last commit3 days ago

Ruby JSON Schema Validator

Stars1,645

Forks247

Last commit19 days ago

Community-curated · Updated weekly · 100% open source

Found a gem we're missing?

Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.

Submit a project Star on GitHub