Question 1

How to run YCSB with MongoDB?

Accepted Answer

First, set up MongoDB and refer to the README in the mongodb-binding directory. Then, use commands like 'bin/ycsb.sh load mongodb -P workloads/workloada' to load data and 'bin/ycsb.sh run mongodb' to execute the benchmark, customizing properties as needed.

Question 2

YCSB vs JMH: which is better for database benchmarking?

Accepted Answer

YCSB is specialized for benchmarking NoSQL databases with standardized workloads simulating real-world patterns, while JMH is a general Java microbenchmarking tool for code snippets. Use YCSB for comparing database systems under load, and JMH for fine-grained method performance analysis.

Question 3

What does YCSB measure for latency?

Accepted Answer

YCSB focuses on tail latency percentiles like P99, P99.9, and P99.99 using HDR histograms, avoiding averaging pitfalls. It provides histogram outputs that must be merged manually for accurate multi-instance analysis, as explained in the README.

Question 4

Can YCSB benchmark SQL databases?

Accepted Answer

YCSB is primarily designed for NoSQL and cloud-serving databases, with some community bindings for SQL systems. However, it's not optimized for SQL benchmarking, and tools like TPC benchmarks may be more suitable for relational database performance evaluation.

Question 5

How to customize workloads in YCSB?

Accepted Answer

Modify the property files in the workloads directory or create new ones, adjusting parameters like record count, operation ratios, and access patterns. The README lists core properties for tailoring simulations to specific application scenarios.

Question 6

Is YCSB good for production monitoring?

Accepted Answer

No, YCSB is intended for controlled benchmarking and testing environments, not real-time production monitoring. It runs batch workloads and requires offline analysis, making it better for pre-deployment evaluation or research studies.

YCSB

What is YCSB?

Overview

Use Cases

Best For

Found a gem we're missing?

Not Ideal For

Pros & Cons

Pros

Cons

Frequently Asked Questions