pebble
A high-performance, LevelDB/RocksDB-inspired key-value database written in Go, optimized for CockroachDB.
What is pebble?
Pebble is a key-value database written in Go, inspired by LevelDB and RocksDB. It is designed as a high-performance storage engine, specifically optimized for use within CockroachDB, offering improvements in areas like reverse iteration and concurrency while maintaining compatibility with RocksDB file formats.
Developers building database systems or storage layers in Go, particularly those needing an embedded, high-performance key-value store similar to RocksDB but with a simpler codebase.
Pebble provides a production-ready, streamlined alternative to RocksDB with specific performance enhancements, a smaller code footprint, and features tailored for modern database workloads, making it ideal for integration into systems like CockroachDB.
Overview
RocksDB/LevelDB inspired key-value database in Go
Use Cases
Best For
- Embedding a high-performance key-value store in Go applications
- Building database storage engines similar to RocksDB
- Scenarios requiring LevelDB/RocksDB compatibility with Go
- Systems needing efficient range deletions and prefix iteration
- Projects that benefit from a simpler, more maintainable LSM-tree implementation
- Use cases where reverse iteration performance is critical
Not Ideal For
- Projects requiring full RocksDB feature set, such as column families or transactions
- Applications that depend on broad third-party ecosystem tools and integrations built around RocksDB
- Use cases where seamless, zero-downtime migration from existing RocksDB databases without format upgrades is essential
Pros & Cons
Pros
Implements backwards links in the memtable skiplist for optimized reverse iteration, a noted improvement over RocksDB in the Advantages section.
Features a faster commit pipeline that achieves better concurrency, enhancing performance under heavy write loads compared to RocksDB.
Intentionally omits less critical RocksDB features, resulting in a smaller, more approachable codebase that is easier to maintain and understand.
Includes range keys API and block-property collectors, enabling efficient range-based data management and iteration skipping for modern workloads.
Cons
Deliberately lacks many RocksDB features like column families, transactions, and FIFO compaction, which may be necessary for general-purpose use.
Forward compatibility with RocksDB is restricted, and upgrading format major versions can involve blocking operations, adding operational complexity.
Written in Go, it lacks cross-language bindings and the extensive community tools available for RocksDB, limiting use in polyglot environments.
Open Source Alternative To
pebble is an open-source alternative to the following products:
LevelDB is an open-source, embedded key-value storage library developed by Google that provides fast storage and retrieval of key-value pairs.
RocksDB is an embeddable persistent key-value store developed by Facebook, optimized for fast storage on SSDs and used as a storage engine in databases.
Frequently Asked Questions
Related Projects
Prometheus.ioThe Prometheus monitoring system and time series database.
MilvusMilvus is a high-performance, cloud-native vector database built for scalable vector ANN search
TiDBTiDB is built for agentic workloads that grow unpredictably, with ACID guarantees and native support for transactions, analytics, and vector search. No data silos. No noisy neighbors. No infrastructure ceiling.
cockroachCockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.