Databases
56 projects
A lightweight, fault-tolerant distributed relational database built on SQLite, designed for high availability with minimal operational effort.
An open-source, cloud-native, distributed SQL database offering MySQL compatibility, horizontal scalability, and HTAP capabilities.
A collection of Python scripts for automating MySQL server lifecycle management, backups, failovers, and replication monitoring in production environments.
A lightweight, high-performance network server for the Kyoto Cabinet key-value database with replication and memcached protocol support.
A key-value datastore for Arduino and resource-constrained embedded systems with disk-based persistent storage.
A Python tool to easily create, manage, and destroy local Apache Cassandra clusters for testing.
A high-performance NoSQL database compatible with Apache Cassandra and Amazon DynamoDB, built on a shared-nothing architecture.
A distributed, Prometheus-compatible, real-time, in-memory time series database designed for massive scalability and low-latency operational metrics.
A distributed transactional in-memory database that adds ACID transactions to MongoDB while maintaining scalability.
A specialized database for social interactions (likes, views, follows) that precomputes data at write time for real-time, high-scale reads.
A graph database framework for storing and querying large-scale graphs with rich properties and in-database aggregation.
A scalable time series database optimized for real-time metrics, events, and analytics with fast query response.
A fast distributed scalable time series database built on top of Cassandra.
A scalable time series database built on Bigtable, Cassandra, and Elasticsearch for high-volume metrics.
A high-performance real-time analytics database designed for fast queries and ingest to reduce time to insight.
A high-performance time-series database optimized for modern hardware, supporting both metrics and events with efficient compression.
A fast, low-overhead metric database written in pure Erlang, optimized for time-series data storage and querying.
A multi-tenant distributed system for ingesting, rolling up, and serving time series metrics at massive scale.
A secure time series database backed by Apache Accumulo with Grafana integration for data visualization.
An in-memory computing platform combining a high-performance database and Lua application server for scalable web components.
An open-source graph database for linked data, inspired by Google's Knowledge Graph.
A distributed, in-memory optimized analytics database that fuses Apache Spark and Apache Geode for unified stream, transaction, and analytic workloads.
Comparison
2 projects
Ingestion
35 projects
A CLI tool to copy data between any databases and platforms with a single command, no code required.
Simplified command-line administration tool for Kafka brokers, providing essential management operations.
A lightweight, non-JVM command-line tool for producing, consuming, and inspecting Apache Kafka messages.
A PostgreSQL extension that enables sending messages directly to Apache Kafka from within the database.
A high-performance C/C++ client library for Apache Kafka, supporting producers, consumers, and admin operations.
A Docker image and configuration for running Apache Kafka in containerized environments.
A web-based tool for managing Apache Kafka clusters, enabling cluster inspection, topic management, and partition operations.
A Node.js client for Apache Kafka 0.9 and later, providing producers, consumers, and administrative APIs.
A fault-tolerant service that persists Kafka log data to cloud storage like S3, GCS, Azure Blob Storage, and OpenStack Swift.
A snappy open-source proxy for Apache Kafka that enables encryption, multi-tenancy, and schema validation.
A deprecated tool for collecting, processing, and delivering data from multiple sources with Go and Lua plugin support.
A distributed data integration framework for big data ecosystems, handling ingestion, replication, organization, and lifecycle management for both streaming and batch data.
A Python library that simplifies data integration between pandas and AWS services like Athena, S3, Redshift, and more.
A polyglot document intelligence framework with a Rust core for extracting text, metadata, and structured data from 91+ file formats.
File System
10 projectsA pure Python HDFS client and Hadoop minicluster wrapper for interacting with Hadoop Distributed File System.
A high-performance distributed POSIX file system for cloud-native environments, storing data in object storage and metadata in databases.
Serialization format
9 projects
A fast compression/decompression library optimized for speed over maximum compression.
A language-neutral, platform-neutral, extensible mechanism for serializing structured data developed by Google.
A fast and efficient binary object graph serialization and cloning framework for Java.