Data Engineering

A lightweight, fault-tolerant distributed relational database built on SQLite, designed for high availability with minimal operational effort.

An open-source, cloud-native, distributed SQL database offering MySQL compatibility, horizontal scalability, and HTAP capabilities.

A collection of Python scripts for automating MySQL server lifecycle management, backups, failovers, and replication monitoring in production environments.

A lightweight, high-performance network server for the Kyoto Cabinet key-value database with replication and memcached protocol support.

A key-value datastore for Arduino and resource-constrained embedded systems with disk-based persistent storage.

A Python tool to easily create, manage, and destroy local Apache Cassandra clusters for testing.

A high-performance NoSQL database compatible with Apache Cassandra and Amazon DynamoDB, built on a shared-nothing architecture.

A distributed, Prometheus-compatible, real-time, in-memory time series database designed for massive scalability and low-latency operational metrics.

A distributed transactional in-memory database that adds ACID transactions to MongoDB while maintaining scalability.

A specialized database for social interactions (likes, views, follows) that precomputes data at write time for real-time, high-scale reads.

A graph database framework for storing and querying large-scale graphs with rich properties and in-database aggregation.

A scalable time series database optimized for real-time metrics, events, and analytics with fast query response.

A fast distributed scalable time series database built on top of Cassandra.

A scalable time series database built on Bigtable, Cassandra, and Elasticsearch for high-volume metrics.

A high-performance real-time analytics database designed for fast queries and ingest to reduce time to insight.

A high-performance time-series database optimized for modern hardware, supporting both metrics and events with efficient compression.

A fast, low-overhead metric database written in pure Erlang, optimized for time-series data storage and querying.

A multi-tenant distributed system for ingesting, rolling up, and serving time series metrics at massive scale.

A secure time series database backed by Apache Accumulo with Grafana integration for data visualization.

An in-memory computing platform combining a high-performance database and Lua application server for scalable web components.

An open-source graph database for linked data, inspired by Google's Knowledge Graph.

A distributed, in-memory optimized analytics database that fuses Apache Spark and Apache Geode for unified stream, transaction, and analytic workloads.

A Python library for comparing Pandas, Polars, Spark, and Snowpark DataFrames with detailed reporting and flexible matching.

A Python CLI tool for comparing data across heterogeneous databases and data warehouses to ensure migration accuracy.

A blazingly fast data comparison tool for Python that instantly compares massive CSV/Parquet datasets, powered by Rust.

A Python SDK for deploying teams of AI research agents to forecast, score, classify, and gather data at scale.

A CLI tool to copy data between any databases and platforms with a single command, no code required.

Change data capture from PostgreSQL into Kafka using logical decoding, enabling real-time data streaming.

Simplified command-line administration tool for Kafka brokers, providing essential management operations.

A lightweight, non-JVM command-line tool for producing, consuming, and inspecting Apache Kafka messages.

A PostgreSQL extension that enables sending messages directly to Apache Kafka from within the database.

A high-performance C/C++ client library for Apache Kafka, supporting producers, consumers, and admin operations.

A Docker image and configuration for running Apache Kafka in containerized environments.

A web-based tool for managing Apache Kafka clusters, enabling cluster inspection, topic management, and partition operations.

A Node.js client for Apache Kafka 0.9 and later, providing producers, consumers, and administrative APIs.

A fault-tolerant service that persists Kafka log data to cloud storage like S3, GCS, Azure Blob Storage, and OpenStack Swift.

A Kafka transport for Winston that enables logging to Apache Kafka topics via REST proxy.

A snappy open-source proxy for Apache Kafka that enables encryption, multi-tenancy, and schema validation.

A deprecated tool for collecting, processing, and delivering data from multiple sources with Go and Lua plugin support.

A distributed data integration framework for big data ecosystems, handling ingestion, replication, organization, and lifecycle management for both streaming and batch data.

A Python library that simplifies data integration between pandas and AWS services like Athena, S3, Redshift, and more.

A PHP library for live importing Google Sheets data into data warehouses with periodic delta loads.

A lightweight Node.js ETL framework for extracting data from databases and loading it into data lakes and warehouses.

A polyglot document intelligence framework with a Rust core for extracting text, metadata, and structured data from 91+ file formats.

A CRDT-based merge library that guarantees mathematical convergence for DataFrames, JSON, ML models, and distributed agents.

A pure Python HDFS client and Hadoop minicluster wrapper for interacting with Hadoop Distributed File System.

A high-performance distributed POSIX file system for cloud-native environments, storing data in object storage and metadata in databases.

A lightweight, HDFS-compatible file system built over Cassandra with a fat driver design for easy deployment.

A fast distributed storage system for blobs, objects, files, and data lakes, optimized for billions of files with O(1) disk seek.

A fast compression/decompression library optimized for speed over maximum compression.

A language-neutral, platform-neutral, extensible mechanism for serializing structured data developed by Google.

A fast and efficient binary object graph serialization and cloning framework for Java.