Apache Arrow

polarspola-rs/polars

An extremely fast query engine for DataFrames, written in Rust, with multi-language frontends.

Perspectivefinos/perspective

An interactive analytics and data visualization component for large and streaming datasets, with a high-performance WebAssembly engine.

cudfrapidsai/cudf

A GPU-accelerated DataFrame library for tabular data processing, part of the RAPIDS data science suite.

datafusionapache/datafusion

An extensible SQL query engine written in Rust, using Apache Arrow as its in-memory format for building fast database and analytic systems.

vaexvaexio/vaex

A high-performance Python DataFrame library for lazy out-of-core processing and visualization of billion-row datasets at interactive speeds.

CloudQuerycloudquery/cloudquery

Open-source data pipelines for cloud asset inventory, CSPM, FinOps, and vulnerability management across AWS, Azure, GCP, and 70+ sources.

CloudQuerycloudquery/cloudquery

Open-source data pipelines to sync cloud infrastructure metadata from AWS, Azure, GCP, and 70+ sources into your data warehouse.

GreptimeDBgrepTimeTeam/greptimedb

An open-source observability database that unifies metrics, logs, and traces into a single engine, replacing Prometheus, Loki, and Elasticsearch.

doradora-rs/dora

A Rust-based middleware framework for building low-latency, composable, and distributed AI robotic applications using dataflow graphs.

feather <img class="emoji" alt="heart" src="https://cdn.jsdelivr.net/gh/qinwf/awesome-R@3c66da6e291bcc0520b1649125b0bed750896a9a/heart.png" height="20" align="absmiddle" width="20">wesm/feather

Feather is a binary columnar serialization format for data frames, enabling fast and interoperable data sharing between Python, R, and other languages.

PyGraphistrygraphistry/pygraphistry

A Python library for loading, shaping, embedding, and exploring large graphs with GPU-accelerated visualization and analytics.

RAPIDS cuGraphrapidsai/cugraph

A collection of GPU-accelerated graph analytics libraries for creating, manipulating, and executing scalable graph algorithms.

.NET for Apache Sparkdotnet/spark

.NET for Apache Spark provides high-performance .NET APIs for Apache Spark, enabling C# and F# developers to work with structured and streaming data.

Apache Ballistaapache/arrow-ballista

A distributed query execution engine that extends Apache DataFusion to run SQL queries in parallel across multiple nodes.

reflect-cppgetml/reflect-cpp

A C++20 library for fast serialization, deserialization, and validation using reflection, supporting JSON, Avro, CSV, Parquet, and more.

Tonbotonbo-io/tonbo

An embedded database for serverless and edge runtimes, storing data as Parquet on S3 with stateless compute.