datafusion
An extensible SQL query engine written in Rust, using Apache Arrow as its in-memory format for building fast database and analytic systems.
What is datafusion?
Apache DataFusion is an extensible SQL query engine written in Rust that uses Apache Arrow as its in-memory format. It provides a high-performance foundation for building custom database and analytic systems, with built-in support for SQL, DataFrames, and multiple data formats. It solves the problem of creating fast, tailored data processing engines without starting from scratch.
Developers and engineers building domain-specific query engines, new database platforms, data pipelines, or custom query languages. It is ideal for those needing a performant, extensible base for data-intensive applications.
Developers choose DataFusion for its excellent performance, full-featured extensibility, and strong community support. Its unique selling point is providing a production-ready, customizable query engine that balances out-of-the-box functionality with deep customization capabilities.
Overview
Apache DataFusion SQL Query Engine
Use Cases
Best For
- Building domain-specific query engines for specialized workloads
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
