Apache Iceberg
A high-performance table format for huge analytic datasets, enabling multiple engines to safely work with the same tables simultaneously.
What is Apache Iceberg?
Apache Iceberg is an open table format for huge analytic datasets that provides a high-performance, reliable layer over storage systems like data lakes. It solves data consistency, performance, and evolution challenges by enabling multiple processing engines to safely work with the same tables simultaneously. Iceberg brings SQL table reliability to big data environments with features like ACID transactions, time travel, and schema evolution.
Data engineers, data platform teams, and analytics engineers who manage large-scale data lakes and need consistent, high-performance querying across multiple processing engines like Spark, Flink, Trino, and Hive.
Developers choose Iceberg for its interoperability across engines, reliable table operations (ACID, time travel), and performance optimizations like partition evolution. Its stable specification and active Apache development ensure long-term viability and community support.
Overview
Apache Iceberg
Use Cases
Best For
- Building consistent, high-performance data lakes that support multiple query engines
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
