Apache Hudi
An open data lakehouse platform for incremental data processing with upserts, deletes, and time-travel queries.
What is Apache Hudi?
Apache Hudi is an open data lakehouse platform that provides transactional capabilities for big data workloads. It enables efficient upserts, deletes, and incremental data processing on data lakes, allowing users to build real-time data pipelines with time-travel and change data capture features.
Data engineers and platform teams building and managing large-scale data lakes or lakehouses, particularly those needing incremental processing, ACID transactions, and efficient data management on cloud storage.
Developers choose Hudi for its ability to bring database-like features (upserts, deletes, transactions) to data lakes, enabling incremental pipelines, reducing ETL complexity, and providing time-travel and CDC capabilities without proprietary lock-in.
Overview
Upserts, Deletes And Incremental Processing on Big Data.
Use Cases
Best For
- Building incremental data pipelines with upsert/delete support
- Implementing change data capture (CDC) on data lakes
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
