Spark
A library enabling Apache Spark to read from and write to Apache HBase tables as external data sources using DataFrames and SQL.
What is Spark?
Apache Spark - Apache HBase Connector (SHC) is a library that enables Apache Spark to read from and write to Apache HBase tables as external data sources. It allows users to perform Spark SQL queries, DataFrame operations, and Dataset transformations directly on HBase data, bridging the gap between Spark's analytical processing and HBase's scalable storage.
Data engineers and developers working with big data stacks who need to integrate Apache Spark for processing with Apache HBase for storage, particularly in environments requiring SQL-like queries on NoSQL data.
It provides a high-performance, optimized connector that leverages Spark's Catalyst optimizer for predicate pushdown, partition pruning, and data locality, making HBase data accessible through familiar Spark APIs without custom low-level code.
Overview
The Apache Spark - Apache HBase Connector is a library to support Spark accessing HBase table as external data source or sink.
Use Cases
Best For
- Running Spark SQL queries on HBase tables
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.