hdfs - A native go client for HDFS
A native Go client library and command-line tool for HDFS that connects directly to the namenode via protocol buffers.
What is hdfs - A native go client for HDFS?
HDFS for Go is a native Go client library and command-line tool for interacting with Hadoop Distributed File System (HDFS). It connects directly to the namenode using the protocol buffers API, providing a fast and idiomatic alternative to Java-based HDFS clients. The library implements interfaces from Go's standard `os` package, making it familiar for Go developers.
Go developers and data engineers who need to interact with HDFS in their applications or workflows, especially those looking for a performant, native alternative to the Hadoop Java client.
Developers choose HDFS for Go because it offers significantly faster performance than `hadoop fs` by avoiding JVM startup overhead, provides an idiomatic Go API that mirrors the standard library, and includes a feature-rich command-line tool with bash tab completion.
Overview
A native go client for HDFS
Use Cases
Best For
- Building Go applications that need to read/write data to HDFS
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.