spark-jobserver
A RESTful job server for Apache Spark that provides a service interface for submitting and managing Spark jobs, jars, and contexts.
What is spark-jobserver?
Spark Job Server is a RESTful service that provides an HTTP interface for submitting and managing Apache Spark jobs, jars, and contexts. It allows developers to interact with Spark clusters via API calls, simplifying job deployment and management while supporting features like persistent contexts and named object sharing.
Data engineers and developers working with Apache Spark who need a scalable, service-oriented way to submit and manage Spark jobs across clusters, especially in environments requiring REST APIs or multi-tenant job management.
Developers choose Spark Job Server because it offers a production-ready, extensible REST API for Spark, reducing the overhead of job submission and context management while providing enterprise features like authentication, high availability, and support for multiple Spark deployment modes.
Overview
REST job server for Apache Spark
Use Cases
Best For
- Submitting and managing Spark jobs via REST APIs
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
