SPARK

YData Profilingydataai/ydata-profiling

Generate comprehensive data quality profiling and exploratory data analysis reports for Pandas and Spark DataFrames with a single line of code.

Pandas Profilingpandas-profiling/pandas-profiling

Generate comprehensive data quality profiles and exploratory data analysis reports for Pandas and Spark DataFrames with a single line of code.

PredictionIOapache/predictionio

An open source machine learning server for developers and data scientists, supporting event collection, algorithm deployment, and REST API queries.

h2oh2oai/h2o-3

An open-source, in-memory platform for distributed and scalable machine learning with support for a wide range of algorithms and big data technologies.

Ethen's Notebook Collectionethen8181/machine-learning

A comprehensive collection of machine learning tutorials and implementations in Python, covering algorithms from scratch to production deployment.

spark-jobserverspark-jobserver/spark-jobserver

A RESTful job server for Apache Spark that provides a service interface for submitting and managing Spark jobs, jars, and contexts.

Elasticsearch Hadoopelastic/elasticsearch-hadoop

Native integration library for using Elasticsearch with Hadoop, Spark, and Hive for real-time search and analytics on big data.

MLeapcombust/mleap

MLeap is a portable execution engine for deploying machine learning pipelines from Spark and Scikit-learn without their runtime dependencies.