Spark
Showing 36 of 88 projects
A large-scale data warehouse system that provides approximate query answers with error bounds on massive datasets up to 300x faster than Hive.
A Python library for comparing Pandas, Polars, Spark, and Snowpark DataFrames with detailed reporting and flexible matching.
Generate Word2Vec vectors for DBpedia entities from Wikipedia dumps, linking words and topics to structured knowledge.
An engine for ML/data tracking, visualization, explainability, drift detection, and dashboards, integrated with Polyaxon.
Kotlin bindings and extensions for Apache Spark, enabling idiomatic Kotlin development with data classes, lambdas, and null safety.
A fast Apache Spark testing helper library with beautifully formatted error messages for Scala applications.
A library for writing Apache Spark applications in Haskell, enabling resilient analytics that scale to thousands of nodes.
A Fish shell plugin for generating sparklines in the terminal with improved performance and additional flags.
A free, open-source alternative to Spark UI and Spark History Server with enhanced CPU and memory metrics visualizations.
A serverless proxy for Spark clusters that provides a functional programming framework and deployment model for Spark applications.
A bi-directional connector enabling Apache Spark to read from and write to Neo4j graph databases using Spark DataSource APIs.
A language server implementing the Microsoft Language Server Protocol for Ada, SPARK, and GPR project files.
An idiomatic Clojure dataframe library that runs on Apache Spark, providing a seamless interface for data processing and machine learning.
An open-source FHIR server developed in C#, supporting multiple FHIR versions for healthcare data interoperability.
A distributed Spark/Scala implementation of Isolation Forest and Extended Isolation Forest algorithms for scalable unsupervised outlier detection.
Define, run, and deploy big data applications on AWS, OpenStack, and local machines using Docker.
A Ruby wrapper for Apache Spark, enabling large-scale data processing with Ruby's expressive syntax.
A Scala/Spark library for measuring fairness and mitigating bias in large-scale machine learning workflows.
An Apache Spark framework for efficient data processing, extraction, and derivation from web archives and archival collections.
An open-source toolkit for analyzing web archives at scale using Apache Spark.
A toolset for formal specification and generation of verifiable binary parsers, message generators, and protocol state machines.
An experimental Rust client for Apache Spark Connect, providing a DataFrame API to interact with Spark clusters.
A Clojure wrapper for Deeplearning4j, providing idiomatic access to neural networks, data import, and distributed training.
A deep learning system for automatic spoken language identification from audio files using TensorFlow and Caffe.
A multi-processor, 64-bit, formally-verified general-purpose operating system for x86-64, written in SPARK/Ada.
A collection of interactive Jupyter notebooks for learning Hadoop, Spark, and MapReduce with hands-on tutorials and demos.
A Spark application for migrating data to ScyllaDB from CQL-compatible databases or DynamoDB via Alternator.
A library that brings useful functions from various modern database management systems to Apache Spark
Helpers & syntactic sugar for PySpark.
Jupyter notebooks for hands-on Big Data Analytics exercise classes covering Spark ML, Map/Reduce algorithms, and deep learning.
A Python library providing tools to process and analyze OMOP-standardized clinical data from AP-HP's Clinical Data Warehouse.
Ada and SPARK firmware for the Crazyflie 2.0 nano quadcopter, targeting the STM32F4 ARM chip.
A flexible Ada library offering generic containers and algorithms with SPARK compatibility and performance control.
A minimalistic, security-focused x86-64 operating system kernel written in Ada/SPARK with formal verification.
Example notebooks for analyzing web archives using the Archives Unleashed Toolkit.
GitHub Action to set up Ada and SPARK development environments for CI/CD workflows.
Related Tags
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.