sbt

kafka-manageryahoo/kafka-manager

A web-based tool for managing Apache Kafka clusters, enabling cluster inspection, topic management, and partition operations.

Delta Lakedelta-io/delta

An open-source storage framework that enables building a Lakehouse architecture with ACID transactions and scalable metadata handling.

scalazscalaz/scalaz

A Scala library providing principled functional programming abstractions, including type classes and purely functional data structures.

Scaldingtwitter/scalding

A Scala API for Cascading that simplifies writing Hadoop MapReduce jobs with Scala integration.

Breezescalanlp/breeze

A numerical processing library for Scala, providing generic, clean, and powerful linear algebra and scientific computing capabilities.

Shapelessmilessabin/shapeless

A type class and dependent type based generic programming library for Scala, enabling boilerplate reduction and arity abstraction.

spark-jobserverspark-jobserver/spark-jobserver

A RESTful job server for Apache Spark that provides a service interface for submitting and managing Spark jobs, jars, and contexts.

Twitter Utiltwitter/util

A collection of idiomatic, small, general-purpose Scala utilities for time, futures, pooling, and hashing.

Sciospotify/scio

A Scala API for Apache Beam and Google Cloud Dataflow, enabling unified batch and streaming data processing.

Algebirdtwitter/algebird

A Scala library providing abstract algebra types and structures for building aggregation systems and analytics.

DataStax Spark Cassandra Connectordatastax/spark-cassandra-connector

A connector that enables Apache Spark to read from and write to Apache Cassandra databases for distributed data processing.

Apache Pekkoapache/incubator-pekko

Build highly concurrent, distributed, and resilient message-driven applications using Java/Scala with the Actor Model.

spark-testing-baseholdenk/spark-testing-base

Base classes for writing Apache Spark tests in Scala and Python, simplifying test setup and teardown.

MLeapcombust/mleap

MLeap is a portable execution engine for deploying machine learning pipelines from Spark and Scikit-learn without their runtime dependencies.