sparkle
A library for writing Apache Spark applications in Haskell, enabling resilient analytics that scale to thousands of nodes.
What is sparkle?
Sparkle is a library that enables developers to write Apache Spark applications in Haskell, compiling them into self-contained JAR files for execution on Spark clusters. It solves the problem of applying Haskell's strong typing and functional paradigms to large-scale, distributed data processing tasks typically handled by Spark.
Haskell developers and data engineers who need to build scalable, type-safe analytics applications on Apache Spark, particularly those already invested in the Haskell ecosystem.
Developers choose Sparkle to leverage Haskell's expressiveness and reliability in big data contexts, avoiding the limitations of Java/Scala while still utilizing Spark's proven distributed computing framework.
Overview
Haskell on Apache Spark.
Use Cases
Best For
- Building type-safe data processing pipelines on Apache Spark
- Migrating existing Haskell analytics code to a distributed Spark environment
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
