Kotlin for Apache Spark

Enables direct use of data classes, lambda expressions, and method references in Spark operations, reducing boilerplate code. The README shows examples like dsOf("a" to 1) for creating Datasets with Kotlin Pairs.

Provides aliases such as leftJoin that enforce nullability, returning Dataset<Pair<LEFT, RIGHT?>> to prevent NullPointerException in distributed computations. This is highlighted in the Null safety section with practical examples.

Offers Kotlin-esque functions like withSparkStreaming for Spark Streaming, automating context management and checkpointing. The README includes a full streaming example with automatic JavaStreamingContext handling.

Supports seamless use in Kotlin Jupyter notebooks with %use spark magic for automatic Spark session initialization and HTML rendering of Datasets, as detailed in the Jupyter section with configuration examples.