Oryx 2
A lambda architecture framework on Apache Spark and Kafka for building and deploying real-time large-scale machine learning applications.
What is Oryx 2?
Oryx 2 is a framework and application suite built on Apache Spark and Apache Kafka that implements the lambda architecture for real-time, large-scale machine learning. It provides both a development framework for custom ML applications and pre-packaged end-to-end solutions for tasks like collaborative filtering, classification, regression, and clustering. The project solves the challenge of deploying scalable, low-latency machine learning systems in production environments.
Data engineers and machine learning practitioners who need to build, deploy, and scale real-time ML applications on big data infrastructure like Hadoop clusters. It's particularly suited for teams requiring both batch and streaming processing capabilities.
Developers choose Oryx 2 because it offers a complete, production-ready solution combining the scalability of Spark and Kafka with specialized ML functionality. Its unique selling point is providing both a flexible framework for custom development and turnkey applications for common ML tasks, reducing the complexity of implementing lambda architecture for machine learning.
Overview
Oryx 2: Lambda architecture on Apache Spark, Apache Kafka for real-time large scale machine learning
Use Cases
Best For
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
