Bytewax
A Python framework and Rust-based distributed processing engine for stateful event and stream processing.
What is Bytewax?
Bytewax is a Python framework and Rust-based distributed processing engine for stateful event and stream processing. It enables developers to build scalable data pipelines that maintain and recover state automatically, integrating seamlessly with the Python ecosystem. The framework simplifies complex stream processing tasks, making it accessible for real-time analytics and machine learning applications.
Data engineers, machine learning engineers, and developers building real-time data pipelines, event-driven applications, or stateful stream processing systems using Python.
Developers choose Bytewax for its Python-first approach, allowing them to leverage existing libraries and tooling while gaining the scalability and stateful processing capabilities of systems like Apache Flink or Spark. Its integration with Kubernetes and rich connector ecosystem make it ideal for production deployments.
Overview
Python Stream Processing
Use Cases
Best For
- Building real-time data pipelines with Python
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
