Petrel
A Python toolkit for developing, testing, and managing Apache Storm streaming data processing topologies.
What is Petrel?
Petrel is a Python toolkit for creating and managing Apache Storm streaming data processing topologies. It allows developers to write, test, and deploy Storm topologies entirely in Python, eliminating the need for Java or Clojure. The tool handles packaging, dependency management, and provides utilities for debugging and monitoring topologies in both local and cluster environments.
Python developers and data engineers building real-time stream processing applications with Apache Storm who want to avoid Java/Clojure development overhead.
Petrel offers a pure Python development experience for Storm with automated environment setup, built-in testing capabilities, and enhanced logging that simplifies the entire topology lifecycle from development to production monitoring.
Overview
Tools for writing, submitting, debugging, and monitoring Storm topologies in pure Python
Use Cases
Best For
- Developing Apache Storm topologies without writing Java or Clojure code
Related Projects
Found a gem we're missing?
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
