An open-source, event-driven orchestration platform for building reliable scheduled and real-time workflows using declarative YAML.
Kestra is an open-source, event-driven orchestration platform that automates both scheduled and real-time workflows using declarative YAML. It solves the complexity of building reliable data pipelines, process automation, and microservice orchestration by applying Infrastructure as Code principles. Developers can define workflows visually or in code, with built-in scalability and a rich plugin ecosystem for extensibility.
Data engineers, DevOps teams, and platform engineers who need to orchestrate complex data pipelines, automate business processes, or manage microservice workflows. It's ideal for organizations running mission-critical applications requiring high availability and fault tolerance.
Developers choose Kestra for its declarative YAML approach combined with a powerful UI, enabling both code-first and visual workflow development. Its rich plugin ecosystem supports any language or cloud service, while built-in scalability and Git integration make it enterprise-ready.
Event Driven Orchestration & Scheduling Platform for Mission Critical Applications
Open-Awesome is built by the community, for the community. Submit a project, suggest an awesome list, or help improve the catalog on GitHub.
Enables Infrastructure as Code for workflows with real-time syntax validation and auto-completion, ensuring consistency whether edited via UI or code.
Hundreds of built-in plugins for databases, cloud services, and multi-language scripting (e.g., Python, Node.js) reduce integration effort and extend functionality.
Designed to handle millions of workflows with high availability and fault tolerance, featuring retries, timeouts, and parallel execution for enterprise-scale deployments.
Combines a drag-and-drop interface with direct Git integration, allowing visual workflow building while maintaining version control and CI/CD pipelines.
Requires setting up Docker, Kubernetes, or cloud infrastructure (e.g., AWS CloudFormation), which can be cumbersome for quick prototyping or small teams.
With a vast plugin ecosystem, ensuring compatibility and updates adds maintenance burden; custom plugin development requires Java knowledge, as per the developer guide.
Complex workflows can lead to lengthy YAML configurations that are hard to manage manually, potentially relying heavily on the UI for readability.