Kestra

Kestra is an event-driven orchestration platform that unifies scheduled and real-time automation behind one declarative interface. Workflows are YAML, and the definition is rewritten whenever someone changes a flow from the UI, an API call or Terraform, so the orchestration logic stays managed as code no matter which door the change came through.

A flow lives in a namespace and holds tasks, while triggers decide when it runs, on a schedule or on an event such as a file arriving or a message landing in Kafka, Redis, Pulsar, MQTT, AWS SQS or Google Pub/Sub. Inputs and variables carry data through, and outputs generate artifacts visible in the interface.

The platform is language-agnostic, and the plugin ecosystem is where that shows.

• Run anywhere: Tasks execute locally, on remote servers over SSH, in Docker containers or as Kubernetes jobs.
• Any language: Python, Node.js, R, Go and Shell scripts run as tasks, alongside SQL queries and HTTP calls.
• Resilience: Retries, timeouts, error handling, conditional branching, backfills, subflows and dynamic tasks.
• Editor: Syntax highlighting, auto-completion, live validation and a topology view of the flow graph.
• Version control: Push flows from the built-in editor to a Git branch and keep CI/CD in the loop.

A single Docker command starts a local server on port 8080. Installation guides cover Docker Compose, Podman, Kubernetes, AWS, Google Cloud and Azure, with CloudFormation and Terraform templates for cloud deployments.