Kubernetes4 min read
Kubernetes Operators for Data Jobs: Unbounded Pods, Then the Cluster Dies
Airflow and Spark can spawn unbounded pods, requests and limits are the difference between busy and evicted, crash loops hide in operators, and MWAA or Databricks is sometimes the right way to not run K8s.
- kubernetes
- orchestration