At Grove we make extensive use of KubernetesPodOperator[0]. This allows to both encapsulate the job in containers (k8s pods), and also specify the resources we need for each DAG.
[0] https://airflow.apache.org/docs/apache-airflow-providers-cnc...
[0] https://airflow.apache.org/docs/apache-airflow-providers-cnc...
No comments yet.