CODEWITHSUNDEEP
pythonairflowairflow-2.xidempotentpyvmomi
Amir Kedem
Amir Kedem

Reputation: 78

Airflow Idempotency and PyVmomi

I want to create a workflow that automates a virutal machine. First start the VM, run a few processes, upload / download some files and finally shut down the VM.

I need each VM action to be in a separate task. How should I manage the PyVmomi connection, should I instantiate a new connection in every task?

My main concern is too many connections that are opening and closing fast.

EDIT 1 I came across the concept of custom executors. Because I need many of my tasks to happen on VMs is it possible to create a custom executor that will run each DAG on a separate VM. This way all the tasks from a specific workflow will happen on the same VM achiving VM Automations.

Upvotes: 0

Views: 20

Answers (0)

Related Questions