How to specify machine type in vertex ai pipeline

Question

I want to specify the machine type in vertex ai pipeline with using kfp sdk. I don't know how to specify machine_type while executing it as a component of pipeline. I tried kfp.v2.google.experimental.run_as_aiplatform_custom_job, but it ran as CustomJobExecution instead of ContainerExecution. For that reason, I want to use Airtifact, but airtifact is not mounted on this component.

Since I want to use the airtifact of the previous components and the function of Output [Airtifact], I want to execute it as ContainerExecution instead of CustomJobExecution.

Answer 1

You can use set_memory_limit and set_cpu_limit, just like you would using Kubeflow Pipelines. Vertex Pipelines will convert these limits to a machine type that satisfies your request.