CODEWITHSUNDEEP
google-cloud-vertex-aigoogle-ai-platform
havryliuk
havryliuk

Reputation: 311

google.cloud.aiplatform: Model.batch_predict with sync=False does not submit batch prediction asynchronously

I am creating a batch prediction from a pipeline. According to the documentation sync=False argument for Model.batch_predict would submit a batch prediction asyncronously, meaning (in my understanding) that the pipeline won't wait till the batch prediction completes. Instead it is pinging the batch prediciton status and completed only after the batch prediction completes.

Sample code:

model.batch_predict(
    gcs_source=gcs_source,
    gcs_destination_prefix=gcs_destination,
    machine_type='n1-standard-4',
    instances_format='csv',
    sync=False
)

Pipeline logs:

enter image description here

Upvotes: 0

Views: 588

Answers (1)

havryliuk
havryliuk

Reputation: 311

According to the answer on python-aiplatform Github, asynchronous submission of batch prediction does not mean that the pipeline will not wait for its completion. It means that we can execute some more code after we have submitted the batch prediction. But the pipeline will still wait for the completion of batch prediction.

https://github.com/googleapis/python-aiplatform/issues/1793

Upvotes: 0

Related Questions