CODEWITHSUNDEEP
google-cloud-dataflow
Mete Kemertas
Mete Kemertas

Reputation: 170

The Dataflow appears to be stuck

Got the following message: The Dataflow appears to be stuck. Please reach out to the Dataflow team at http://stackoverflow.com/questions/tagged/google-cloud-dataflow.

I realized there were other questions regarding the same error message, but the context seemed different for each and the message rather generic, so I'm posting again.

Job ID: 2017-09-25_09_27_25-5047889078463721675

Please assist. Thanks.

EDIT: Problem seems to have disappeared (at least for now) after updating to Apache Beam SDK for Python 2.1.1 from 2.0.0.

Upvotes: 2

Views: 1249

Answers (1)

Ben Chambers
Ben Chambers

Reputation: 6130

A common cause of stuckness in Dataflow pipelines is an inability to start the workers. If you look at the Stackdriver Logs (view Logs in the UI, and click the link to go to Stackdriver) you should be able to view the worker_startup logs. Any problems here can indicate failures to start workers, which would cause the job to be stuck.

Upvotes: 3

Related Questions