CODEWITHSUNDEEP
google-cloud-dataflow
Ashutosh Krishna
Ashutosh Krishna

Reputation: 330

Error message from worker: Data channel closed, unable to receive additional data from SDK sdk-0-0

We're running a Dataflow job on GCP using Apache Beam Python 3.9 SDK 2.45.0. For that, we're using a setup.py file that contains the packages to be installed on the worker machine. While installing the packages, we get the following error:

Python exited: signal: killed

Upon looking in the error logs, we found the following errors:

enter image description here

Any help would be appreciated, thanks!

Upvotes: 3

Views: 1703

Answers (1)

AInguva
AInguva

Reputation: 64

Please take a look at https://cloud.google.com/dataflow/docs/guides/troubleshooting-your-pipeline on how to troubleshoot errors in the Dataflow pipeline.

You will need to look into the worker logs for the root cause.

  • Are you able to install the setup.py, that you pass to the Dataflow, on your local successfully?

Upvotes: 0

Related Questions