CODEWITHSUNDEEP
google-cloud-dataproc
user1068378
user1068378

Reputation: 319

Python module dependencies on cloud-dataproc

i am trying to deploy my code on cloud-dataproc. My app is made of two modules, moduleA.py and moduleB.py moduleA import a function from modulB I have uploaded both modules in the same bucket, however when i kick off my dataproc template , dataproc complains that it cannot find moduleB WHat extra steps do i need to follow in order for my moduleA to see moduleB on dataproc?

kind regards

Upvotes: 2

Views: 676

Answers (1)

user1068378
user1068378

Reputation: 319

Apologies to all..I think I had some other unrelated errors in one of the steps I thought I deleted it, nothing to do with dependencies Managed to have a successful run by packaging dependencies in a zip and run with. --py-files gs://mydeps.zip .....

Kind regards

Upvotes: 1

Related Questions