CODEWITHSUNDEEP
pythonamazon-web-servicesjupyter-notebookamazon-emr
Meng zhao
Meng zhao

Reputation: 221

How to import from another ipynb file in EMR jupyter notebook which runs a PySpark kernel?

I'm using jupyter notebook on AWS EMR to run PySpark, and is having trouble importing modules from another file. I tried a couple methods that I searched on stackoverflow, none worked. More specifically, I tried the following (here I have a notebook named "include.ipynb" in the same directory as the notebook that runs the import statements):

enter image description here

Both of these methods worked in jupyter notebook on my local computer. Why aren't they working on AWS?

Upvotes: 3

Views: 1431

Answers (1)

VaibhavK
VaibhavK

Reputation: 13

You have to install these packages in your EMR explicitly using Pip or conda. Your local has those packages installed already.

Upvotes: 1

Related Questions