CODEWITHSUNDEEP
apache-sparkjarapache-zeppelin
muazfaiz
muazfaiz

Reputation: 5031

Load external jars to Zeppelin from s3

Pretty simple objective. Load my custom/local jars from s3 to zeppelin notebook (using zeppelin from AWS EMR).

Location of the Jar

s3://my-config-bucket/process_dataloader.jar

Following zeppelin documentation I opened the interpreter like in the following image and spark.jars in the properties name and its value is s3://my-config-bucket/process_dataloader.jar

enter image description here

I restarted the interpreter and then in the notebook I tried to import the jar using the following

import com.org.dataloader.DataLoader

but it throws the following

<console>:23: error: object org is not a member of package com
       import com.org.dataloader.DataLoader

Any suggestions for solving this problem?

Upvotes: 4

Views: 2498

Answers (1)

Explorer
Explorer

Reputation: 1647

A bit late thought but for anyone else who might need this in future try below option,

https://bucket/dev/jars/RedshiftJDBC41-1.2.12.1017.jar" is basically your s3 object url.

%spark.dep
z.reset()
z.load("https://bucket/dev/jars/RedshiftJDBC41-1.2.12.1017.jar")

Upvotes: 0

Related Questions