CODEWITHSUNDEEP
javaazurehadoophdfs
karthik
karthik

Reputation: 551

Unable to connect with azure blob storage with local hadoop

While trying to connect the local hadoop with the AZURE BLOB storage (ie using the blob storage as HDFS)with Hadoop Version - 2.7.1, It throws exception

Here i have successfully formed the local cluster by setting the property 

<property>
    <name>fs.default.name</name>
    <value>wasb://[email protected]</value>
</property>

and followed by its key value for blob storage in core-site.xml.

while listing the file or making HDFS operations to the blob storage,getting the follwing Exception as 

 ls: No FileSystem for scheme: wasb

Anyone please guide me to resolve the above issue.

Upvotes: 6

Views: 2400

Answers (1)

Kumar
Kumar

Reputation: 3990

  1. You need to add hadoop-azure.jar in the hadoop classpath.
  2. Download azure-storage-java project and build it using maven then you will get azure-storage-3.0.0.jar. Add the built jar in hadoop classpath.

Now you can do all the operations. Refer Azure Blob Storage documentation for more information.

Upvotes: 5

Related Questions