CODEWITHSUNDEEP
azurehadoopmapreduce
Paracharan
Paracharan

Reputation: 1

how can i upload larger files into azure hadoop cluster?

how can i upload larger files into azure hadoop cluster?

Is there a way i can browse to the /example/apps directory in hadoop cluster by taking remote desktop connection so that i can copy the files?

Upvotes: 0

Views: 1156

Answers (2)

Jonathan Gao
Jonathan Gao

Reputation: 31

HDInsight uses Windows Azure Blob storage (WASB). There are several ways you can upload data to WASB:

  • AzCopy
  • Windows Azure PowerShell
  • 3rd party tools include Azure Storage Explorer, Cloud Storage Studio 2, CloudXplorer and so on.
  • Hadoop command line. You must enable RDP first.

For more information, see http://www.windowsazure.com/en-us/manage/services/hdinsight/howto-upload-data-to-hdinsight/.

Upvotes: 1

user728584
user728584

Reputation: 2135

Copy the files to Azure Blob Storage via HTTP/HTTPS and then MapReduce them from Hadoop on Azuure (HDInsight) by pointing at the HTTP URL of the uploaded file(s).

Cheers

Upvotes: 0

Related Questions