CODEWITHSUNDEEP
azurehadoopazure-hdinsight
Dolan Antenucci
Dolan Antenucci

Reputation: 15942

Create sample Azure Hadoop job via Web UI or cross-platform CLI?

I'm trying to play with Hadoop on Azure using HDInsight, but am a bit confused on how to run a Hadoop job on my newly created cluster. So far I've created an HDInsight cluster and attached a Storage Account to it. I also have the azure-cli installed on my local OS X box.

There's an Azure tutorial on launching Hadoop jobs, but it uses PowerShell, which I don't think is available via the Azure cross-platform CLI.

Aside form starting up a Windows VirtualBox, can a job get created via the Azure Web UI (e.g. like Amazon EMR provides) or via some other command line arguments that would be compatible with OS X?

Thanks

Upvotes: 3

Views: 263

Answers (1)

maxiluk
maxiluk

Reputation: 381

  1. Login using Remote Desktop Protocol into the head node of the cluster and use CLI tools there.
  2. Or submit jobs using WebHCatalog REST APIs (e.g. using curl).

HDInsight currently has XPlat CLI tools for cluster provisioning. Job submission XPlat CLI tools will be available later.

Upvotes: 3

Related Questions