CODEWITHSUNDEEP
pythonazurehadoopmapreduceazure-hdinsight
Eduardo
Eduardo

Reputation: 433

Can you run python code with Hadoop Streaming API in Azure HDInsight?

I see that you can run C# code (http://azure.microsoft.com/en-us/documentation/articles/hdinsight-hadoop-develop-deploy-streaming-jobs/.) And presumably any other compiled language since that example uses .exe files.

Can you do the same thing using python code?

Upvotes: 0

Views: 513

Answers (1)

Larry Franks
Larry Franks

Reputation: 431

I have not had much luck running Python mapreduce on HDInsight. While Python is there on the Windows cluster, I have received pipe errors trying to use it for streaming mapreduce.

However, HDInsight on Linux clusters was announced as a preview today, and Python works for streaming mapreduce there. http://azure.microsoft.com/en-us/documentation/articles/hdinsight-hadoop-streaming-python/

Upvotes: 1

Related Questions