CODEWITHSUNDEEP
hadoopapache-pig
chamibuddhika
chamibuddhika

Reputation: 1439

Executing Pig on another framework

I understand that Pig Latin is a data flow language. In that sense it should be theoretically possible to execute Pig Latin in any framework though currently and it is meant to be executed in a Hadoop enviornment. How hard would it be to switch Pig Latin to run on a different framework? Are there any extension points for this if at all or is Pig Latin is tightly coupled to Hadoop?

Upvotes: 1

Views: 184

Answers (1)

Donald Miner
Donald Miner

Reputation: 39943

PigLatin is tightly coupled to Hadoop. Basically, the PigLatin script is interpreted into a series of Hadoop MapReduce jobs and there isn't really much way of swapping out that underlying data computation layer.

You can write a custom loader and custom writer to load from and store to custom data stores, but in the end it is still starting a Hadoop MapReduce job.

Upvotes: 1

Related Questions