CODEWITHSUNDEEP
hadoopmapreduceapache-pig
Aviral Kumar
Aviral Kumar

Reputation: 824

Renaming part files of PIG output

I have a requirement of changing the part file naming convention after running my PIG job. I want part-r-0000 to be userdefinedName-r-0000.

Any possible solution to that? I am avoiding hadoop -cp and hadoop -mv commands.

Thanks

Upvotes: 3

Views: 1423

Answers (2)

Mikhail Golubtsov
Mikhail Golubtsov

Reputation: 6673

This files are created by map-reduce jobs generated by Pig. So you should configure Apache Map-reduce. The corresponding property is mapreduce.output.basename

You can define any Hadoop property directly in your pig script:

SET mapreduce.output.basename 'custom-name';

Upvotes: 3

rbyndoor
rbyndoor

Reputation: 729

Starting the pig like this would do the same

 pig -Dmapreduce.job.queuename=my-queue -Dmapreduce.output.basename=my-outputfilename;

Upvotes: 1

Related Questions