CODEWITHSUNDEEP
hadoopcompressionapache-piggzip
Mike S
Mike S

Reputation: 935

Using Pig to process compressed files which have no extension

I have a number of files I want to process with pig which have been gzipped. The files do not end with any extension. The documentation that I have seen says that pig determines compression based on file extension, so is there a way to process compressed files without a special file extension. In this case, it is not very feasible to change the file extensions.

Upvotes: 1

Views: 112

Answers (1)

KrazyGautam
KrazyGautam

Reputation: 2692

The only possible way is you writing your own loader , and handling this conditions .

Upvotes: 1

Related Questions