CODEWITHSUNDEEP
cachinghadoophdfshadoop-streaming
udayanga
udayanga

Reputation: 421

Caching option for files

I have a requirement to develop a middle tier application to get a requested file from HDFS repository. That is pretty easy. But, I'm thinking of a way that how to cache those requested files for further requests in order to prevent querying that file again and again from HDFS.

For this, what is the best caching option should I use?

Please note that, these files are quite large in size. (near GBs)

Upvotes: 0

Views: 36

Answers (1)

Praveen Sripati
Praveen Sripati

Reputation: 33495

HDFS supports caching, more information here. Not sure in which version this feature has been introduced.

Upvotes: 1

Related Questions