CODEWITHSUNDEEP
javaazureazure-storageazure-data-lake
Abdennacer Lachiheb
Abdennacer Lachiheb

Reputation: 4888

How to compress files on azure data lake store

I'm using Azure data lake store as a storage service for my Java app, sometimes I need to compress multiples files, what I do for now is I copy all files into the server compress them locally and then send the zip to azure, even though this is work it take a lot of time, so I'm wondering is there a way to compress files directly on azure, I checked the data-lake-store-SDK, but there's no such functionality.

Upvotes: 1

Views: 532

Answers (1)

Itay Podhajcer
Itay Podhajcer

Reputation: 2664

Unfortunately, at the moment there is no option to do that sort of compression.

There is an open feature request HTTP compression support for Azure Storage Services (via Accept-Encoding/Content-Encoding fields) that discusses uploading compressed files to Azure Storage, but there is no estimation on when this feature might be released.

The only option for you is to implement such a mechanism on your own (using an Azure Function for example).

Hope it helps!

Upvotes: 1

Related Questions