CODEWITHSUNDEEP
azureparquetazure-blob-storage
Jiew Meng
Jiew Meng

Reputation: 88187

Downloading parquet files from Azure Blob Storage. File and folder with same names

I have created parquet files on Azure Blob Storage. And now I want to download them. Problem is it keeps failing. I think its because the is a file and folder with same names. Why is that? Do I just need the folder? Since the file is only 0B?

enter image description here

The error I get looks like:

enter image description here

Its saying that because it already downloaded the 0B file

Upvotes: 2

Views: 1199

Answers (1)

Sivaprasanna Sethuraman
Sivaprasanna Sethuraman

Reputation: 4132

As mentioned in the comments, instead of downloading the actual file, you might have downloaded the Block Blob file which is an Azure's implementation to handle and provide FileSystem like access when the blob storage is being used as a filesystem (Azure HDInsight clusters have their HDFS backed with Azure Blob Storage). Object storage like Azure Blob Storage and AWS S3 have these sort of custom implementation to provide (or simulate) a seamless filesystem like experience.

In short, don't download the Block Blob. Download the actual files.

Upvotes: 2

Related Questions