CODEWITHSUNDEEP
google-bigquery
user20010203
user20010203

Reputation: 99

Does BigQuery support avro compression or not?

On one documentation here: https://cloud.google.com/bigquery/docs/loading-data-cloud-storage-avro#avro_compression it clearly says avro compression is not supported.

On another documentation here: https://cloud.google.com/bigquery/docs/loading-data#loading_compressed_and_uncompressed_data it says Avro format is preferred for compressed data.

Can someone tell me what this means? I am really confused.

Upvotes: 1

Views: 664

Answers (1)

Xiaoxia Lin
Xiaoxia Lin

Reputation: 746

The documentation in both places only talks about compressed data blocks, which is supported, and they are consistent.

Compressed data blocks means that the data inside the Avro files is compressed. You cannot stick an Avro file inside a zip or gzip container. It's like how PNGs have compression but a gzipped image is not the same thing.

Upvotes: 2

Related Questions