CODEWITHSUNDEEP
hadoophdfsparquet
lightweight
lightweight

Reputation: 3337

parquet version used to write a file

is there a way to find out what parquet version was used to write a parquet file in HDFS? I'm trying to see if various files were written using the same parquet version or different versions.

Upvotes: 7

Views: 6024

Answers (2)

Tectrendz
Tectrendz

Reputation: 1454

Other option using parquet-tools

parquet-tools meta --debug file.parquet

Upvotes: 2

Jimmy Da
Jimmy Da

Reputation: 109

$ hadoop jar parquet-tools-1.9.0.jar meta my-parquet-file.parquet |grep "parquet-mr version"

creator:                     parquet-mr version 1.8.1 (build 4aba4dae7bb0d4edbcf7923ae1339f28fd3f7fcf)

Upvotes: 2

Related Questions