Reputation: 25701
The Parquet.Net
specification says I can read and write in RLE_DICTIONARY
encoding. I am trying to read the docs of Parquet.Net
and the github repo code, but how do I write my DataTable to use this encoding?
The demo I am basing this off of is found here:
Stack Overflow Parquet Size Discrepancy Question
Upvotes: 0
Views: 897
Reputation: 331
I'm finding this answer either, I just found an answer like this: if you are using spark just write DataFrame with
df.write
.option("parquet.enable.dictionary",true) //true is RLE_DICTIONARY and false plain (maybe)
.parquet(yourPath)
Upvotes: -1