cdub
cdub

Reputation: 25701

Writing a Parquet.Net file using RLE_DICTIONARY encoding

The Parquet.Net specification says I can read and write in RLE_DICTIONARY encoding. I am trying to read the docs of Parquet.Net and the github repo code, but how do I write my DataTable to use this encoding?

The demo I am basing this off of is found here:

Stack Overflow Parquet Size Discrepancy Question

Upvotes: 0

Views: 897

Answers (1)

SummersKing
SummersKing

Reputation: 331

I'm finding this answer either, I just found an answer like this: if you are using spark just write DataFrame with

df.write
.option("parquet.enable.dictionary",true) //true is RLE_DICTIONARY and false plain (maybe)
.parquet(yourPath)

Upvotes: -1

Related Questions