CODEWITHSUNDEEP
python-3.xpyarrow
jay
jay

Reputation: 1463

to_pandas() got an unexpected keyword argument

I am trying to convert a parquet table to pandas data frame, and to avoid memory doubling as per the documentation(enter link description here), I used following code;

df = table.to_pandas(split_blocks=True, self_destruct=True)

But I am getting following error;

TypeError: to_pandas() got an unexpected keyword argument 'split_blocks'

Right now I have the pyarrow version 0.15.1 installed. When I run the code Conda update pyarrow I get the message, required packages are installed.

May I know how can this error be remedied. Thanks in advance.

Upvotes: 0

Views: 6369

Answers (1)

0x26res
0x26res

Reputation: 13932

Version 0.15.1 support fewer options than the latest version. You can see the options here. If you are worried about memory you can try to pass zero_copy=True.

I'm not an expert in conda, but have you tried conda install pyarrow=1.0.1

Upvotes: 0

Related Questions