StackOverflow Questions for Tag: fastparquet

Alex Pilafian
Alex Pilafian

Reputation: 181

Can a parquet file exceed 2.1GB?

Score: 2

Views: 1232

Answers: 1

Read More
moonhouse
moonhouse

Reputation: 620

Does any Python library support writing arrays of structs to Parquet files?

Score: 21

Views: 5087

Answers: 1

Read More
qxzsilver
qxzsilver

Reputation: 655

How to open huge parquet file using Pandas without enough RAM

Score: 12

Views: 21577

Answers: 3

Read More
Beatriz Campos
Beatriz Campos

Reputation: 31

Failed to install pyarrow and fastparquet

Score: 3

Views: 3383

Answers: 0

Read More
James Kelleher
James Kelleher

Reputation: 2147

What is the least memory-intensive way to read a Parquet file in Python? Is line-by-line possible?

Score: 1

Views: 1077

Answers: 1

Read More
Stephan Claus
Stephan Claus

Reputation: 475

Write nested parquet format from Python

Score: 6

Views: 5005

Answers: 1

Read More
Areza
Areza

Reputation: 6080

"ArrowInvalid: Can't unify schema with duplicate field names" read parquet files from s3 using dask;

Score: 1

Views: 1144

Answers: 1

Read More
balderman
balderman

Reputation: 23825

Reading parquet file from AWS S3 using pandas

Score: 2

Views: 13182

Answers: 2

Read More
Tim
Tim

Reputation: 263

Why does pandas.to_parquet need so much RAM?

Score: 4

Views: 995

Answers: 0

Read More
Sohan Bansal
Sohan Bansal

Reputation: 1

Error installing truefoundry experiment tracking library (pip install mlfoundry)

Score: 0

Views: 274

Answers: 1

Read More
Harry
Harry

Reputation: 451

Error reported when saving dataframe with date as object into a parquet file

Score: 0

Views: 670

Answers: 0

Read More
stormfield
stormfield

Reputation: 1758

How to read partitioned parquet files from S3 using pyarrow in python

Score: 67

Views: 119377

Answers: 5

Read More
Salahddin-Warid
Salahddin-Warid

Reputation: 115

Insert data into a snowflake table from sqlachemy

Score: 0

Views: 190

Answers: 0

Read More
linux
linux

Reputation: 157

No such file or directory : fastparquet.llibs\\.load_order

Score: 1

Views: 357

Answers: 0

Read More
Dulshan
Dulshan

Reputation: 43

fastparquet error when saving pandas df to parquet: AttributeError: module 'fastparquet.parquet_thrift' has no attribute 'SchemaElement

Score: 1

Views: 3135

Answers: 1

Read More
prasannads
prasannads

Reputation: 659

Pandas dataframe type datetime64[ns] is not working in Hive/Athena

Score: 13

Views: 9416

Answers: 6

Read More
Vineel
Vineel

Reputation: 45

AttributeError: 'numpy.ndarray' object has no attribute '_ndarray' while reading parquet files in pandas

Score: 1

Views: 608

Answers: 0

Read More
Alex
Alex

Reputation: 460

Read parquet file using pd.read_parquet looking for a schema

Score: 1

Views: 1346

Answers: 1

Read More
Arun
Arun

Reputation: 41

while creating a parquet file using dask (fastparquet) with an append option the first partitions file were missing from the folder

Score: 1

Views: 386

Answers: 0

Read More
veg2020
veg2020

Reputation: 1020

unable to export dataframe due to overflow error: Python int too large to convert to C long

Score: 4

Views: 805

Answers: 0

Read More
PreviousPage 3Next