CODEWITHSUNDEEP
pythonpandaslarge-data
Alexis Eggermont
Alexis Eggermont

Reputation: 8155

Large csv pandas memory error

I'm running exactly the same one line code on two similar machines to read a 1 GB csv file.

dataframe = pd.read_csv('url_here', delimiter='|')

One machine reads it correctly, the other one gives me an empty memory error ("MemoryError:")

Both machines have 8 GB ram and an i7 processor.

What could cause this? Is there a way to increase memory availability for Python?

Thanks!

Upvotes: 1

Views: 2029

Answers (1)

Shravan
Shravan

Reputation: 2723

Try using low_memory=False:

dataframe = pd.read_csv('url_here', delimiter='|', low_memory=False)

Upvotes: 1

Related Questions