Reputation: 321
I have a list of data frames which I reshuffle and then I want to save the output as a csv. To do this I'm trying to append this list to an empty data frame:
l1=[year1, year2,..., year30]
shuffle (l1)
columns=['year', 'day', 'tmin', 'tmax', 'pcp']
index=np.arange(10957)
df2=pd.DataFrame(columns=columns, index=index)
l1.append(df2)
This result in an empty data frames with a bunch of Nans. I don't necessarily need to append my reshuffled list to a dataframe, I just need to save it as a csv, and this is the only way I find yet.
Upvotes: 5
Views: 20117
Reputation: 942
An alternative to the chosen answer is to open the CSV and append one dataframe at a time inside a loop. This can be order of magnitude faster depending on the size of data.
f = open(filename, 'a')
for df in l1:
df.to_csv(f)
f.close()
Upvotes: 4