CODEWITHSUNDEEP
pythonpandasdataframepickle
cdub
cdub

Reputation: 410

Read Specific Columns from a pickle files

So I know in Pandas, you can specific what columns to pull from a csv file to generate a DataFrame

df = pd.read_csv('data.csv', usecols=['a','b','c'])

How do you do this with a pickled file?

df = pd.read_pickle('data.pkl', usecols=['a','b','c'])

gives TypeError: read_pickle() got an unexpected keyword argument 'usecols'

I cant find the correct argument in the documentation

Upvotes: 1

Views: 11493

Answers (1)

Max Kaha
Max Kaha

Reputation: 922

Since pickle files contain complete python objects I doubt you can select columns whilst loading them or atleast it seems pandas doesnt support that directly. But you can first load it completely and then filter for your columns as such:

df = pd.read_pickle('data.pkl')
df = df.filter(['a', 'b', 'c'])

Documentation

Upvotes: 3

Related Questions