CODEWITHSUNDEEP
python-2.7pandasdataframe
BKS
BKS

Reputation: 2333

Dataframe encoding

Is there a way to encode the index of my dataframe? I have a dataframe where the index is the name of international conferences.

df2= pd.DataFrame(index=df_conf['Conference'], columns=['Citation1991','Citation1992'])

I keep getting: KeyError: 'Leitf\xc3\xa4den der angewandten Informatik'

whenever my code references a foreign conference name with unknown ascii letters.

I tried:

df.at[x.encode("utf-8"), 'col1']

df.at[x.encode('ascii', 'ignore'), 'col']

Is there a way around it? I tried to see if I could encode the dataframe itself when creating it, but it doesn't seem I can do that either.

Upvotes: 11

Views: 101246

Answers (3)

Marcel Kim
Marcel Kim

Reputation: 91

Just put "u" in front of utf8 strings such that

df2= pd.DataFrame(index=df_conf[u'Conference'], columns=[u'Citation1991',u'Citation1992'])

It will work.

Upvotes: 2

BKS
BKS

Reputation: 2333

If you're not using csv, and you want to encode your string index, this is what worked for me:

df.index = df.index.str.encode('utf-8')

Upvotes: 17

Guillaume Jacquenot
Guillaume Jacquenot

Reputation: 11707

Setting up the encoding should be treated when reading the input file, using the option encoding

df = pd.read_csv('bibliography.csv', delimiter=',', encoding="utf-8")

or if the file uses BOM,

df = pd.read_csv('bibliography.csv', delimiter=',', encoding="utf-8-sig")

Upvotes: 11

Related Questions