CODEWITHSUNDEEP
pythondjango
avramov
avramov

Reputation: 2114

Django: unicode string gets written to database as non-unicode

I have written a basic script that imports several thousand values into a Django database. Here's how it looks like: link.

Those locations are in Cyrillic letters, and are represented as unicode literals. However, as soon as I save them to the database, they are converted to what seems to be encoded simple strings, in some sort of hex encoding:

>>> Region.objects.all()[0].parent
'\xd0\xbe\xd0\xb1\xd0\xbb\xd0\xb0\xd1\x81\xd1\x82 \xd0\xa1\xd0\xbb\xd0\xb8\xd0\xb2\xd0\xb5\xd0\xbd'

Surprisingly, they appear correctly in the admin panel, but I have trouble when trying to use them. How do I store and retrieve them as unicode?

I'm running Django 1.4.0 on top of MySQL, collation set to utf8_bin.

Upvotes: 0

Views: 543

Answers (2)

lqc
lqc

Reputation: 7328

This is a Django/MySQL "bug". See issue #16052. It's actually documented here.

Upvotes: 1

Mark Ransom
Mark Ransom

Reputation: 308111

It looks like the data is being returned as a UTF-8 byte string rather than a Unicode string. Try decoding it:

>>> x='\xd0\xbe\xd0\xb1\xd0\xbb\xd0\xb0\xd1\x81\xd1\x82 \xd0\xa1\xd0\xbb\xd0\xb8\xd0\xb2\xd0\xb5\xd0\xbd'
>>> x.decode('utf-8')
u'\u043e\u0431\u043b\u0430\u0441\u0442 \u0421\u043b\u0438\u0432\u0435\u043d'
>>> print x.decode('utf-8')
област Сливен

Upvotes: 1

Related Questions