CODEWITHSUNDEEP
python
daniel
daniel

Reputation: 2626

Is the builtin hash method of Python2.6 stable across architectures?

I need to compute a hash that needs to be stable across architectures. Is python's hash() stable?

To be more specific, the example below shows hash() computing the same value on two different hosts/architectures:

# on OSX based laptop
>>> hash((1,2,3,4))
485696759010151909
# on x86_64 Linux host
>>> hash((1,2,3,4))
485696759010151909

The above is true for at least those inputs, but my question is for the general case

Upvotes: 15

Views: 4764

Answers (4)

Eli Collins
Eli Collins

Reputation: 8543

The hash() function is not what you want; finding a reliable way to serialize the object (eg str() or repr()) and running it through hashlib.md5() would probably be much more preferrable.

In detail - hash() is designed to return an integer which uniquely identifies an object only within it's lifetime. Once the program is run again, constructing a new object may in fact have a different hash. Destroying an object means there's a chance another object will have that hash in the future. See python's definition of hashable for more.

Behind the scenes, most user-defined python objects fall back to id() to provide their hash value. While you're not supposed to make use of this, id(obj) and thus hash(obj) is usually implemented (eg in CPython) as the memory address of the underlying Python object. Thus you can see why it can't be relied on for anything.

The behavior you currently see is only reliable for certain builtin python objects, and that not very far. hash({}) for instance is not possible.

Regarding hashlib.md5(str(obj)) or equivalent - you'll need to make sure str(obj) is reliably the same. In particular, if you have a dictionary being rendering within that string, it may not list it's keys in the same order. There may also be subtle differences between python versions... I would definitely recommend unittests for any implementation you rely on.

Upvotes: 9

Mr_Pink
Mr_Pink

Reputation: 109442

No.

x86_64
>>> print hash("a")
12416037344

i386
>>> print hash("a")
-468864544

If you need a stable hash, create a digest of your data using something like sha1, which can be found in hashlib

Upvotes: 6

nmichaels
nmichaels

Reputation: 51029

If you need a well defined hash, you can use one out of hashlib.

Upvotes: 12

jehuelsm
jehuelsm

Reputation: 103

No. On ARM with python 2.6:

>>> hash((1,2,3,4))

89902565

Upvotes: 5

Related Questions