CODEWITHSUNDEEP
pythonurllib2mechanizeurllib
kairyu
kairyu

Reputation: 27

Python urllib2 parse html problem

I am using mechanize to parse html of website, but with this website i got strange result.

from mechanize import Browser
br = Browser()
r = br.open("http://www.heavenplaza.com")
result = r.read()

result is something which i can not understand. you can see here: http://paste2.org/p/1556077

Anyone can have some method to get that website HTML? with mechanize or urllib.

Thanks

Upvotes: 1

Views: 1025

Answers (2)

ksn
ksn

Reputation: 633

import urllib2, StringIO, gzip
f = urllib2.urlopen("http://www.heavenplaza.com")
data = StringIO.StringIO(f.read())
gzipper = gzip.GzipFile(fileobj=data)
print gzipper.read()

Upvotes: 1

Mikko Ohtamaa
Mikko Ohtamaa

Reputation: 83768

I quickly checked the script in the console and the site was returning crap. You probably need to spoof your HTTP user agent to be something else that the site doesn't think you are using a robot.

http://www.google.com works

Upvotes: 1

Related Questions