CODEWITHSUNDEEP
htmlparsingcurlhtml-parsingwget
xBlue
xBlue

Reputation: 673

wget, curl, html parsers fail to get correct html

I'm trying to parse this link

http://www.sears.com/search=play%20station?pageNum=1&viewType=list

If I open the website in my browser it works perfectly. However, none of parsers seems to work (trying jsoup). Also, I tried doing a curl and wget to the url and the output is not correct either.

I tried to check if the website actually redirects (301, 302) but apparently it does not.

Does anyone have any idea what I may be doing wrong?

Upvotes: 0

Views: 422

Answers (1)

singpolyma
singpolyma

Reputation: 11241

It's doing a JavaScript redirect to http://www.sears.com/search=play%20station?storeId=10153&catalogId=12605&vName=Movies+Music+%26+Gaming&viewItems=25&viewType=list&autoRedirect=true&redirectType=CAT_REC_PRED&intShip=3&intlDelivery=3 which you can grab with cURL just fine :)

Upvotes: 1

Related Questions