CODEWITHSUNDEEP
javascriptgoogle-apps-script
snoop31
snoop31

Reputation: 91

UrlFetchApp.fetch - missing code of webpage. How to get full code?

I'm trying to get data from this webpage:

http://www.gymboree.com/shop/dept_item.jsp?PRODUCT%3C%3Eprd_id=845524446027540&FOLDER%3C%3Efolder_id=2534374305278637&ASSORTMENT%3C%3East_id=1408474395917465&bmUID=1363035275064&productSizeSelected=0&fit_type=

by UrlFetchApp.fetch(url).getContentText() but I don't get all the data from the page:

UrlFetchApp.fetch(url).getContentText() give me: 

<ul id=""size-options-ul"" class=""size-options""> <!-- AJAX DATA -->

but within this directory have an extra code (I click in Google Chrome, right-click on the page, then Inspect Element. Chrome gives me all the code of this page)

<ul id="size-options-ul" class="size-options"><li id="1689949376460861_0" title="0-3 mos"><a href="javascript:DoSmth()" title="0-3 mos"><span>0-3 mos</span></a></li><li id="1689949376460862_1" title="3-6 mos" class=""><a href="javascript:DoSmth()" title="3-6 mos"><span>3-6 mos</span></a></li><li id="1689949376460864_2" title="6-12 mos" class="selected"><a href="javascript:DoSmth()" title="6-12 mos"><span>6-12 mos</span></a></li><li id="1689949376460865_3" title="12-18 mos" class=""><a href="javascript:DoSmth()" title="12-18 mos"><span>12-18 mos</span></a></li><li id="1689949376460866_4" title="18-24 mos"><a href="javascript:DoSmth()" title="18-24 mos"><span>18-24 mos</span></a></li></ul>

How can i get full code? maybe some arguments of UrlFetch can do it? I think this page dynamically generated via Javascript... but somehow Chrome takes all the data from the page and the script maybe possible.

Thanks! Ivan.

Upvotes: 1

Views: 829

Answers (1)

Brian
Brian

Reputation: 423

Apps Script's UrlFetchApp does not interprets anything, as it does make a HTTP request and return just a response from server.

But Chrome interprets the JavaScript after the page loads and inserts the results in the DOM (so you can view the current state in Inspect Element).

You need to use tools that can "interpret" the JavaScript See these links

Upvotes: 0

Related Questions