CODEWITHSUNDEEP
javahtml
user1019083
user1019083

Reputation: 381

Extract HTML content from a webpage using java

I am trying to extract HTML content of a webpage using JAVA. But the problem is the page which I am trying to load, keeps expanding if the user scrolls down. So my code is able to extract only whatever the page loads at first time. How do i extract the remaining part of the HTML code which is generated usually when the user scrolls down.

Upvotes: 2

Views: 278

Answers (1)

dm03514
dm03514

Reputation: 55932

Open up firebug or chrome developer tools. Look at the network tab. When you scroll down an ajax call will be made. Note this url and the params. YOu will manually have to make the call to the appropriate url (the ajax url) and parse the response which may or may not be html.

Upvotes: 3

Related Questions