CODEWITHSUNDEEP
wget
Mikiku
Mikiku

Reputation: 152

Wget to download html

I have been trying to download an html from http://osu.ppy.sh/u/2330158 to get Historical data but it doesnt download that part. Nor it downloads General, Top Ranks etc

Is there a way to make wget to download it?

Upvotes: 0

Views: 308

Answers (1)

chooban
chooban

Reputation: 9256

That part of the page is loaded dynamically, so wget won't see it as it doesn't support Javascript. However, if you open the web developer tools in your browser of choice and then load the main page you can get the URL which you're really after. For this page, it's: http://osu.ppy.sh/pages/include/profile-history.php?u=2330158&m=0

Luckily, it's another simple, parameterised URL so you can feed that to wget:

wget "http://osu.ppy.sh/pages/include/profile-history.php?u=2330158&m=0"

That'll get you an html document containing just the historic data you're looking for.

Upvotes: 2

Related Questions