CODEWITHSUNDEEP
pythonparsingbeautifulsoup
wip
wip

Reputation: 17

Issue parsing a number on webpage via BeautifulSoup

I would like to parse a number from this website dashboard. The number is located beneath "Organic Search"

Using a simple cmd-F on the soup, I eventually realized that my soup doesn't contain this number at all. It would be great to hear suggestions on why this is.

Upvotes: 0

Views: 55

Answers (1)

宏杰李
宏杰李

Reputation: 12168

This page is rendered by JavaScrip, the response will be:

enter image description here

the real data is in this url:

import requests

r = requests.get('https://us.backend.semrush.com/?key=adb79c4ec6282f461fb0e2e67aa50949&action=report&type=url_organic&currency=usd&url=https%3A%2F%2Fwww.yelp.com%2Fbiz%2Fplayground-2-0-santa-ana-3&_=1486008342774')
data = r.json()
data['organic']['traffic']

Upvotes: 1

Related Questions