CODEWITHSUNDEEP
pythonwebweb-scraping
qorka
qorka

Reputation: 114

Web scraping cnbc.com

I am trying to scrape this page with bs4 and I was wondering how can I scrape the EUR/USD, price change, and price % ?

I am pretty new to this, so this is all I have so far:

import requests
from bs4 import BeautifulSoup

url = 'http://www.cnbc.com/pre-markets/'
source_code = requests.get(url).text
soup = BeautifulSoup(source_code, 'lxml')

for r in soup.find_all('td', {'class': 'first text'}):
    print(r)

Upvotes: 0

Views: 1749

Answers (1)

Tomark
Tomark

Reputation: 369

The data you're looking for are probably loaded with javaScript and therefore you can't see them with bs4. But you can do it using an headless browser like PhantomJS, Selenium or Splash. See also this response: scraping dynamic updates of temperature sensor data from a website

Upvotes: 2

Related Questions