CODEWITHSUNDEEP
python-2.7seleniumweb-scrapingweb-crawler
Emile
Emile

Reputation: 197

Web crawler: web content does not show up in html code

I am doing a basic web crawler work for this web page (just for study purpose, and I have got their permission):

http://www.seattle.gov/council/calendar#/?i=0

What I wanted to do is to get all the events' "Time", "Description" and "Location" in that form. I have tried python regular expression however it looks like these information does not show up in the HTML code of this page. Instead, I am using a Selenium, but I still don't know where to find this information.

Upvotes: 2

Views: 76

Answers (1)

Andrés Pérez-Albela H.
Andrés Pérez-Albela H.

Reputation: 4021

Sometimes, things are in front of you but you don't see them.

You can fetch/extract that data from their RSS Feed. It's here: http://www.trumba.com/calendars/seattle-city-council.rss

Hope this helps.

Upvotes: 1

Related Questions