Scrape data in JS Pop Up Python

Question

I want to know that can we scrape data of a specific field from a pop up generated on a page using Python ? If yes, please suggest.

I am trying to scrape it, but it is not getting detected and return me an empty list. I am using Python and Beautiful soup to do the job .

Answer 1

You can not use scrapy for JS

You can also solve it with ScrapyJS :

This library provides Scrapy+JavaScript integration using Splash.

Follow the installation instructions for Splash and ScrapyJS, READ the answer here

OR

You can use Selenium:

Follow the installation instructions Selenium Doc