Reputation: 1
Hi I am trying to scrape a website using selenium after sometime the website blocks my ip for scraping and a pop up message appears.
What i want to do is that whenever that pop up message appear it displays a warning on my terminal, My code looks like this to get the result
blo = driver.find_element_by_xpath('/html/body/div[2]/div/div/div[1]/h3')
if blo:
print('ip blocked')
else:
print('eroor')
But its not working i just get a blank screen, How can i solve this
HTML of the element:
<h3 class="modal-title">Notifications</h3>
<div class="alert alert-warning">Sorry, you have exceeded the maximum number of queries allowed per day. If you believe you have reached this message in error, please contact our support team.</div>
Upvotes: 0
Views: 201
Reputation: 193188
The validate the presence of the pop up message you have to induce WebDriverWait for the visibility_of_element_located()
and you can use either of the following Locator Strategies:
Using CSS_SELECTOR
:
try:
WebDriverWait(driver, 20).until(EC.visibility_of_element_located((By.XPATH, "h3.modal-title+div.alert.alert-warning")))
print("ip blocked")
except TimeoutException:
print("eroor")
Using XPATH
:
try:
WebDriverWait(driver, 20).until(EC.visibility_of_element_located((By.XPATH, "//h3[@class='modal-title' and text()='Notifications']//following::div[@class='alert alert-warning']")))
print("ip blocked")
except TimeoutException:
print("eroor")
Upvotes: 2