Extracting link text from HTML Table in python selenium

Question

I'm new to selenium. I wanted to extract the link text from the HTML table from the following HTML code of the website.

Code Snippet:

For the above snippet I wrote the following code in selenium:

from selenium import webdriver
from selenium.webdriver.common.by import By

option = webdriver.ChromeOptions()
option.add_argument("--incognito")
option.add_argument("--start-maximized")

chrome_path = r"C:\Users\singh\Downloads\chromedriver_win32\chromedriver.exe"
browser = webdriver.Chrome(chrome_path, options=option)
browser.get("https://timesofindia.indiatimes.com/archive/year-2010,month-1.cms")
browser.implicitly_wait(10)

num = []
numbers = browser.find_elements(By.XPATH, "//table[@class = 'calender']/tbody/tr/td/a[@href]")

for n in numbers:
    number = n.text
    num.append(number)

Expected Output:

num = ['S', 'M', 'T', 'W', 'T', 'F', 'S', '1', '2', '3', '4', '5', '6', '7', '8', '9', '10', '11', '12', '13', '14', '15', '16', '17', '18', '19', '20', '21', '22', '23', '24', '25', '26', '27', '28', '29', '30', '31']

The program is returning both num and numbers lists as empty lists.

I know something's not correct in the XPath entered in the code. But I'm not able to figure out what is the error.

OS: Windows 10 x64
Python IDE: Anaconda Spyder
Python Version: 3.6

Guy · Accepted Answer

There are two problems

1.calender is id, not class.

2.To get the href you need to use get_attribute, not text

numbers = browser.find_elements(By.XPATH, '//table[@id="calender"]//a')

for n in numbers:
    number = n.get_attribute('href')
    num.append(number)

Extracting link text from HTML Table in python selenium

Answers (1)

Related Questions