Using Selenium with Python to parse table data

Question


    
    
        
        #
        
            Title
        
            Solution
        
            Acceptance
        
            Difficulty
        Frequency
             
    
    
    
    
        
        1
        
            Two Sum    
        
        
        44.2%
        Easy
        
    
    
        
        2
        
            Add Two Numbers    
        
        
        31.2%
        Medium

The HTML above represents the two rows shown in the image. I want to iterate through the table row and print out the Title (Two Sum and Add Two Numbers) using Selenium with Python.

However, the table structure is too complicated and I am not sure how to make a generalized function that might work for a bigger table with more rows.

Any help?

KunduK · Accepted Answer

If you use selenium and following xpath it will return all cells under rows from table body.

//table[@class='table table-striped']/tbody[@class='reactable-data']//tr//td

However you need to find out the cell index to find particular text or particular tag inside cell.

(Two Sum Add Two Numbers)

in this case your xpath should be

//table[@class='table table-striped']/tbody[@class='reactable-data']//tr//td[3]//a

To handle dynamic element it always good to induce WebdriverWait

Here is your complete code.

from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

driver=webdriver.Chrome(executable_path='path/to/chromedriver')
driver.get("url")
elements=WebDriverWait(driver,20).until(EC.visibility_of_all_elements_located((By.XPATH,"  //table[@class='table table-striped']/tbody[@class='reactable-data']//tr//td[3]//a")))
for ele in elements:
    print(ele.text)

Output will be printed on console.

Two Sum
Add Two Numbers

Using Selenium with Python to parse table data

Answers (1)

Output will be printed on console.

Related Questions