java find table using jsoup and equivalent xpath

Question

Here is the HTML code:


And here is the xpath to get the table:
//td[text() = 'TestSet URL']/ancestor::table[1]
How can I get this table using jSoup?  I've tried:
tableElements = doc.select("td:contains('TestSet URL')");
to get the child element, but that doesn't work and returns null.  I need to find the table and put all the children into a map.  Any help would be greatly appreciated!

    
        
            Batch ID d32654464bdb424396f6a91f2af29ecf
        
        
            ALM Server
            
        
        
            ALM Domain/Project
            EBUSINESS/STERLING
        
        
            TestSet URL
            almtestset://localhost
        
        
            Tests Executed
            6
        
        
            Start Time
            08/31/2017 12:20:46 PM
        
        
            Finish Time
            08/31/2017 02:31:46 PM
        
        
            Total Duration
            2h 11m 
        
        
            Test Parameters
            {"browser":"chrome","browser-version":"56","language":"english","country":"US"}
        
        
            Passed
            0
        
        
            Failed
            6
        
        
            Not Completed
            0
        
        
            Test Pass %
            0.0%

glytching · Accepted Answer

The following code will parse your table into a map, this code is subject to a few assumptions:

This xpath //td[text() = 'TestSet URL']/ancestor::table[1] will find any table which contains the text "TestSet URL" anywhere in its body, this seems a little bit brittle but assuming it is sufficient for you the JSoup code in getTable() is functionally equiavalent to that xpath
The code below assumes that every row contains two cells with the first one being the key and the second one being the value, since you want to parse the table content to a map this assumption seems valid
The code below throws exceptions if the above assumptions are not met i.e. if the given HTML does not contain a table definition with "TestSet URL" embedded in its body or if there are more than two cells in any row within that table.

If those assumptions are invalid then the internals of getTable and parseTable will change but the general approach will remain valid.

public void parseTable() {
    Document doc = Jsoup.parse(html);

    // declare a holder to contain the 'mapped rows', this is a map based on the assumption that every row represents a discreet key:value pair
    Map asMap = new HashMap<>();
    Element table = getTable(doc);

    // now walk though the rows creating a map for each one
    Elements rows = table.select("tr");
    for (int i = 0; i < rows.size(); i++) {
        Element row = rows.get(i);
        Elements cols = row.select("td");

        // expecting this table to consist of key:value pairs where the first cell is the key and the second cell is the value
        if (cols.size() == 2) {
            asMap.put(cols.get(0).text(), cols.get(1).text());
        } else {
            throw new RuntimeException(String.format("Cannot parse the table row: %s to a key:value pair because it contains %s cells!", row.text(), cols.size()));
        }
    }
    System.out.println(asMap);
}

private Element getTable(Document doc) {
    Elements tables = doc.select("table");
    for (int i = 0; i < tables.size(); i++) {
        // this xpath //td[text() = 'TestSet URL']/ancestor::table[1] will find the first table which contains the
        // text "TestSet URL" anywhere in its body
        // this crude evaluation is the JSoup equivalent of that xpath
        if (tables.get(i).text().contains("TestSet URL")) {
            return tables.get(i);
        }
    }
    throw new RuntimeException("Cannot find a table element which contains 'TestSet URL'!");
}

For the HTML posted in your question, the above code will output:

{Finish Time=08/31/2017 02:31:46 PM, Passed=0, Test Parameters={"browser":"chrome","browser-version":"56","language":"english","country":"US"}, TestSet URL=almtestset://localhost, Failed=6, Test Pass %=0.0%, Not Completed=0, Start Time=08/31/2017 12:20:46 PM, Total Duration=2h 11m, Tests Executed=6, ALM Domain/Project=EBUSINESS/STERLING, Batch ID=d32654464bdb424396f6a91f2af29ecf, ALM Server=}

java find table using jsoup and equivalent xpath

Answers (2)

Related Questions