Extracting rows from a table

Question

I'm trying to extract rows with their corresponding cells from the following table:


The rows I'm interested in are the ones with A, B, C, and so on with numbers next to them.
The solution I came up with is:
table = tree.xpath("//table/tr[td[not(contains(@class, 'white'))]]")

for tr in table:
    print( tr.xpath('td/text()'))
However, the output still includes the first row with the empty cell and Last Day/Week ones, and looks like this:
['', 'Last Day', 'Last Week']
['A', '0', '3', '0', '13']
['B', '0', '0', '2', '0']
['C', '0', '3', '0', '5']
What can be done to get rid of it?


    
    Last Day
    Last Week


    Race
    Killed Players
    Killed by Players
    Killed Players
    Killed by Players


    A
    0
    3
    0
    13


    B
    0
    0
    0
    7


    C
    0
    0
    0
    1


    D
    0
    0
    0
    7


    Total
    210
    1060458
    1132
    5585115

Andr&#233;s P&#233;rez-Albela H. · Accepted Answer

Just change tr to be:

tr[not(contains(@bgcolor, "505050"))]

So your code should look like this:

from lxml import html

HTML = """"""

tree = html.fromstring(HTML)
results = defaultdict

for item in tree.xpath('//table/tr[not(contains(@bgcolor, "505050"))]'):
    print item.xpath('.//td/text()')
And the output:
['A', '0', '3', '0', '13']
['B', '0', '0', '0', '7']
['C', '0', '0', '0', '1']
['D', '0', '0', '0', '7']
Still, I would recommend to use a dict(). See:
tree = html.fromstring(HTML)
results = dict()

def unpack(data):
    return data[0], data[1:]

for item in tree.xpath('//table/tr[not(contains(@bgcolor, "505050"))]'):
    key, values = unpack(item.xpath('.//td/text()'))
    results[key] = values

print results
Output:
{
    'A': ['0', '3', '0', '13'],
    'C': ['0', '0', '0', '1'],
    'B': ['0', '0', '0', '7'],
    'D': ['0', '0', '0', '7']
}

  In Python 3, there is not need to have a unpack() function like the above one,  you would just need to change
   key, values = unpack(item.xpath('.//td/text()')) to key, *values = item.xpath('.//td/text()')
See: https://www.python.org/dev/peps/pep-3132/
Also, if you want, you can sort results by letter (key) using sorted():
[
  ('A', ['0', '3', '0', '13']),
  ('B', ['0', '0', '0', '7']),
  ('C', ['0', '0', '0', '1']),
  ('D', ['0', '0', '0', '7'])
]


    
    Last Day
    Last Week


    Race
    Killed Players
    Killed by Players
    Killed Players
    Killed by Players


    A
    0
    3
    0
    13


    B
    0
    0
    0
    7


    C
    0
    0
    0
    1


    D
    0
    0
    0
    7


    Total
    210
    1060458
    1132
    5585115

Extracting rows from a table

Answers (1)

Related Questions