iterate through a HTML table with names embedding in link tags

Question

I am a beginner in web scraping with Beautiful Soup and I am trying to get the teams with their wins and losses in Euroleague from https://www.basketball-reference.com/international/euroleague/2020.html

I want to iterate through this table and get the name wins and losses and insert them in a CSV a list or JSON file later. With my code below I can get only the HTML of the first element in the table even if I try a for loop :

from bs4 import BeautifulSoup as bs 
import requests 
from requests import get 
import pandas as pd 
import json 
import time 
from time import sleep



url = 'https://www.basketball-reference.com/international/euroleague/2020.html' 

time.sleep(2)
source = requests.get(url).text

time.sleep(4)
soup = bs(source,'lxml')

time.sleep(2)
for item in soup.find_all('div' , class_='table_outer_container'):
    #prints only first item
    team=item.div.table.tbody.tr
    print(team)

The structure of the table element :


      
      
  EuroLeague Standings Table
   
   
      
      
         Regular Season
      
      

      
      
          
         W
         L
      
      
   
   
Anadolu Efes 24 4
Real Madrid 22 6
FC Barcelona 22 6
CSKA Moscow 19 9
Maccabi FOX Tel Aviv 19 9
Panathinaikos OPAP 14 14
Fenerbahçe Beko 13 15
Khimki 13 15
Kirolbet Baskonia 12 16
Olympiacos 12 16
Žalgiris 12 16
Valencia Basket 12 16
AX Armani Exchange Olimpia 12 16
Crvena zvezda mts 11 17
LDLC ASVEL 10 18
Alba Berlin 9 19
Zenit Saint Petersburg 8 20
Bayern Munich 8 20

I would appreciate your help with guiding me to iterate through this element correctly and get the team name, wins, and losses. Thank you in advance.

Philippe Remy · Accepted Answer

Try this:

Code

import requests
from bs4 import BeautifulSoup

url = 'https://www.basketball-reference.com/international/euroleague/2020.html'

soup = BeautifulSoup(requests.get(url).text, 'html.parser')
teams = soup.find('div', class_='table_outer_container')

for team in teams.find_all('a'):
    # prints only first item
    team_name = team.text
    wins = team.parent.parent.find('td', {'data-stat': 'wins|Regular Season'}).text
    losses = team.parent.parent.find('td', {'data-stat': 'losses|Regular Season'}).text
    print(team_name, wins, losses)

Output

Anadolu Efes 24 4
Real Madrid 22 6
FC Barcelona 22 6
CSKA Moscow 19 9
Maccabi FOX Tel Aviv 19 9
Panathinaikos OPAP 14 14
Fenerbahçe Beko 13 15
Khimki 13 15
Kirolbet Baskonia 12 16
Olympiacos 12 16
Žalgiris 12 16
Valencia Basket 12 16
AX Armani Exchange Olimpia 12 16
Crvena zvezda mts 11 17
LDLC ASVEL 10 18
Alba Berlin 9 19
Zenit Saint Petersburg 8 20
Bayern Munich 8 20

iterate through a HTML table with names embedding in link tags

Answers (1)

Related Questions