Python and BeautifulSoup: extracting scores from Livescore.com

Today’s entrance is a suggestion from a reader. He want to extract the info of the score from LiveScore.com.

Using a config file

To increase customization, let’s create an ini file where you write key: URL as value, like this:

[livescore]
champ=http://www.livescore.com/soccer/champions-league/
spain=http://livescore.com/spain

I have write only two URL, but you can add what you need, of course!

Python’s code

The basis of the code are:

• Read the URL from a config file (using the class ini2url)
• Download the HTML code
• Extract the score of the matches
• Show results

Tha idea behind the config file is the ability to work with more that one URL. That’s the way I sometimes solve a problem, and I have included it on this script. If you don’t like it, just modify the code

I have created a class to deal with everything, but it’s able to you to increase functionality if you need it. The aspect of the web is:

I run the script, having this result:

The code is available on GitHub, but you can modify it, for example, creating a database to store the evolution of matches.

The full code:

# coding: utf-8
__author__ = 'dtrillo'

import bs4

HTML = ".html"
miVersion = "SEF LiveScore - Version 0.5.0 - 20140403"
iniurl = "url.ini"

# contenedores = [ "td", "td", "td" ]
# conte_clases = [ "fh", "fa", "fs" ]</pre>
contenedores = [ "div", "div", "div" ]
conte_clases = [ "ply tright name", "ply name", "sco"]

class LiveScore():
""" Tratamiento de URL de BetFair """
def __init__(self, misclaves, misvalores):
self.partidos = []
self.misclaves = misclaves
self.misvalores = misvalores
self.dw = Downloading('')
for k in range(0, len(misclaves)):
url = misvalores[k]
html = self.descarga(url)
self.ejecuta(html)
def descarga(self, surl):
data, error = self.dw.gethtml(surl,'')
return data
def ejecuta(self, data):
#data = clases.SEFcomun.readFile(fich)
soup = bs4.BeautifulSoup(data)
locales = soup.findAll(contenedores[0], { "class" : conte_clases[0] })
visitantes = soup.findAll(contenedores[1], { "class" : conte_clases[1] })
marcador = soup.findAll(contenedores[2], { "class" : conte_clases[2] })

for tr in range(0, len(locales)):
print locales[tr].text + " = " + visitantes[tr].text + " -> " + marcador[tr].text
pt = partidosWeb(locales[tr].text, visitantes[tr].text, marcador[tr].text)
self.partidos.append(pt)

def listadoPartidos(self):
for p in self.partidos:
print p

class ini2urls():
""" Recupera de ficheros INI el listado de URL a procesar """
def __init__(self, fichero, numseccion = 0):
self.fichero = fichero
self.config = ConfigParser.RawConfigParser()
self.config.read(self.fichero)
self.secciones = self.config.sections()
self.error = True if len(self.secciones) == 0 else False
self.seccion = self.secciones[numseccion] if self.error == False else ''
self.misclaves = []
self.misvalores = []
self.dicc = ()
if self.error: print("ERROR - Fichero INI no es el esperado!")
if self.error == False:
self.misclaves = self.config.options(self.seccion)
for k in self.misclaves:
tmp = self.config.get(self.seccion,k)
self.misvalores.append(tmp)
#self.dicc = tmp
def claves_valores(self):
return  self.misclaves, self.misvalores
#def dicc(self):
#    return self.dicc
def listado(self):
""" Listado de URL recuperadas """
for i in range(0, len(self.misclaves)):
print (self.misclaves[i] + " - " + self.misvalores[i])

if __name__ == '__main__':
print miVersion
listadoURLs = ini2urls(iniurl,0)    # Lectura de URL desde fichero de INICIO
keys, vlr = listadoURLs.claves_valores()  # Claves y valores

listadoURLs.listado()
ls = LiveScore(keys, vlr)
ls.listadoPartidos()

Have a nice day!