rogersmark/mls-api

Django App for the MLS Soccer Stats API I'm playing with

mls-api's Issues

Substitution Event needs to FK to GamePlayers

Right now they FK to Players instead of GamePlayers, and that's poor. Also need to make use of this model in general, but some mls-scraper work needs to be done first. That work is documented here

Put an API in front of all this data

Add option for parser to parse all games in a season

We can easily pull all the links to every game from the Results Map (http://www.mlssoccer.com/results). I have a good list of all of those links, but it'd be nice to not be relying on that random file on my laptop forever.

Deploy the site somewhere

Not much good being just on my machine.

MultipleObjectsReturned when retrieving players in 2012 scrape

For some reason, after parsing 2013's stats, and then parsing 2012 I'm getting MutlipleObjectsReturned errors for players. Lenhart and Gordon seem to be the biggest trouble makers, which seems oddly fitting.

Grab formation information

After the scraper project is properly returning this data, let's pull it in to the database.

The scraper is single threaded right now, this is lame

Need to convert to a celery stack at some point. Won't be super useful until I get this deployed somewhere though.

Urls that fail to parse

Just want to get a thread going for weird/random games that don't parse:

http://www.mlssoccer.com/match/484907/stats - 403. Oddly can't view this in a browser either, looks like a bug on the MLS Soccer side.

http://www.mlssoccer.com/match/484859/stats - Error:

Traceback (most recent call last):
File "/home/mrogers/projects/mls/src/mls-api/mls_api/management/commands/scrape_game.py", line 138, in _parse_game_stats
self.parsed_stats = parser.MLSStatsParser(url, logger=self.logger)
File "/home/mrogers/projects/mls/src/mls-scraper/mls_scraper/parser.py", line 127, in init
self._generate_stats()
File "/home/mrogers/projects/mls/src/mls-scraper/mls_scraper/parser.py", line 32, in _generate_stats
self.get_events()
File "/home/mrogers/projects/mls/src/mls-scraper/mls_scraper/parser.py", line 104, in get_events
self._get_bookings()
File "/home/mrogers/projects/mls/src/mls-scraper/mls_scraper/parser.py", line 471, in _get_bookings
self._parse_booking_dict(x) for x in events
File "/home/mrogers/projects/mls/src/mls-scraper/mls_scraper/parser.py", line 444, in _parse_booking_dict
booking.card_color = booking_dict['card_color']
KeyError: 'card_color'

Add season flag to scraper

Would be nice if you could easily parse 2012 stats

Scraper needs to more intelligently display errors

Right now when doing processing of a large set of stats, it's hard to tell what's going right/wrong.