Page 1 of 1

Web Scraping

Posted: Fri Nov 16, 2012 9:51 pm
by Eternal
If you're new to web scraping, I have simple examples that scrape Yahoo stock prices written in Ruby, Python and Perl.

https://github.com/galizur/scrapers

I don't normally make any sports data scrapers public because I don't want people hammering servers that I care about.

-Chris

Re: Web Scraping

Posted: Sun Dec 16, 2012 9:47 pm
by JohnHasADHD
Scraping ESPN.com for their NBA box score, play by play, and shot files really doesn't hammer their servers too much if you're doing it every day, takes very little time to get a days worth of games, and I'm assuming if you add the gameflow it won't take much more as it's a small xml file

For me - I scrape the data into files on my own computer and parse them on my own time