Page 1 of 3
Estimating Replacement Level: Sabermetrics perspective
Posted: Tue Jul 29, 2014 12:04 pm
by DSMok1
Most people reading this forum will have already seen this, but I feel it's worth linking to again to make sure.
Tangotiger, one of the leading Sabermetrics experts, has been leading a discussion on his site on how to estimate replacement level for the NBA. He was one of the originators of the whole WAR replacement level concept for baseball, and is an expert on methodologies for estimating replacement level.
The thread is at:
http://tangotiger.com/index.php/site/co ... nba-player
Re: Estimating Replacement Level: Sabermetrics perspective
Posted: Tue Jul 29, 2014 3:13 pm
by colts18
Good post on the topic:
I don’t think that RAPM is good for this type of thing because it regresses low minute (replacement level) players a lot. Maybe someone with RAPM expertise should run an RAPM with the 40 10 day contract players as just 1 variable rather than 40 seperate variables.
That would definitely be an interesting RAPM experiment. Put all the players who signed midseason (10 day, veterans, buyout players, etc.) into 1 variable and see what kind of RAPM they would have.
Re: Estimating Replacement Level: Sabermetrics perspective
Posted: Wed Jul 30, 2014 5:43 am
by talkingpractice
colts18 wrote:That would definitely be an interesting RAPM experiment. Put all the players who signed midseason (10 day, veterans, buyout players, etc.) into 1 variable and see what kind of RAPM they would have.
if someone wants to partner on this, then id be willing to do the rapm part. i just don't want to invest any summertime manhours of my team into researching the list of players (10 day, veterans, buyout players, etc.) over the past x years to then run the model with. but if someone is wiling to think through, and then put together, that list of guys (going back as far as 2006), then we can lump them together into a 'replacement level group' and run it. that part of the job is pretty trivial.
ftr weve done different but similar things, and my guess is still in the -2 to -2.5 or so range.
caveat: ive not read one word of the tango thread (yet), and thus far only know what ive seen about it on twitter (mostly via DSMok1).
Re: Estimating Replacement Level: Sabermetrics perspective
Posted: Wed Jul 30, 2014 11:45 am
by Mike G
If I don't read it here, or find a link from this forum, I probably didn't read it.
Re: Estimating Replacement Level: Sabermetrics perspective
Posted: Wed Jul 30, 2014 2:13 pm
by colts18
talkingpractice wrote:
if someone wants to partner on this, then id be willing to do the rapm part. i just don't want to invest any summertime manhours of my team into researching the list of players (10 day, veterans, buyout players, etc.) over the past x years to then run the model with. but if someone is wiling to think through, and then put together, that list of guys (going back as far as 2006), then we can lump them together into a 'replacement level group' and run it. that part of the job is pretty trivial.
ftr weve done different but similar things, and my guess is still in the -2 to -2.5 or so range.
caveat: ive not read one word of the tango thread (yet), and thus far only know what ive seen about it on twitter (mostly via DSMok1).
I don't have the data for past seasons, but here is a list of the players who were 10 day contract guys this past season. You can try to run a 2014 RAPM on them though I'm not sure if its a big enough sample (7406 total MP), but its a good start.
Drew Gooden
Chris Johnson
Cartier Martin
Jarvis Varnado
Shawne Williams
Dewayne Dedmon
Leandro Barbosa
Hilton Armstrong
Earl Clark
Chris Wright
Jorge Gutierrez
Casper Ware
Jason Collins
Jared Cunningham
Justin Hamilton
Othyus Jeffers
Orlando Johnson
Tony Mitchell
Maalik Wayns
Chris Babb
Seth Curry
Shane Edwards
Manny Harris
Royal Ivey
Damion James
DeAndre Liggins
Darius Morris
Arinze Onuaku
Dexter Pittman
D.J. Stephens
Adonis Thomas
D.J. White
Royce White
Reggie Williams
Vander Blue
Mike James
James Nunnally
Mustafa Shakur
Sasha Vujacic
Darius Johnson-Odom
Shannon Brown
Re: Estimating Replacement Level: Sabermetrics perspective
Posted: Wed Jul 30, 2014 3:12 pm
by Kevin Pelton
Here is a list of minimum-salary players signed either before or during the season (noted as such) from 2008-09 through 2012-13:
https://docs.google.com/spreadsheets/d/ ... xU/pubhtml
Re: Estimating Replacement Level: Sabermetrics perspective
Posted: Wed Jul 30, 2014 4:24 pm
by DSMok1
Excellent, Kevin! Thanks!
Re: Estimating Replacement Level: Sabermetrics perspective
Posted: Wed Jul 30, 2014 4:57 pm
by talkingpractice
Well, that is perfect. I can get this done for us next week. I'll get one of our junior guys to handle any naming discrepancies between this list and our pbp, and then we can run it on the entire 2009-2014 sample (combining the lists from kevin and colts). I'm pretty sure this sample will be large enough to get a useful result.
Re: Estimating Replacement Level: Sabermetrics perspective
Posted: Wed Jul 30, 2014 6:15 pm
by DSMok1
Cross posting from the Tangotiger thread:
Thanks to Kevin Pelton for the list of minimum salary players signed preseason and in season for 2009 through 2013 (5 seasons).
http://www.apbr.org/metrics/viewtopic.p ... 248#p20248
Here are their ASPM ratings, all weighted by minutes played:
Code: Select all
╔═══════════╦═══════╦══════════╦═══════╦════════╦════════╗
║ Type ║ Count ║ Avg %Min ║ ASPM ║ O-ASPM ║ D-ASPM ║
╠═══════════╬═══════╬══════════╬═══════╬════════╬════════╣
║ In-Season ║ 165 ║ 6.9% ║ -2.70 ║ -1.94 ║ -0.76 ║
║ Preseason ║ 266 ║ 16.0% ║ -1.95 ║ -1.67 ║ -0.28 ║
║ Total ║ 431 ║ 12.5% ║ -2.11 ║ -1.73 ║ -0.38 ║
╚═══════════╩═══════╩══════════╩═══════╩════════╩════════╝
Once again, it appears replacement level is somewhere around -2.
Re: Estimating Replacement Level: Sabermetrics perspective
Posted: Wed Jul 30, 2014 6:51 pm
by talkingpractice
what is meant by the Preseason row?
one of my guys already confirmed that there are way less naming discrepancies between these lists and our pbp than i guessed there would be originally, so ill have the rapm version of this back much quicker than i said earlier.
Re: Estimating Replacement Level: Sabermetrics perspective
Posted: Wed Jul 30, 2014 7:18 pm
by DSMok1
talkingpractice wrote:what is meant by the Preseason row?
one of my guys already confirmed that there are way less naming discrepancies between these lists and our pbp than i guessed there would be originally, so ill have the rapm version of this back much quicker than i said earlier.
Signed before the season vs. Signed during the season.
Re: Estimating Replacement Level: Sabermetrics perspective
Posted: Wed Jul 30, 2014 11:53 pm
by talkingpractice
aaaaaaaaaaaahhhhhhhh, of course. im a bozo.
Re: Estimating Replacement Level: Sabermetrics perspective
Posted: Thu Jul 31, 2014 12:29 pm
by DSMok1
talkingpractice wrote:aaaaaaaaaaaahhhhhhhh, of course. im a bozo.
No you're not...
Someone on the Tangotiger thread noted that replacement level players are different before the season than during the season. Before the season, the available players will be better. During the season, most of the replacement level players will be in Europe playing, and the available players will not likely be as good.
One of the reasons for the wide disparity in the table I posted above.
Re: Estimating Replacement Level: Sabermetrics perspective
Posted: Thu Jul 31, 2014 1:34 pm
by Mike G
That's what I was thinking. There are some decent role players before the season starts, who just missed the cut somewhere, due to roster makeup and other happenstance.
On colts18's list for 2013-14, we have Cartier Martin, who had
started 6 games in 3 years for the Wiz. He had .065 WS/48 in that interval, which is much better than I normally think of as guy-off-the-street caliber. He played 12% of the ~7500 total minutes by these players last year.
I get 6.15 eWins for the lot of them -- a rate that is .40 of NBA avg.
Normally I consider 'replacement value' to achieve zero wins.
Code: Select all
eW the replacements tm Min e484 eW the replacements tm Min e484
1.09 Drew Gooden Was 394 1.34 .18 Chris Wright Mil 126 .71
.92 Cartier Martin Atl 825 .54 .14 Jorge Gutierrez Brk 244 .28
.59 Earl Clark Cle 699 .41 .12 Casper Ware Phl 116 .49
.56 Shawne Williams LAL 754 .36 .12 Tony Mitchell Det 84 .67
.52 Chris Johnson Bos 790 .32 .12 Dewayne Dedmon Phl 150 .37
.43 Leandro Barbosa Phx 368 .56 .11 Earl Clark NYK 70 .73
.34 Jarvis Varnado Phl 341 .48 .10 Orlando Johnson Ind 342 .15
.32 Dewayne Dedmon Orl 235 .66 .08 Jared Cunningham Sac 58 .63
.23 Hilton Armstrong GSW 100 1.09 .06 Cartier Martin Chi 48 .63
.19 Darius Morris Phl 193 .48 .05 Justin Hamilton Mia 70 .34
.19 Manny Harris LAL 179 .50
These guys represent about 40% of the bunch -- and 105% of the eWins total. The rest had few minutes or were more truly off-the-street performers.
Re: Estimating Replacement Level: Sabermetrics perspective
Posted: Thu Jul 31, 2014 10:44 pm
by talkingpractice
i'll have the rapm version of this for us by Monday at the latest.