Page 6 of 15
Re: 2016-17 Team Win Projection Contest / Discussion
Posted: Wed Nov 30, 2016 4:16 pm
by shadow
Not sure I'd say their defensive issues were overblown considering they currently rank 29th in AdjDRtg on bbr, but it is still a little early I suppose. Although I wouldn't bet on a substantial improvement given their personnel and coaching style.
Re: 2016-17 Team Win Projection Contest / Discussion
Posted: Fri Dec 02, 2016 1:20 pm
by Mike G
A few days ago, 3 guesses were less than 4.00 avg error, with RyRi at 3.93
Now we've all drifted away, but for the regressed 16Pyth -- which is creeping close to the middle of the field.
Code: Select all
RyRi 4.37 .47 ncsB 4.78 .06
Mike 4.40 .43 jg34 4.82 .01
sndi 4.44 .39 16py 4.84 .00
amp5 4.44 .39 ncsD 4.89 -.05
sbs. 4.47 .37 BaDo 4.92 -.08
lnqi 4.61 .23 GK5. 4.92 -.08
trzu 4.66 .17 ATCt 4.97 -.13
kmed 4.68 .16 cali 5.02 -.18
taco 4.70 .13 Crow 5.07 -.23
shad 4.71 .13 yoop 5.15 -.31
vegas 4.74 .10 nrfo 5.30 -.46
In squared errors, 16py ranks 8th, just ahead of vegas.
Re: 2016-17 Team Win Projection Contest / Discussion
Posted: Sat Dec 03, 2016 11:57 am
by Mike G
Can't say which is more startling -- our sudden reversal of fortunes as a group; or the disparity in ranking with different exponents applied.
Code: Select all
average absolute errors
RyRi 4.55 .61 vegas 5.01 .15
sbs. 4.66 .50 taco 5.09 .07
amp5 4.66 .50 GK5. 5.16 .00
sndi 4.73 .43 16py 5.16 .00
shad 4.74 .42 ATCt 5.18 -.02
Mike 4.75 .41 jg34 5.19 -.03
ncsB 4.81 .35 cali 5.22 -.06
kmed 4.93 .23 ncsD 5.25 -.09
trzu 4.93 .23 Crow 5.29 -.13
lnqi 4.97 .19 nrfo 5.45 -.29
BaDo 5.00 .16 yoop 5.53 -.37
square root of avg of errors-squared RMSE
Mike 5.54 .60 16py 6.14 .00
RyRi 5.73 .41 shad 6.17 -.03
sbs. 5.78 .36 trzu 6.17 -.03
sndi 5.84 .31 ncsD 6.20 -.06
amp5 5.88 .26 GK5. 6.36 -.22
lnqi 5.96 .19 Crow 6.42 -.28
vegas 5.97 .17 cali 6.42 -.28
jg34 6.05 .09 ATCt 6.43 -.29
ncsB 6.07 .07 BaDo 6.43 -.29
taco 6.09 .05 yoop 6.66 -.52
kmed 6.10 .04 nrfo 6.83 -.68
square of avg of sqrt-errors (SMRE)
RyRi 3.80 .70 vegas 4.45 .05
shad 3.85 .64 ATCt 4.45 .04
sbs. 3.86 .63 GK5. 4.49 .00
amp5 3.90 .59 16py 4.49 .00
ncsB 4.05 .45 cali 4.51 -.01
sndi 4.07 .43 nrfo 4.56 -.06
BaDo 4.09 .40 taco 4.56 -.06
trzu 4.22 .27 jg34 4.56 -.07
Mike 4.22 .27 Crow 4.64 -.15
kmed 4.32 .17 ncsD 4.71 -.22
lnqi 4.35 .14 yoop 4.82 -.33
Re: 2016-17 Team Win Projection Contest / Discussion
Posted: Sat Dec 03, 2016 4:49 pm
by BasketDork
Why am I so low in RMSE ? Not a criticism, Im just curious.
Re: 2016-17 Team Win Projection Contest / Discussion
Posted: Sat Dec 03, 2016 7:15 pm
by Mike G
Two words: Lakers and Bucks.
And Mavs.
You had the lowest guesses on both. Lakers are headed for 37 wins vs your guess of 21.
Bucks look like a 42-win team vs your call of 28.
Your absolute 'errors' are 16.2 and 13.7, and the squares are 262 and 188, respectively.
Then you were a couple wins higher than most on Dallas -- 40 vs their projection of 27, an error squared of 174.
These 3 misses account for 50% of your squared error total of 1240.
It's quite possible all 3 teams will drift toward their pre-season expectations.
I don't really understand how it adds any understanding to exaggerate these errors by squaring them.
Between the two of us, you have 6 of the 7 best guesses and 3 of the 7 worst. And you rank better in SMRE
You show zero (rounded) squared errors for Cha, Hou, Mia, Phx, Sac, and Uta. That's <.707 abs err, and 6 such exact hits seems to lead the field.
Re: 2016-17 Team Win Projection Contest / Discussion
Posted: Sat Dec 03, 2016 8:20 pm
by Mike G
With the season at about 23%, for the record, here are the prognosticators' best and worst (relative to the field) guesses:
Code: Select all
. closest on furthest on
RyRi Atl Sac
shad Atl Mia Min Phl Tor Sac
sbs. Atl OKC Sac
amp5 Atl Den OKC Uta
ncsB Brk NYK Phl LAL Orl Por Uta
sndi SAS Min
BaDo Cha Hou Mia Phx Sac Brk LAL Mil
trzu Det Mil Phl SAS Bos Por Tor
Mike Bos Chi LAL NOP Hou Ind SAS
kmed Hou Was Min
lnqi Phx Sac
ATCt Ind Mem
GK5. Chi Cle Tor Was GSW NYK Phl
cali OKC Phl Uta Sac SAS
nrfo Atl Orl Phx Cle Dal Den Det SAS
taco GSW Ind Cle Orl
jg34 Sac Tor
Crow LAC Orl Uta Atl Mem Phx Tor Was
ncsD Uta Cha Orl
yoop Dal Hou Phx Por Chi LAC Mia NOP Sac
Ties (rounded to integer) are listed. Some of the 'closest' guesses are worse than some of the 'furthest'. The best guess at the Mavs is off by 8, while the worst on Sac and Mem are only off by 4.
Re: 2016-17 Team Win Projection Contest / Discussion
Posted: Sat Dec 03, 2016 10:39 pm
by AcrossTheCourt
RMSE is a traditional, common measure of model fit. It's been utilized in many fields. You can find answers of why squared errors are used pretty easily on google and it's taught (or at least I hope it is) in early statistics classes.
http://stats.stackexchange.com/question ... ared-error
I actually don't know what the error distribution is, but I don't think it's symmetrical, at least not for teams at the two extreme ends. So I don't know if RMSE is particularly needed for NBA wins, but the errors are squared for good reasons.
Re: 2016-17 Team Win Projection Contest / Discussion
Posted: Sun Dec 04, 2016 1:19 am
by Mike G
We know light and sound fall off with the square of distance, gravitational velocity is proportional to time squared, etc. But what does that say about average errors of predictions?
When you're creating formulas, you might square the errors to reduce the outliers the most. But you can do that with an exponent of 1.4 or 2.2 or anything else.
The tradition may be simply that old timers with pen and paper could calculate a square root; a 1.4 root is much harder or impractical. I don't believe 2 is a magic number here, any more than 1/2 is . They just distort the measure in opposite ways.
It's also hard to use RMSE in a sentence. Can you verb it like you can with 'average'?
If you get the Lakers exactly right, and I am off by 4; and you're off by 16 on the Spurs, where my error is 12; then both our avg errors = 8.0
But in RMSE, you're off by (0+256)^1/2 = 16, while mine is (16+144)^1/2 = 12.65
Is that fair? Were you really more off than I was?
Re: 2016-17 Team Win Projection Contest / Discussion
Posted: Sun Dec 04, 2016 12:45 pm
by Mike G
The 'news' today is that we all shrank our projected errors, from -.03 to -.28 (ATCt); yet regressed pyth'16 got bigger by .11, so we all gained relative to that.
Code: Select all
RyRi 4.34 .93 BaDo 4.85 .42
sbs. 4.48 .79 ATCt 4.90 .37
amp5 4.50 .77 GK5. 4.93 .34
sndi 4.53 .74 taco 4.99 .28
ncsB 4.59 .68 jg34 5.00 .27
shad 4.63 .64 cali 5.06 .21
Mike 4.64 .63 ncsD 5.08 .19
trzu 4.67 .60 Crow 5.10 .17
lnqi 4.75 .52 16py 5.27 .00
vegas 4.77 .50 nrfo 5.33 -.06
kmed 4.79 .48 yoop 5.50 -.23
And relative to shadow's weighted power ratings:
Code: Select all
RyRi 4.44 .52 shad 4.87 .09
sbs. 4.48 .48 ncsB 4.87 .09
sndi 4.54 .42 trzu 4.92 .04
GK5. 4.55 .41 16PyR 4.96 .00
taco 4.57 .39 jg34 5.01 -.05
Mike 4.65 .31 vegas 5.05 -.09
amp5 4.71 .25 yoop 5.19 -.23
ATCt 4.80 .16 cali 5.22 -.26
ncsD 4.81 .15 BaDo 5.34 -.38
kmed 4.84 .12 Crow 5.57 -.61
lnqi 4.86 .10 nrfo 5.72 -.76
Re: 2016-17 Team Win Projection Contest / Discussion
Posted: Tue Dec 06, 2016 6:29 pm
by Mike G
If someone had just averaged our 20 entries, they'd be vying for the lead here.
Code: Select all
. avg error impr . avg error impr
RyRi 4.09 .25 ATCt 4.69 .21
avg 4.16 GK5. 4.69 .24
amp5 4.21 .29 cali 4.72 .34
sbs. 4.24 .24 Crow 4.72 .38
Mike 4.30 .34 taco 4.84 .15
trzu 4.33 .34 jg34 4.86 .14
shad 4.34 .29 ncsD 4.94 .14
sndi 4.36 .17 nrfo 5.14 .19
ncsB 4.40 .19 16PyR 5.22 .05
kmed 4.42 .37 yoop 5.35 .15
BaDo 4.44 .41
vegas 4.48 .29
lnqi 4.48 .27
Good to serious improvement for every participant, in just one day.
Re: 2016-17 Team Win Projection Contest / Discussion
Posted: Thu Dec 08, 2016 12:28 pm
by Mike G
Today we see the smallest error to date, for the leader and perhaps for most. And everyone is now better than
regressed 2016 Pyth.
Code: Select all
RyRi 3.89 1.48 lnqi 4.42 .96
amp5 4.04 1.33 BaDo 4.42 .95
avg 4.08 1.30 kmed 4.43 .94
ncsB 4.09 1.29 taco 4.62 .76
shad 4.15 1.23 Crow 4.63 .75
sbs. 4.15 1.23 ncsD 4.68 .69
trzu 4.26 1.12 cali 4.71 .67
Mike 4.32 1.05 jg34 4.72 .65
sndi 4.36 1.02 GK5. 4.76 .61
vegas 4.37 1.01 nrfo 4.80 .57
ATCt 4.39 .99 yoop 5.26 .12
. 16PyR 5.38 .00
That 2nd number is how far you are ahead of '16 Pythag-Regressed.
EDIT: Relative to latest shadow
weighted power ratings:
Code: Select all
RyRi 4.31 1.52 taco 4.77 1.06
avg 4.33 1.49 lnqi 4.81 1.02
sbs. 4.35 1.47 ncsD 4.81 1.01
amp5 4.39 1.44 BaDo 4.87 .96
ncsB 4.49 1.34 jg34 4.91 .92
sndi 4.59 1.24 cali 4.98 .85
Mike 4.59 1.23 vegas 4.99 .84
shad 4.63 1.20 yoop 5.11 .71
ATCt 4.63 1.20 Crow 5.18 .65
kmed 4.66 1.17 nrfo 5.60 .23
GK5. 4.66 1.17 16PyR 5.83 .00
trzu 4.71 1.12
viewtopic.php?f=2&t=9228&p=28376#p28376
Re: 2016-17 Team Win Projection Contest / Discussion
Posted: Tue Dec 13, 2016 12:32 pm
by Mike G
Greatest separation to date between the leader and the rest:
Code: Select all
Abs Err Avg >16py Abs Err Avg >16py
RyRi 3.95 1.74 sndi 4.57 1.12
amp5 4.19 1.50 Crow 4.59 1.10
avg 4.20 1.49 kmed 4.59 1.10
trzu 4.20 1.49 nrfo 4.62 1.07
sbs. 4.22 1.47 taco 4.73 .95
ATCt 4.40 1.29 jg34 4.90 .79
lnqi 4.44 1.25 ncsD 4.99 .69
vegas 4.47 1.22 cali 5.01 .68
shad 4.47 1.21 GK5. 5.14 .55
ncsB 4.48 1.21 yoop 5.16 .53
BaDo 4.48 1.21 16PyR 5.69 .00
Mike 4.51 1.18
... and ...
Code: Select all
. RMSE >16py RMSE >16py
RyRi 4.94 1.56 taco 5.45 1.04
amp5 5.01 1.49 kmed 5.46 1.04
avg 5.03 1.47 ATCt 5.54 .95
sbs. 5.15 1.34 ncsD 5.58 .91
lnqi 5.20 1.30 nrfo 5.74 .76
ncsB 5.21 1.28 cali 5.77 .72
trzu 5.32 1.17 Crow 5.81 .68
sndi 5.35 1.15 jg34 5.92 .57
vegas 5.35 1.14 GK5. 5.95 .54
Mike 5.36 1.14 yoop 6.17 .33
BaDo 5.41 1.09 16PyR 6.50 .00
shad 5.42 1.08
Re: 2016-17 Team Win Projection Contest / Discussion
Posted: Sun Dec 18, 2016 3:25 pm
by Mike G
Again we've sunk to new lows.
Code: Select all
RyRi 3.53 2.02 BaDo 4.19 1.37
avg 3.76 1.79 sndi 4.19 1.37
trzu 3.79 1.77 kmed 4.22 1.34
amp5 3.84 1.72 Mike 4.26 1.29
ncsB 3.86 1.70 taco 4.29 1.27
ATCt 3.87 1.68 ncsD 4.39 1.17
sbs. 3.90 1.66 Crow 4.42 1.13
lnqi 3.93 1.63 jg34 4.46 1.09
vegas 4.02 1.53 nrfo 4.48 1.08
shad 4.06 1.50 cali 4.48 1.07
. yoop 4.78 .78
. GK5. 4.82 .74
. 16PyR 5.56 0
RyanRiot has made one post to this forum. None of his predictions were the high or the low one for any team. But he guessed on the "right" side on most teams:
Code: Select all
tm avg proj err RyRi -dif
Min 38.7 32.2 -6.5 36.7 2.0
Atl 42.5 38.9 -3.6 40.6 1.9
Mil 31.9 42.8 10.9 33.8 1.9
Cha 41.5 43.6 2.1 42.9 1.4
Det 41.2 43.4 2.2 42.5 1.3
Mia 36.2 34.7 -1.5 35.0 1.2
NYK 35.7 39.0 3.3 36.8 1.1
Phx 28.5 26.7 -1.8 27.7 .8
Uta 48.3 50.0 1.7 48.9 .6
Tor 50.4 57.2 6.8 51.0 .6
Bos 50.7 44.8 -5.9 50.2 .5
Phl 24.1 24.5 .4 24.6 .3
Ind 40.2 37.9 -2.3 40.0 .2
Brk 25.3 25.6 .3 25.5 .2
Sac 36.2 36.0 -.2 36.1 .1
Was 41.4 37.3 -4.1 41.3 .1
SAS 56.9 56.8 -.1 57.0 -.1
Mem 39.5 43.8 4.3 39.4 -.1
Cle 56.8 56.7 -.1 56.9 -.1
Dal 37.8 28.6 -9.2 38.0 -.2
Den 36.1 36.0 -.1 36.3 -.2
GSW 68.8 63.6 -5.2 69.1 -.3
Chi 39.3 41.4 2.1 38.9 -.4
Okl 45.6 43.6 -2.0 46.0 -.4
LAL 23.7 30.7 7.0 23.1 -.6
Por 44.0 37.1 -6.9 44.7 -.7
Hou 46.8 56.6 9.9 45.8 -1.0
LAC 51.2 56.8 5.6 50.2 -1.0
Orl 35.4 32.8 -2.6 36.4 -1.0
NOP 35.2 30.8 -4.4 36.3 -1.1
These are ranked by how much he's beating the field (avg). He's actually worse than avg on 14 of 30, but by smaller amounts.
He has the best (or tied) guess on about 7 teams; closest he comes to worst guess looks like Orl and Por, where he's within 1 or so.
Re: 2016-17 Team Win Projection Contest / Discussion
Posted: Sun Dec 18, 2016 9:13 pm
by Crow
Ryan Riot.
Is it a Friday Riot by chance? In Tampa? On Radio? Or am I barking up wrong tree? If I am, are you a musician in Canada or Switzerland?
I hope you will share more about your method or yourself. If you feel like it.
Re: 2016-17 Team Win Projection Contest / Discussion
Posted: Mon Dec 19, 2016 12:08 pm
by Mike G
Having been reminded that 538 also has a projection ongoing, here we are relative to that forecast:
Code: Select all
RyRi 3.61 2.46 ATCt 4.16 1.91
trzu 3.67 2.40 shad 4.20 1.87
sbs. 3.77 2.29 nrfo 4.20 1.87
avg 3.79 2.27 cali 4.20 1.87
amp5 3.80 2.27 Crow 4.23 1.83
lnqi 3.82 2.24 ncsD 4.33 1.73
BaDo 3.87 2.20 sndi 4.40 1.67
vegas 3.87 2.19 jg34 4.66 1.41
ncsB 3.93 2.13 taco 4.80 1.27
Mike 4.00 2.07 yoop 4.87 1.20
kmed 4.08 1.98 GK5. 4.92 1.15
. vvvvvvvvvv 16PyR 6.07 .00
A closer field and more separation from 2015-16 pyth-regressed.
I believe these are yesterday's numbers, so they can be compared to the previous chart.