Predictions 2014-2015

Home for all your discussion of basketball statistical analysis.
Mike G
Posts: 6144
Joined: Fri Apr 15, 2011 12:02 am
Location: Asheville, NC

Re: Predictions 2014-2015

Post by Mike G »

bbstats wrote:Whoa. 2nd-to-last place?

I blame Boogie.

EDIT: Though my W totals are based on schedule so measuring them against Pyth is probably skewing it slightly?
No, you're next to best, after Crow, in both tables.
I subtracted everyone's 'error' from the '14py' error.
These numbers represent that your guesses look 2+ Wins better than a hypothetical someone who just submitted last year's PythW totals. Bigger is better.

It's a very sketchy method I used this time. But by several variations on the method, our rankings are quite similar.
bbstats
Posts: 227
Joined: Thu Apr 21, 2011 8:25 pm
Location: Boone, NC
Contact:

Re: Predictions 2014-2015

Post by bbstats »

Oh! I was thinking '14 Pyth was '15 Pyth :-D
mystic
Posts: 470
Joined: Mon Apr 18, 2011 10:09 am
Contact:

Re: Predictions 2014-2015

Post by mystic »

Just as a comparison, z-scores for our group using RMSE of the bbr projection:

Code: Select all

Crow               -1.65
mystic             -1.29
FiveThirtyEight    -1.27
AJPT-PM            -1.14
bbstats            -0.73
WilliamH           -0.60
v-zero             -0.54
AcrossTheCourt     -0.42
MikeG              -0.35
ESPNF              -0.19
ESPNS               0.07
AJASPM              0.47
Bobbofitos          0.54
italia13calcio      0.68
HoopDon             0.79
nbacouch            0.97
sndesai1            1.11
DrP                 1.56
fpliii              2.00
Crow, maybe you mentioned that before and I missed it, but how did you arrive at your numbers?
Crow
Posts: 10533
Joined: Thu Apr 14, 2011 11:10 pm

Re: Predictions 2014-2015

Post by Crow »

Subjectively weighted blend of 12 metrics / predictions (mostly here but some from outside including 3 Vegas lines, based on past performance / my impression at 5-15%) then further subjectively tweaked up or down by 1-4, with a few by a little more. About 2 hours to process. If I did 10-50 times the work to adjust things I might do better, break even or do worse.

You are also doing well. Custom metric or...?
ampersand5
Posts: 262
Joined: Sun Nov 23, 2014 6:18 pm

Re: Predictions 2014-2015

Post by ampersand5 »

I really like the basketball reference predictor. Unfortunately, it does not take into account some important things like percentage of games played at home, or back to backs. Over the season these might even eachother out, but this tool is useless after the season ends. Things are really unequal in November/December making this less accurate.

Also - there really should be a confidence interval in regards to sample size. IE after 13/82 games, confidence is X. After 40 games of 82, confidence is Y.
mystic
Posts: 470
Joined: Mon Apr 18, 2011 10:09 am
Contact:

Re: Predictions 2014-2015

Post by mystic »

ampersand5 wrote:I really like the basketball reference predictor. Unfortunately, it does not take into account some important things like percentage of games played at home, or back to backs. Over the season these might even eachother out, but this tool is useless after the season ends. Things are really unequal in November/December making this less accurate.
How do you know this? I can't find any further explanation for the basis of that prediction than those words: "Results are based on 1000 simulations of remainder of season."
ampersand5 wrote: Also - there really should be a confidence interval in regards to sample size. IE after 13/82 games, confidence is X. After 40 games of 82, confidence is Y.
There is a best and worst scenario for each team listed already.
mystic
Posts: 470
Joined: Mon Apr 18, 2011 10:09 am
Contact:

Re: Predictions 2014-2015

Post by mystic »

Crow wrote:Subjectively weighted blend of 12 metrics / predictions (mostly here but some from outside including 3 Vegas lines, based on past performance / my impression at 5-15%) then further subjectively tweaked up or down by 1-4, with a few by a little more. About 2 hours to process. If I did 10-50 times the work to adjust things I might do better, break even or do worse.
Ok. Thanks.
Crow wrote:You are also doing well. Custom metric or...?
Individual player rating based on 2014 data with an age adjustment as well as a rookie prediction based on draft position only. Additionally, a wild guess for the minute distribution. :)
AcrossTheCourt
Posts: 237
Joined: Sat Feb 16, 2013 11:56 am

Re: Predictions 2014-2015

Post by AcrossTheCourt »

Can we throw in a Vegas line for the predictions as a baseline too? Just curious. Thanks.
Mike G
Posts: 6144
Joined: Fri Apr 15, 2011 12:02 am
Location: Asheville, NC

Re: Predictions 2014-2015

Post by Mike G »

I think Crow just averaged everybody else's lines, bumped a few up or down. He isn't highest or lowest on any team, within 1 W of group avg on most.

How does Bobbofitos guess OKC wins 41 games? Everyone else was over 53. Currently headed for 32 or so.
sndesai1
Posts: 141
Joined: Fri Mar 08, 2013 10:00 pm

Re: Predictions 2014-2015

Post by sndesai1 »

i have bobbofitos as 51 for okc...i thought crow had the lowest prediction at 50

i didn't read too carefully about what you were tracking our predictions against, but it looks like it might be a better method than just current wins + pyth%. if that's the case, i will start using that in the comparison instead.

as of end of 11/24:
Image
mystic
Posts: 470
Joined: Mon Apr 18, 2011 10:09 am
Contact:

Re: Predictions 2014-2015

Post by mystic »

http://www.basketball-reference.com/fri ... f_prob.cgi

http://espn.go.com/nba/hollinger/playoffodds

Two examples where a simulation of the remainder of the season is used. That is a much better approach than using current win% or pyth, because the latter does not take current and upcoming SOS into account.
Crow
Posts: 10533
Joined: Thu Apr 14, 2011 11:10 pm

Re: Predictions 2014-2015

Post by Crow »

I think Crow did what I said I did above and what everyone was trying to do, i.e. find a good method to most accurately predict wins. I blend metrics with discretion because I believe that is a good approach, not just because it is easy. I believed and believe that independently; but a certain NBA analyst / rapm producer once told me he used a blended metric approach to come in second in one of the biggest, most prestigious prediction contests in world with one of the hugest cash prizes, so the approach is not unknown or without much merit.
mystic
Posts: 470
Joined: Mon Apr 18, 2011 10:09 am
Contact:

Re: Predictions 2014-2015

Post by mystic »

I think it is completely fine what you did and I agree that the likelihood of getting it "right" improves by blending different methods. For my own rating I use a blend of two different approaches (purely boxscore-based plus RAPM-based) as well. Nothing wrong with that.

Anyway, seeing the high correlation to my prediction, any chance it is included in yours, Crow?
Crow
Posts: 10533
Joined: Thu Apr 14, 2011 11:10 pm

Re: Predictions 2014-2015

Post by Crow »

Thanks. I thought it was included, but apparently not. Probably because there wasn't a prediction under your name here last season? And I was in a hurry and thought a dozen was enough. It would be weighted if I revised based on performance to date. And if I could set up a machine learning model, I'd let it grind to the best blend, this season and thie last five. And apply that to future projections. But for this, one iteration of a blend may be enough, by a human not a computer. (It was good enough for first here twice before.)
permaximum
Posts: 416
Joined: Tue Nov 27, 2012 7:04 pm

Re: Predictions 2014-2015

Post by permaximum »

Just want to bet on Crow that he's going to win the contest. If a blending approach leads this early, I can't see a way he'll lose.
Post Reply