Page 17 of 18
Re: 2024-25 team win projection contest
Posted: Mon Apr 14, 2025 1:16 am
by TeemoTeejay
Out of curiousity, how would my results look if they were regressed a tad more, let’s say with the same variance as the winner?
Won’t be allowed to enter the contest going forward so curious on that front
Re: 2024-25 team win projection contest
Posted: Mon Apr 14, 2025 1:24 am
by Crow
Who / how many regressed as a separate step? Based on guess or formal analysis? By a standard amount or informed by team specific experience relative to estimated strength?
Any other adjustments people want to share / show-off / ask about / discuss?
Anybody include coach and / or front office as separate variables in a model or guesstimate? I include those considerations in my final subjective adjustments but not in a formal or data driven way.
If someone was really motivated, could compare results to predictions and estimate how much was performance estimate error, minutes distribution error, other coach / front office variance (especially trades and other roster adjustments but not limited tovthat), luck variance, injuries, SOS shift from average or expected...
If you could reasonably estimate impacts of everything else, could any residual be ascribed to front office / coach? Which did best / worst?
For those with player level age / development adjustments, how close did it track on average? Outlier cases?
Re: 2024-25 team win projection contest
Posted: Mon Apr 14, 2025 2:47 pm
by dtkavana
Wow! I was not expecting to win after the way things looked last week...what a pleasant surprise. Yes, I use a predictive version of CraftedPM which is basically just a players CraftedPM from the prior season with an age adjustment. Two wins in three years is a nice little resume builder.
Re: 2024-25 team win projection contest
Posted: Mon Apr 14, 2025 3:01 pm
by DQuinn1575
Crow wrote: ↑Mon Apr 14, 2025 1:24 am
Who / how many regressed as a separate step? Based on guess or formal analysis? By a standard amount or informed by team specific experience relative to estimated strength?
Any other adjustments people want to share / show-off / ask about / discuss?
Anybody include coach and / or front office as separate variables in a model or guesstimate? I include those considerations in my final subjective adjustments but not in a formal or data driven way.
If someone was really motivated, could compare results to predictions and estimate how much was performance estimate error, minutes distribution error, other coach / front office variance (especially trades and other roster adjustments but not limited tovthat), luck variance, injuries, SOS shift from average or expected...
If you could reasonably estimate impacts of everything else, could any residual be ascribed to front office / coach? Which did best / worst?
For those with player level age / development adjustments, how close did it track on average? Outlier cases?
Congrats to the winners, happy where I finished, probably getting most improved. I'm going to dive into where I missed and see how much was each of those buckets, in a goal to see improvements in my model. I didnt account for coaching or fron office at all. But wondering how much I missed to do (1) minutes, (2) performance, (3) production from players not forecasted (I used Pelton's model), (4) luck, and (5) errors by me in my model.
But overall pretty happy with a model that did well, and I think beat Vegas on the over/under by a good margin.
Re: 2024-25 team win projection contest
Posted: Mon Apr 14, 2025 5:49 pm
by TeemoTeejay
Sounds like an age adjustment was the missing piece for me
I was doing this as a preliminary test of the metric, so I was more so concerned to see where it would rank by all star break before trade deadline shenanigans happened. Looking through my results it felt like age adjustment stuff + it being very high on the mavs/suns/pels who all had injury issues or age decline issues was what separated it from how Darko did + it predicting relatively widely in terms of range at least, so im pretty happy with the results even though a bit disappointed in the final day loss (Although as a fan the results on the west were how I wanted them to go and I'll gladly take that over a win).
Pretty happy with a second place finish over CraftedDPM considering how good it had done in recent years, The MAMBA metric itself I basically had to take it down since I got a job so it hasnt been updated in awhile (I dont think its available anymore since I took it down too), but im happy it beat out the predictive versions of EPM and LEBRON.
I am curious how you guys went about projecting from a chosen metric though, all I did was lm(Mamba ~ Wins) just since it was a test run of the metric, but seeing what Darko and the LEBRON/EPM BBI projections were (In terms of preseason adjustments and vegas stuff) it sounds like that might be just as complicated as a step
Re: 2024-25 team win projection contest
Posted: Tue Apr 15, 2025 4:30 pm
by knarsu3
Yeah these are my projections. I thought I described those models in here earlier. But to explain again:
the LEBRON and EPM ones use the prior 3 seasons of LEBRON/EPM data + some of our talent grades + offensive and defensive roles + minutes consistency etc. to predict the next season LEBRON/EPM and then those are used to come up with season projections. At the time, I had done this before the predictive version of EPM had come out so with hindsight, the EPM one is kinda pointless/unnecessary since that was converted to be more like DARKO.
The Advanced model and Vegas advanced model ones were published here:
https://docs.google.com/spreadsheets/d/ ... =900051927
Also since I know that Mike G wants proof that win projections were done before the season, here it is:
tweeted October 23, 2024 at 5:54 pm EST
But I did not post it in here so if those are the rules, that is fine and makes sense. I certainly should've put the effort to post it and kinda just forgot because it was last minute. I will clarify and say that my projections shown above are different from the LEBRON/EPM ones which are a team effort (that includes me).
Hopefully this clarifies some questions about my/bball-index win projections.
TeemoTeejay wrote: ↑Wed Apr 09, 2025 9:41 pm
kmedved wrote: ↑Wed Apr 09, 2025 6:35 pm
What’s the difference between the LEBRON and EPM projections and the advanced model and Vegas advanced model ones?
Re: 2024-25 team win projection contest
Posted: Tue Apr 15, 2025 4:47 pm
by knarsu3
Normally I've seen people using whatever metric- MAMBA, LEBRON, EPM, DARKO etc. and take that to generate win probabilities based on the minutes and simulate the season (or you can just calculate and add up based on the schedule). But I honestly think that is maybe unnecessarily complicated and that your method (and mine in that other win projection model) is the best way- just do lm(Wins ~ Mamba (or LEBRON/DARKO etc.) and you can include other variables like preseason net rating etc. It's also just so much easier now with the uncertainty with the schedule due to the IST games. Schedules aren't really balanced and so imo, I do think your way is the best way.
TeemoTeejay wrote: ↑Mon Apr 14, 2025 5:49 pm
Sounds like an age adjustment was the missing piece for me
I was doing this as a preliminary test of the metric, so I was more so concerned to see where it would rank by all star break before trade deadline shenanigans happened. Looking through my results it felt like age adjustment stuff + it being very high on the mavs/suns/pels who all had injury issues or age decline issues was what separated it from how Darko did + it predicting relatively widely in terms of range at least, so im pretty happy with the results even though a bit disappointed in the final day loss (Although as a fan the results on the west were how I wanted them to go and I'll gladly take that over a win).
Pretty happy with a second place finish over CraftedDPM considering how good it had done in recent years, The MAMBA metric itself I basically had to take it down since I got a job so it hasnt been updated in awhile (I dont think its available anymore since I took it down too), but im happy it beat out the predictive versions of EPM and LEBRON.
I am curious how you guys went about projecting from a chosen metric though, all I did was lm(Mamba ~ Wins) just since it was a test run of the metric, but seeing what Darko and the LEBRON/EPM BBI projections were (In terms of preseason adjustments and vegas stuff) it sounds like that might be just as complicated as a step
Re: 2024-25 team win projection contest
Posted: Tue Apr 15, 2025 5:45 pm
by Crow
Knarsu3, how did LeBron and your projections do on average error?
KMedved, what ws the final error for Darko?
Knarsu's models themselves could possibly be discussed. Quite detailed.
Re: 2024-25 team win projection contest
Posted: Wed Apr 16, 2025 2:36 am
by TeemoTeejay
knarsu3 wrote: ↑Tue Apr 15, 2025 4:47 pm
Normally I've seen people using whatever metric- MAMBA, LEBRON, EPM, DARKO etc. and take that to generate win probabilities based on the minutes and simulate the season (or you can just calculate and add up based on the schedule). But I honestly think that is maybe unnecessarily complicated and that your method (and mine in that other win projection model) is the best way- just do lm(Wins ~ Mamba (or LEBRON/DARKO etc.) and you can include other variables like preseason net rating etc. It's also just so much easier now with the uncertainty with the schedule due to the IST games. Schedules aren't really balanced and so imo, I do think your way is the best way.
That makes sense
The age adjustment things are what I find interesting too, I haven’t really explored that yet although it seems pretty straightforward I do wonder how to account for players with different aging curves
Re: 2024-25 team win projection contest
Posted: Wed Apr 16, 2025 8:56 pm
by DQuinn1575
Mike G wrote: ↑Sun Apr 13, 2025 11:19 pm
FINAL
Code: Select all
. avg err rmse r^2 . avg err rmse r^2
dtka 7.50 9.7 .46 emin 8.47 10.9 .37
TmTj 7.63 10.0 .44 eExp 8.48 10.7 .42
avgA 7.82 10.1 .41 WShr 8.49 10.3 .39
medi 7.87 11.1 .37 24pr 8.51 10.8 .33
DQin 7.93 10.3 .42 KPel 8.52 10.0 .58
bpmW 8.14 10.0 .43 24py 8.66 11.7 .33
Crow 8.33 10.6 .41 bmgm 9.13 12.1 .33
vegas 8.40 10.7 .38 eWin 9.65 11.9 .20
. perW 9.96 12.0 .18
KPel wins at e>2.57
dtka takes everything else.
I think you flip flopped my Chicago and Charlotte win projections again. I come up with 7.80, and if I flip flop them (which you originally did) I get 7.93
I had CHicago 30 & Charlotte 28.
Thanks for doing all the work on this!
Re: 2024-25 team win projection contest
Posted: Thu Apr 17, 2025 6:19 am
by Mike G
A very strange thing happened. In mid Jan. I opened my Excel file to update, and it had reverted to a version saved sometime in Nov. This after updating (and saving) almost every day in the meantime.
I searched all thru my computer for another version of the file but never found one. So I blame microsoft.
One page in the file (named "log") is a daily record of everyone's MAE that is nice to be able to reference. I patched in entries for the missing weeks by copying from this thread; it's every few days instead of daily.
So yeah, I guess we fixed the Cha/Chi issue in that 'lost' interval. Sorry about that.
Maybe mediocre will swap his 3rd-place prize money for yours.
Re: 2024-25 team win projection contest
Posted: Thu Apr 17, 2025 3:51 pm
by DQuinn1575
Mike G wrote: ↑Thu Apr 17, 2025 6:19 am
A very strange thing happened. In mid Jan. I opened my Excel file to update, and it had reverted to a version saved sometime in Nov. This after updating (and saving) almost every day in the meantime.
I searched all thru my computer for another version of the file but never found one. So I blame microsoft.
One page in the file (named "log") is a daily record of everyone's MAE that is nice to be able to reference. I patched in entries for the missing weeks by copying from this thread; it's every few days instead of daily.
So yeah, I guess we fixed the Cha/Chi issue in that 'lost' interval. Sorry about that.
Maybe mediocre will swap his 3rd-place prize money for yours.
lol, he can keep all the cash, I'm just in it for the glory.
Seriously .06 0r .07 x 30 teams is 2 wins total, and really a tie anyway.
Really happy beating Vegas, Pelton, and the ESPN experts - pretty impressive group here when I can do that and still finish behind a couple of guys.
Again thanks for tracking this.
Re: 2024-25 team win projection contest
Posted: Tue Apr 29, 2025 7:03 pm
by kmedved
Crow wrote: ↑Tue Apr 15, 2025 5:45 pm
KMedved, what ws the final error for Darko?
As linked before, the projections are here:
https://docs.google.com/spreadsheets/d/ ... =235611189, and the final results were:
1) 0.533 R^2
2) 7.24 MAE
3) 9.15 RMSE
I generally think R^2 is the best measure for these sorts of contests. For the sake of clarity, I reiterate I don't think these should be eligible, since I didn't post them in the contest. This was a good year for the preseason-adjustments in particular, which were helpful essentially everywhere except Cleveland.
Re: 2024-25 team win projection contest
Posted: Tue Apr 29, 2025 7:28 pm
by Crow
It was a very good performance.
Pre-season adjustments by player and / or team?
(Fwiw, I am unable to reach / see in mobile the column headers for that spreadsheet. But I was able to copy and see.)
Re: 2024-25 team win projection contest
Posted: Tue Apr 29, 2025 7:38 pm
by kmedved
Crow wrote: ↑Tue Apr 29, 2025 7:28 pm
It was a good performance.
Pre-season adjustments by player and / or team?
Preseason adjustments are done at the team level, but weighted by the number of minutes played by players, so if you underperform without playing any of your starters, there's less weight given.