How the NHL model is tested
The method itself isn't published here. What is published: every pick is locked before puck drop and graded after the final (overtime and shootouts count like any other result), the model is evaluated on seasons it never saw, and a change only ships if it holds up there. Winners are the record: the pick is the side the model favors, with the probability it gives that side. When sportsbooks price a game, that probability follows the betting market's price: in testing, the market beat the team ratings alone, so the ratings decide only games the books haven't priced yet.
Backtest
Walk-forward: every game priced from ratings that have seen only the games before it, fixed before these seasons were ever scored. This is the ratings alone; anchored to the market's price, as picks are published now, held-out games 2022–26 went 60.0%.
Backtest winners · ratings aloneEvery game priced only from what was known before it, then scored once. Kept apart from the record.
Walk-forward backtest of the ratings alone, held-out seasons 2019–26: not in the recordFor scale: always picking the home team would have won 53.6% of the same games. Hockey games sit closer to a coin flip than basketball or football, so most calls land between 50% and 65%.
Calibration
When the model gives a side 60%, that side should win about 60% of the time. The lanes put the live picks (only a handful so far: NHL picks are just starting to grade) beside the backtest for each band.
When it said 70%, did it win 70%?Each lane is a confidence band. Calibrated means the dot lands in its gray band; the bar shows luck's range.
- Said 50–55%47% won 7 of 1590% range 28–67%backtest 51.0% of 2,884
- Said 55–60%36% won 4 of 1190% range 18–61%backtest 57.3% of 2,455
- Said 60–65%63% won 5 of 8only 8 graded: too few to judgebacktest 63.8% of 1,621
- Said 65–70%100% won 6 of 6only 6 graded: too few to judgebacktest 66% of 996
- Said 70–100%67% won 2 of 3only 3 graded: too few to judgebacktest 75% of 554
Live picks, locked before the start. Backtest: walk-forward backtest of the ratings alone, held-out seasons 2019–26, not in the record. Lanes with fewer than 10 graded picks are faded.
Live record
Winners calledOnly picks locked before the start count. A pick made later, or priced after the fact, never enters it.
Locked before the start, graded afterWon 24. Its stated probabilities expected 25.2 (90% range 19.9–30.4): inside that range, in line with its probabilities.
Betting favorite on the same 41 priced games: 23–18 (ours 23–18).
Against the betting favoriteSame games, winners only. The favorite is the side with the shorter no-vig moneyline when the pick was locked.
Every pick here is from the market-anchored era: a priced game's win % is the market's no-vig price. 2 picks have no stored price and sit in none of these rows. Under 30 games a record is too early to read either way. Every pick, one row each →
Every graded pick, the ledger and expected vs actual winners →
What we don't publish
The method, its parameters, and what was tried and rejected are not published — that's the part of the work we keep to ourselves. What's always public is the result: every pick locked pre-game, graded after, calibration shown honestly, and nothing about the record edited after the fact.
For information only, not betting advice. 21+ only. Gambling problem? Call or text 1-800-GAMBLER.