Brier Score: How Close a Win Probability Was
How it is worked out
Take each forecast's probability for the side it picked, subtract 1 if that side won or 0 if it lost, square it, and average. A 70% call that came in scores 0.090; a 60% call that missed scores 0.360.
- Ours: 70% (won), 60% (lost)
- 0.225
- The market: 60% (won), 55% (lost)
- 0.231
Lower is better. Here ours edges it on Brier, a made-up example of two games, far too few to mean anything.
Brier score and log loss
Both grade the same forecasts. Log loss punishes a confident miss much harder (on these two games 0.636 for ours against 0.655 for the market), the Brier score treats misses more evenly. Probetrics' results pages show both, ours beside the market's no-vig probabilities on the same priced games, because a win rate alone cannot say whether the stated chances were any good.
See it on tonight's props. Pro puts each player's hit rate beside the books' chance on every line.
Start 7-day free trialQuestions and answers
- What is a good Brier score?
- Lower is better. Always saying 50% scores 0.25, so a forecast has to beat that to say anything, and in sports the market's own probabilities are the real bar.
- Why compare with the market?
- Because the market is the strongest simple forecast available. Scoring ours and the market's on the same games shows whether ours adds anything; mostly it matches it.
- Is a lower score a guaranteed edge?
- No. Over a few hundred games the gap between two scores is mostly noise; read it with the sample size beside it.
Read next
- CalibrationCalibration is whether stated probabilities match what happens: of the picks a model gave about 70%, about 70% should win.
- Market-anchored probabilityA market-anchored probability starts from the sportsbook's no-vig price for a game and lets a model change it only where testing has shown the model adds information.
- No-vig oddsNo-vig odds, also called fair odds, are a two-sided price with the sportsbook's margin (the vig, or juice) taken out, so the two sides' chances add up to 100%.
This page explains arithmetic and vocabulary. It does not recommend a bet, a side, an amount or a sportsbook, and the examples are illustrations. Data and analytics only, not betting advice: any bet is your own decision, and we are not responsible for losses. 21+ only. Gambling problem? Call or text 1-800-GAMBLER.