Variance and Sample Size: Why Short Streaks Mislead
Learn why a hot week proves little, how to estimate the normal swings in win rates, and why small samples fool even careful analysts.
Sports analysts, fantasy players and casual fans share a habit: they see a pattern in a few results and treat it as proof. A team wins six straight, a player hits ten shots in a row, a bettor has a hot month. Statistics offers a sober check on these reactions. The key ideas are variance and sample size. This guide walks through both with simple numbers. It is educational and does not recommend any bet.
What variance means
Variance describes how much results scatter around their average. Even when a probability is perfectly known, outcomes bounce. A fair coin lands heads half the time over thousands of flips, but over 10 flips you will often see 3 heads or 7. That is not a sign the coin is broken; it is the normal spread of a small sample.
The law of large numbers
The law of large numbers says that as the number of trials grows, the average result gets closer to the true probability. Notice what it does not say: it does not promise that early swings will be corrected. If a coin has produced 8 heads in 10 flips, it does not owe tails in the next 10. The average simply gets diluted by many more flips. This is the root of the gambler's fallacy, the belief that outcomes must balance in the short run.
A worked example
Suppose a forecaster's picks truly win 55 percent of the time. How much will a record bounce around?
The standard deviation of the number of wins in n trials is the square root of n times p times (1 minus p).
- 20 picks: expected wins are 11. The standard deviation is the square root of 20 x 0.55 x 0.45, about 2.2. A typical range of two standard deviations is roughly 7 to 15 wins, so 35 to 75 percent. That range is huge.
- 1,000 picks: expected wins are 550. The standard deviation is about 15.7, so two standard deviations give roughly 519 to 581 wins, or 52 to 58 percent.
The lesson is clear. A 20-pick record tells you almost nothing about skill, and even 1,000 picks leaves some uncertainty.
Why it matters when prices have a margin
As we explain in our guide to reading American odds, standard minus 110 prices require about a 52.4 percent win rate just to break even. With sample-size noise of the kind shown above, someone with no edge at all can look brilliant for a month, and someone with a small real edge can look poor for a season. Short-term results are a weak guide in both directions.
Practical habits for thinking clearly
- Decide your sample size in advance. Do not judge a method after a handful of results.
- Beware cherry-picking. Looking only at the best stretch inflates impressions.
- Track everything, including losses. Memory favors wins and exciting moments.
- Think in ranges, not points. Ask what range of results would be normal if nothing special were going on.
- Separate process from outcome. A good decision can lose and a poor one can win.
The same logic applies to team and player analysis, and it is why statisticians in sports pay such attention to regression to the mean. For more on this history, see our look at how statistics changed sports fandom.
Frequently asked questions
Is a player on a hot streak more likely to score again? In some sports there is evidence of small effects, but research often finds streaks are less meaningful than they feel. Treat apparent streaks with caution.
How big a sample is enough? It depends on how big the effect is. Smaller effects need far more observations to detect reliably.
Does this mean skill does not exist? No. It means skill must be measured over enough observations and separated from luck.
Steps
- Define the underlying probability: State the long-run win probability you are testing, such as 55 percent.
- Estimate the spread of outcomes: Use the standard deviation formula, the square root of n times p times one minus p, to see typical swings.
- Compare results with the expected range: Check whether the actual result falls within about two standard deviations of the average.
- Collect more data before concluding: Avoid drawing firm conclusions from small samples and revisit your estimate as results accumulate.