LearnViz CompSci
Home / Learn / Math for Computing / Law of Large Numbers

Intermediate Topic 22 of 51 Math for Computing

Law of Large Numbers

Sample averages converge to expectation.

How it works

The law of large numbers states that as the number of independent, identically distributed trials grows, the sample average converges to the expected value. The weak law says convergence in probability and the strong law says almost sure convergence. It justifies using averages of repeated experiments to estimate true means, and underlies Monte Carlo methods, polling and insurance.

Where it is used

Estimating probabilities by simulation, casinos and insurers relying on stable long-run averages, A/B testing and statistical sampling use the law of large numbers.

Common pitfall

It says nothing about short runs and does not imply that deviations get corrected, the gambler's fallacy: the average converges because new results dilute earlier ones, not because of compensation. It requires finite expectation, so heavy-tailed distributions such as the Cauchy do not converge. Convergence can be slow, with error shrinking like one over the square root of n. Check variance and sample size.

Where it fits in the course

Law of Large Numbers is topic 22 of 51 in Math for Computing, rated Intermediate. It follows Binomial and Poisson Distributions. The next topic is Central Limit Theorem.

Practice and explore

How to study this topic

  1. Read the explanation above and restate the definition in your own words.
  2. Open the interactive lesson and answer its mini quiz.
  3. Read the common pitfall, then write a short example that avoids it.
  4. Check your understanding in the Math for Computing quiz, and revisit the topic if you miss a question.

Frequently asked questions

What is Law of Large Numbers?
Sample averages converge to expectation. It belongs to Math for Computing and is an intermediate-level topic.
Where do people use Law of Large Numbers?
Estimating probabilities by simulation, casinos and insurers relying on stable long-run averages, A/B testing and statistical sampling use the law of large numbers.
What is the most common mistake with Law of Large Numbers?
It says nothing about short runs and does not imply that deviations get corrected, the gambler's fallacy: the average converges because new results dilute earlier ones, not because of compensation.
What should I learn before this topic?
Start with Binomial and Poisson Distributions, the topic just before it in Math for Computing.
How can I practice it?
Answer the mini quiz in the interactive lesson, then take the Math for Computing quiz.
Is Law of Large Numbers hard to learn?
It is an Intermediate topic. Be comfortable with the Beginner topics in this area first, then read the common pitfall carefully, since it is where most mistakes happen.
How long does it take to learn Law of Large Numbers?
Most learners can read the explanation and finish the interactive lesson in under an hour. Fluency comes from applying the idea, so plan a few short practice sessions with the quiz.
Which topics are related to Law of Large Numbers?
Binomial and Poisson Distributions, Central Limit Theorem, Normal Distribution are closely connected. The full list is in the related topics section of this page.
What should I study after Law of Large Numbers?
Continue with Central Limit Theorem, the next topic in Math for Computing.

Related topics