LearnViz CompSci
Home / Learn / Math for Computing / Hypothesis Testing

Intermediate Topic 24 of 51 Math for Computing

Hypothesis Testing

Deciding whether data contradict a claim.

How it works

Hypothesis testing is a framework for deciding whether data provides enough evidence against a null hypothesis, usually a statement of no effect or no difference. You choose a significance level alpha, such as 0.05, compute a test statistic, such as t, z, chi-squared or F, and its p-value, the probability of seeing results at least as extreme if the null were true. If the p-value is below alpha, you reject the null. Type I errors are false positives, type II errors are false negatives, and power is the chance of detecting a real effect.

Where it is used

A/B testing in products, clinical trials, quality control, scientific experiments and machine-learning model comparison use hypothesis tests.

Common pitfall

A p-value is not the probability that the null is true or that the result is important, and failing to reject does not prove the null. Running many tests inflates false positives, requiring corrections such as Bonferroni. Stopping early when results look good biases outcomes. Report effect sizes and confidence intervals and plan sample sizes with power analysis.

Where it fits in the course

Hypothesis Testing is topic 24 of 51 in Math for Computing, rated Intermediate. It follows Central Limit Theorem. The next topic is Confidence Intervals.

Practice and explore

How to study this topic

  1. Read the explanation above and restate the definition in your own words.
  2. Open the interactive lesson and answer its mini quiz.
  3. Read the common pitfall, then write a short example that avoids it.
  4. Check your understanding in the Math for Computing quiz, and revisit the topic if you miss a question.

Frequently asked questions

What is Hypothesis Testing?
Deciding whether data contradict a claim. It belongs to Math for Computing and is an intermediate-level topic.
Where do people use Hypothesis Testing?
A/B testing in products, clinical trials, quality control, scientific experiments and machine-learning model comparison use hypothesis tests.
What is the most common mistake with Hypothesis Testing?
A p-value is not the probability that the null is true or that the result is important, and failing to reject does not prove the null.
What should I learn before this topic?
Start with Central Limit Theorem, the topic just before it in Math for Computing.
How can I practice it?
Answer the mini quiz in the interactive lesson, then take the Math for Computing quiz.
Is Hypothesis Testing hard to learn?
It is an Intermediate topic. Be comfortable with the Beginner topics in this area first, then read the common pitfall carefully, since it is where most mistakes happen.
How long does it take to learn Hypothesis Testing?
Most learners can read the explanation and finish the interactive lesson in under an hour. Fluency comes from applying the idea, so plan a few short practice sessions with the quiz.
Which topics are related to Hypothesis Testing?
Central Limit Theorem, Confidence Intervals, Law of Large Numbers are closely connected. The full list is in the related topics section of this page.
What should I study after Hypothesis Testing?
Continue with Confidence Intervals, the next topic in Math for Computing.

Related topics