Probability basics: counting, conditional probability, Bayes

12 steps · about 5 h 40 min · Beginner

  1. Seeing Theory: A visual introduction to probability and statistics (interactive, Brown University (Daniel Kunin), 40 min)

    Start by playing with coins, dice and sample spaces so that probability as a long-run fraction makes sense before any formulas.

  2. Counting, permutations, and combinations (tutorial, Khan Academy, 1 h 30 min)

    Counting outcomes is the foundation for equally-likely probability, so learn the counting principle, factorials, permutations and combinations first.

  3. Probability and combinatorics (tutorial, Khan Academy, 45 min)

    Apply counting to real probabilities such as card hands and lotteries, using combinations in the numerator and denominator.

  4. Conditional probability and independence (article, Khan Academy, 15 min)

    Introduces P(A|B) and shows how it tells you whether two events are independent.

  5. Calculate conditional probability (practice) (interactive, Khan Academy, 15 min)

    Practise the definition on concrete tables before moving on to Bayes' rule.

  6. Conditional probability with Bayes' Theorem (video, Khan Academy (Brit Cruise), 10 min)

    A short tree-diagram view shows how Bayes' rule re-weights outcomes once you learn new information.

  7. 2.2: Conditional Probability and Bayes' Rule (reference, LibreTexts Statistics (Saint Mary's College), 40 min)

    A college-text treatment with worked examples that formalises the definition, the multiplication rule and Bayes' rule.

  8. Bayes theorem, the geometry of changing beliefs (video, 3Blue1Brown, 16 min)

    Builds a geometric picture of Bayes' rule as updating beliefs, and shows where human intuition goes wrong.

  9. The quick proof of Bayes' theorem (article, 3Blue1Brown, 8 min)

    Now that you have the intuition, see the short algebraic reason it is true: P(A and B) can be unpacked in two ways.

  10. Monty Hall Problem: Solution Explained Simply (article, Statistics How To, 15 min)

    Test your skills on a famous counterintuitive puzzle that Bayes' rule resolves.

  11. The medical test paradox, and redesigning Bayes' rule (video, 3Blue1Brown, 21 min)

    Apply Bayes' rule to false positives and base rates, then try the odds and Bayes-factor form.

  12. Bayes' theorem (reference, Wikipedia, 25 min)

    Finish with a reference page covering the formula, its history and further applications you can read later.