Probability basics

Probability puts a number from 0 (impossible) to 1 (certain) on how likely something is, and the chances of all possible outcomes add up to 1. A fair coin lands heads with probability 0.5; two heads in a row has probability 0.5 × 0.5 = 0.25. A language model's output is a probability for every possible next word.

Why it matters: A language model is, at heart, a machine for assigning probabilities to the next piece of text.

Learn it, then prove it

Sign in (free) to take this step's mastery check and save your journey.