Conditional Probability - Probability Given Prior Knowledge
Conditional probability is the probability of an event occurring given that another event has already occurred. It is one of the most important and widely applied ideas in the whole of probability, used in medicine, spam filters, weather forecasting, and legal reasoning.
Notation and Formula
P(B | A) is read as "the probability of B given A". It means: assuming A has already happened, what is the probability that B also happens?
P(B | A) = P(A and B) ÷ P(A)
Rearranging: P(A and B) = P(A) × P(B | A)
This second form is called the General Multiplication Rule and works for both independent and dependent events.
When Is P(B | A) = P(B)?
If A and B are independent, knowing A occurred gives no information about B, so P(B | A) = P(B). This is actually the mathematical definition of independence.
Worked Examples
After one red is removed: 3 red remain out of 9 total.
P(red 2nd | red 1st) = 3/9 = 1/3.
P(red 1st and red 2nd) = P(red 1st) × P(red 2nd | red 1st) = 4/10 × 3/9 = 12/90 = 2/15.
Given the student is a boy (18 boys total), 10 of them play sport.
P(plays sport | boy) = 10/18 = 5/9 ≈ 0.556.
P(A | B) = P(A and B) ÷ P(B) = 0.2 ÷ 0.4 = 0.5. Since P(A | B) = P(A), A and B are independent.
P(B | A) = 0.2 ÷ 0.5 = 0.4. Since P(B | A) = P(B), confirmed independent.
Real-World Application: Medical Testing
Suppose a disease affects 1% of a population and a test for it is 99% accurate. Even with a positive result, the probability of actually having the disease (conditional probability) may be much lower than you expect – this is a famous result known as the base rate fallacy, and conditional probability is the tool that reveals the truth.
Key Takeaways
- P(B | A) = P(A and B) ÷ P(A) – the probability of B given A has occurred.
- General multiplication rule: P(A and B) = P(A) × P(B | A).
- If P(B | A) = P(B), then A and B are independent.
- Conditional probability is essential for dependent events and real-world reasoning under uncertainty.
Practice Questions
- A bag has 5 red and 3 green balls. Two are drawn without replacement. Find P(green 2nd | red 1st).
- P(A) = 0.6, P(A and B) = 0.3. Find P(B | A).
- In a class, 40% play football and 25% play both football and tennis. Find P(tennis | football).
- A card is drawn from a deck; it is a face card. Find the probability it is a King, given it is a face card. (12 face cards: 4 Kings, 4 Queens, 4 Jacks.)
- Explain in your own words why knowing that A has occurred can change the probability of B.