Probability Basics- Essential Concepts and Problem-Solving Strategies
What Probability Actually Is
Probability measures how likely something is to happen. That's it. No philosophical musings needed.
You express it as a number between 0 and 1. Zero means impossible. One means certain. Everything else falls somewhere in between.
Most people encounter probability through gambling, weather forecasts, or statistics classes. But it shows up everywhere—medical tests, insurance premiums, sports predictions, even Netflix recommendations.
The Building Blocks You Need First
Sample Space
The sample space is every possible outcome of an experiment. Roll a die? Your sample space is {1, 2, 3, 4, 5, 6}. Flip a coin? {Heads, Tails}.
Getting this right matters. Mess up your sample space and everything downstream falls apart.
Events
An event is a subset of the sample space. "Rolling an even number" is an event: {2, 4, 6}. "Rolling a 3" is an event: {3}.
Events can be simple (one outcome) or compound (multiple outcomes). They can also be mutually exclusive or independent—more on that shortly.
Probability of an Event
For equally likely outcomes, the formula is straightforward:
P(Event) = Number of favorable outcomes / Total number of outcomes
Roll a fair die. What's the probability of rolling a 4?
One favorable outcome (the 4) divided by six total outcomes. P(4) = 1/6 ≈ 0.167
The Three Types of Probability
1. Classical Probability
Uses logic to determine outcomes before they happen. Coin flips, dice rolls, card draws—ideal situations where all outcomes are equally likely.
Works great in theory. Falls apart when outcomes aren't equally likely, which is most real-world situations.
2. Experimental (Empirical) Probability
Based on actual experiments and observations. Flip a coin 1,000 times, record the results, calculate the ratio.
P(Event) = Frequency of event / Total experiments
This is how actuaries figure out life expectancy. It's how casinos know the house edge. Reality-based.
3. Subjective Probability
Your personal judgment about how likely something is. "There's a 70% chance it rains tomorrow." That's not math—that's a forecast based on experience, data, and intuition.
Valuable in business and decision-making. Useless for rigorous calculations.
Key Probability Rules You Can't Ignore
The Addition Rule
Used when you want the probability of this OR that happening.
P(A or B) = P(A) + P(B) - P(A and B)
Draw a card from a deck. What's P(King or Red)?
P(King) = 4/52. P(Red) = 26/52. P(King and Red) = 2/52 (only red kings).
Answer: 4/52 + 26/52 - 2/52 = 28/52 ≈ 0.538
You subtract the overlap because you counted those cards twice.
The Multiplication Rule
Used when you want the probability of this AND that happening.
For independent events (one doesn't affect the other):
P(A and B) = P(A) × P(B)
Flip two coins. What's P(Heads and Heads)?
0.5 × 0.5 = 0.25
For dependent events (one affects the other):
P(A and B) = P(A) × P(B|A)
Draw two cards without replacement. What's P(Both Aces)?
P(First Ace) = 4/52. P(Second Ace | First was Ace) = 3/51.
Answer: (4/52) × (3/51) ≈ 0.0045
Complementary Events
The complement of an event is everything except that event.
P(not A) = 1 - P(A)
Roll a die. What's P(Not a 3)?
1 - 1/6 = 5/6 ≈ 0.833
This shortcut saves time. Instead of counting all the favorable outcomes, calculate the complement and subtract from 1.
Conditional Probability: When One Thing Affects Another
Conditional probability asks: what's the probability of B given that A already happened?
Notation: P(B|A)
You have a jar with 5 red marbles and 3 blue marbles. You pick one, don't put it back, then pick another. What's P(Second is Blue | First is Red)?
After removing a red, you have 5 blue and 2 red left. Seven marbles total.
P(Blue | Red removed) = 5/7 ≈ 0.714
This matters in medical testing, quality control, and anywhere past events influence future outcomes.
Expected Value: What You Actually Expect to Happen
Expected value multiplies each outcome by its probability and sums them up.
E(X) = Σ [Outcome × Probability]
Flip a coin. Heads you win $3, Tails you lose $2.
E = (0.5 × $3) + (0.5 × -$2) = $1.50 - $1.00 = $0.50
On average, you gain 50 cents per flip. Over 1,000 flips, you'd expect around $500.
This is how insurance companies price policies. It's how casinos ensure profit. It's how you evaluate any risky decision.
Common Probability Mistakes (And How to Avoid Them)
- Ignoring replacement: Drawing cards without replacing them changes the probabilities. Always check whether events are dependent.
- Overlapping events: Forgetting to subtract the overlap when using the addition rule. Draw a Venn diagram if you need to.
- Assuming independence: Weather on consecutive days isn't independent. Neither are stock prices. Know when events affect each other.
- Confusing odds with probability: Odds of 3:1 mean 1 success per 4 attempts (P = 0.25). Not the same as probability 0.3.
- Gambler's fallacy: The roulette wheel hit red 10 times. That doesn't mean black is "due." Each spin is independent.
Probability Tools and Methods Compared
| Method | Best For | Limitations |
|---|---|---|
| Tree Diagrams | Sequential events, dependent probabilities | Gets messy with many branches |
| Counting Principles | Large sample spaces, combinations/permutations | Easy to miss arrangements |
| Venn Diagrams | Visualizing overlaps, addition rule | Only works cleanly for 2-3 events |
| Bayes' Theorem | Reversing conditional probabilities | Requires accurate prior probabilities |
| Simulation | Complex situations, no closed-form solution | Approximation only, needs computing power |
Getting Started: How to Solve Any Probability Problem
Follow this sequence every time:
Step 1: Define Your Experiment
What actually happens? One coin flip? Drawing a card? Two dice?
Step 2: List the Sample Space
Write out every possible outcome. Use a diagram if needed.
Step 3: Identify What You're Looking For
Is it P(A or B)? P(A and B)? P(A|B)? Conditional? Expected value?
Step 4: Choose the Right Formula
Match your problem type to the appropriate rule. Don't force a problem into the wrong framework.
Step 5: Calculate and Simplify
Plug in numbers. Reduce fractions. Convert to decimals or percentages if helpful.
Step 6: Check Your Work
Is the answer between 0 and 1? Does it make intuitive sense? Can you verify with a different method?
Quick Reference: Core Formulas
- P(A) = Favorable / Total
- P(not A) = 1 - P(A)
- P(A or B) = P(A) + P(B) - P(A and B)
- P(A and B) = P(A) × P(B) [independent]
- P(A and B) = P(A) × P(B|A) [dependent]
- P(B|A) = P(A and B) / P(A)
- E(X) = Σ [x × P(x)]
Print these. Memorize these. They're the toolkit. Everything else is just applying them correctly.