Probability Fundamentals- Basic Concepts and Applications

What Probability Actually Is

Probability measures how likely something is to happen. That's it. No fancy definitions needed.

You express it as a number between 0 and 1. Zero means impossible. One means guaranteed. Everything else falls somewhere in between.

You'll also see probability written as percentages (0% to 100%). Same thing, different format.

The Building Blocks You Need First

Before you can do anything useful with probability, you need to understand these terms:

Visualizing Sample Space

Think of sample space as your universe of possibilities. Everything else in probability builds from this foundation.

Three Ways to Calculate Probability

1. Classical Probability

Use this when you know all possible outcomes and they're equally likely.

Formula: P(Event) = Number of favorable outcomes / Total number of possible outcomes

Example: What's the probability of rolling a 3 on a fair six-sided die?

2. Empirical (Experimental) Probability

Use this when you don't know the theoretical odds—you calculate them from real data.

Formula: P(Event) = Number of times event occurred / Total number of trials

Example: You flip a coin 100 times and get 42 heads. Empirical probability of heads = 42/100 = 0.42

This is how statisticians actually work most of the time. You collect data, then calculate what happened.

3. Subjective Probability

This is your educated guess based on judgment or experience. Weather forecasters use this. Sports analysts use this. It's not mathematical—it's practical.

"There's a 70% chance it rains tomorrow" is subjective probability. You can't run experiments on tomorrow's weather.

The Rules That Actually Matter

Complement Rule

The probability of something not happening equals 1 minus the probability it does happen.

P(not A) = 1 - P(A)

If there's a 30% chance of rain, there's a 70% chance it stays dry. Simple.

Addition Rule

Use this when you want the probability of either event happening.

For mutually exclusive events (they can't happen together):

P(A or B) = P(A) + P(B)

Rolling a 2 OR a 4 on a die: 1/6 + 1/6 = 2/6 = 1/3

For non-mutually exclusive events (they can overlap):

P(A or B) = P(A) + P(B) - P(A and B)

Drawing a face card OR a heart from a deck: 12/52 + 13/52 - 3/52 = 22/52

Multiplication Rule

Use this when you want the probability of both events happening.

For independent events (one doesn't affect the other):

P(A and B) = P(A) × P(B)

Probability of flipping heads twice in a row: 0.5 × 0.5 = 0.25 (25%)

For dependent events (one affects the other):

P(A and B) = P(A) × P(B|A)

P(B|A) means "probability of B given that A already happened."

Conditional Probability Explained

Conditional probability is the probability of an event occurring given that another event has already occurred.

Notation: P(B|A) reads as "probability of B given A"

Example: You draw two cards from a deck without replacement. What's the probability both are kings?

The second probability changed because you already removed a king from the deck.

Independence: Does One Thing Affect Another?

Two events are independent if knowing one happened doesn't change the probability of the other.

Examples of independent events:

Two events are dependent if knowing one changes the probability of the other.

Expected Value: What Will You Get on Average?

Expected value is the long-term average if you repeated an experiment many times.

Formula: E(X) = Σ (each outcome × its probability)

Example: A game costs $5 to play. You win $20 if you roll a 6 on a fair die, otherwise nothing.

On average, you lose $1.67 per game. Casinos love expected value.

Common Probability Distributions

Binomial Distribution

Use when you have exactly two outcomes (success/failure), fixed number of trials, constant probability, and independent trials.

Examples: Flipping coins, yes/no survey responses, pass/fail tests.

Formula: P(X = k) = C(n,k) × p^k × (1-p)^(n-k)

Where n is trials, k is successes, p is probability of success.

Normal Distribution

The famous bell curve. Used for heights, test scores, measurement errors, and many natural phenomena.

Defined by two parameters: mean (center) and standard deviation (spread).

About 68% of data falls within one standard deviation of the mean. 95% within two. 99.7% within three.

Poisson Distribution

Use for counting events that happen independently over a fixed interval of time or space.

Examples: Number of emails per hour, accidents per month, customers arriving per minute.

Comparing Probability Types

Type Best Used When Requirements Example
Classical All outcomes equally likely Know all possible outcomes Rolling dice, coin flips
Empirical Have historical data Collected observations Sports statistics, insurance
Subjective No data available Expert judgment Weather forecasts, betting odds

How to Calculate Probability: Getting Started

Follow these steps for any probability problem:

Step 1: Define Your Experiment

What are you actually doing? Be specific.

Step 2: List the Sample Space

Write out or count every possible outcome.

Step 3: Identify Your Event

What specific outcome or set of outcomes are you interested in?

Step 4: Choose the Right Formula

Step 5: Calculate and Interpret

Do the math. Check that your answer is between 0 and 1. If it's not, you made a mistake.

Where You'll Actually Use This

Common Mistakes to Avoid

Quick Reference Formulas

These are the tools you need. Practice with real problems until the logic becomes automatic.