Normal Random Variables (Adding, Subtracting, Multiplying, Dividing)
Info sheet · Statistics for Psychology & Neuroscience
Warning✎ Editing notes — to do / to check
Working notes for the author — not shown to students once collapsed; remove before publishing.
- [ ]
What you’ll get from this sheet
What happens when you combine normal random variables — and when the result stays a bell curve. By the end you should be able to:
- Give the mean and variance of \(aX+b\), and of \(X \pm Y\).
- Say why sums and differences of independent normals are still normal, but products and quotients are not.
Scale/shift a normal and it stays normal: \(aX+b \sim N(a\mu+b,\; a^2\sigma^2)\). Add or subtract two independent normals and it stays normal, with the variances adding either way: \(X\pm Y \sim N(\mu_X\pm\mu_Y,\; \sigma_X^2+\sigma_Y^2)\). Multiply or divide them and the result is not normal.
The rules
A normal random variable \(X \sim N(\mu,\sigma^2)\) is defined by its mean and variance. Combine normals and some operations preserve the bell shape while others don’t:
- Linear transform. \(aX+b \sim N(a\mu+b,\; a^2\sigma^2)\). Shifting by \(b\) moves the mean; scaling by \(a\) multiplies the SD by \(|a|\) (so the variance by \(a^2\)). Still normal.
- Sum / difference (independent \(X,Y\)). \(X\pm Y \sim N(\mu_X\pm\mu_Y,\; \sigma_X^2+\sigma_Y^2)\). The means add or subtract as you’d expect — but the variances add in both cases. Subtracting doesn’t cancel uncertainty; it compounds it. Still normal.
- Product / quotient. \(X\times Y\) and \(X/Y\) are not normal. A product of normals is skewed; a quotient is heavy‑tailed (near‑Cauchy, because the denominator can land near zero). No neat mean/variance shortcut applies.
See which operations stay normal
Two independent normals, \(X \sim N(3,1)\) and \(Y \sim N(1,1)\). Pick an operation and watch the resulting distribution — the green curve is the normal the rules predict (drawn only when the result really is normal):
The sum, difference, and linear transform all produce a clean bell curve that the green predicted‑normal traces exactly — and note the difference case: \(X - Y\) has variance \(1 + 1 = 2\), not zero. Uncertainties compound whether you add or subtract, which is why a difference score is noisier than either measurement alone. Switch to the product or quotient and the histogram goes lopsided or grows fat tails, and no normal curve fits — those operations leave the normal family entirely.
See it in code
X = 3 + randn(1e5,1); Y = 1 + randn(1e5,1);
[mean(X-Y), var(X-Y)] % ~ (2, 2)
[mean(2*X+3), var(2*X+3)] % ~ (9, 4)
histogram(X./Y, 200) % quotient: heavy-tailed, not normalThe R and Python tabs run live; MATLAB is a static reference.
TipCheck your understanding
Pre‑ and post‑test scores are each \(N(50, 100)\) and independent. What’s the distribution of the change score (post − pre)?
\(N(0,\; 200)\). The means subtract (50 − 50 = 0), but the variances add (100 + 100 = 200), so the change score has SD \(\sqrt{200}\approx 14.1\) — larger than either test’s SD of 10. That’s the key, counter‑intuitive point: taking a difference doesn’t cancel noise, it accumulates it, which is exactly why difference/change scores are noisier and why paired designs analyse them carefully.
“Variances add” only holds for independent variables — if \(X\) and \(Y\) are correlated, the variance of \(X\pm Y\) picks up a \(\pm 2\,\text{Cov}(X,Y)\) term (which is precisely how a paired t‑test gains power from positively correlated pre/post scores). And don’t assume every function of normals is normal: products and quotients aren’t, so you can’t slap a mean‑and‑SD normal onto a ratio of measurements.
Where this shows up next
These rules underlie standard errors, the CLT, and why paired designs beat independent ones. See Chapter (Foundations) and the Normal Distribution & CLT sheet.