Who this is for
- Aspiring and junior Data Analysts who need to quantify uncertainty in estimates.
- Professionals preparing to present average metrics and conversion rates with confidence intervals.
- Anyone confused about the difference between standard deviation and standard error.
Prerequisites
- Basic arithmetic and square roots.
- Understanding of mean, proportion, and standard deviation.
- Comfort with the idea of a sample vs. a population.
Why this matters
In analytics you rarely know the exact population value. You estimate it from a sample. The Standard Error (SE) tells you how far your estimate might be from the true value due to sampling variation.
- Product metrics: Reporting average session duration or revenue per user along with a margin of error.
- Marketing: Estimating conversion rate and its 95% confidence interval after a campaign.
- A/B tests: Comparing variant lifts while judging if differences exceed typical sampling noise.
Concept explained simply
Standard Error is the typical error of a statistic (like the sample mean or sample proportion) if you could repeat the sampling many times. Smaller SE means more precise estimates.
- SE of the mean (unknown population SD): SE = s / βn, where s is sample standard deviation and n is sample size.
- SE of a proportion: SE = β( p(1 β p) / n ), where p is the sample proportion.
- Margin of Error (approx 95%): β 1.96 Γ SE. Confidence Interval β estimate Β± 1.96 Γ SE.
Mental model
Imagine you re-sample your data over and over. Each time you get a slightly different mean or proportion. Those estimates form a distribution. The standard deviation of that distribution is the standard error. Increase n and the estimates cluster tighter, so SE shrinks roughly with 1/βn.
Worked examples
Example 1 β SE of a mean
Given s = 12 and n = 100, SE = 12 / β100 = 12 / 10 = 1.2.
Interpretation: Your sample mean will typically be about 1.2 units from the true mean just due to sampling.
Example 2 β SE and 95% CI for a mean
Sample mean = 50, s = 10, n = 64.
- SE = 10 / β64 = 10 / 8 = 1.25
- Approx 95% CI = 50 Β± 1.96 Γ 1.25 = 50 Β± 2.45 β [47.55, 52.45]
Example 3 β SE of a proportion
p = 0.40, n = 200.
- SE = β(0.40 Γ 0.60 / 200) = β(0.24 / 200) = β0.0012 β 0.0346
- Approx 95% MOE = 1.96 Γ 0.0346 β 0.0678 β CI β [0.332, 0.468]
Example 4 β Comparing precision by sample size
Same s = 8. Team A: n = 25 β SE = 8/5 = 1.6. Team B: n = 100 β SE = 8/10 = 0.8. Bigger n halves SE here, doubling precision.
Common mistakes and self-check
- Confusing SD with SE: SD describes spread of individual observations. SE describes uncertainty of an estimated statistic. Self-check: Am I talking about individuals (SD) or the estimate (SE)?
- Ignoring sample size: SE shrinks with βn, not n. Self-check: If I doubled n, did I reduce SE by ~29% (Γ0.707)?
- Using z=1.96 blindly: For very small n and non-normal data, a t-multiplier may be more appropriate. Self-check: Is n reasonably large (often n β₯ 30) or is the distribution near-normal?
- Rounding too early: Round at the end to avoid compounding error. Self-check: Keep 3β4 decimals in intermediate steps.
Practical projects
- Campaign conversion: From n signups and N visitors, compute p, SE, and a 95% CI. Present the estimate with MOE on a chart.
- Average order value (AOV): From sample transactions (mean and s) across a week, compute SE and a 95% CI for the mean AOV. Compare two weeks by their CIs.
- Experiment readout: For variant A and B, compute p, SE, and MOE for each. Discuss which has tighter precision and why.
Step-by-step: compute SE and a CI
- Identify your statistic: mean or proportion.
- Gather inputs: n, and either s (for mean) or p (for proportion).
- Compute SE:
- Mean: SE = s / βn
- Proportion: SE = β(p(1 β p) / n)
- Compute MOE (95%): 1.96 Γ SE (approximate).
- CI: estimate Β± MOE.
- Interpret: Emphasize uncertainty and the role of n.
Exercises
Do these now. You can compare with solutions in the toggles. Anyone can take the quick test; only logged-in users will have progress saved.
Exercise 1 β SE of mean and 95% CI
Given a sample with mean = 72, s = 15, n = 49:
- Compute SE of the mean.
- Compute an approximate 95% CI using 1.96 as the multiplier.
Show your steps and round final answers to 2 decimals.
- Expected output: SE and CI bounds.
Hints
- SE = s / βn
- MOE β 1.96 Γ SE
- CI = mean Β± MOE
Show solution
SE = 15 / β49 = 15 / 7 = 2.142857 β 2.14
MOE = 1.96 Γ 2.142857 β 4.20
CI = 72 Β± 4.20 β [67.80, 76.20]
Exercise 2 β SE of proportion and MOE
In n = 500 trials, there are 195 successes. Compute p, SE, MOE (95%), and a 95% CI.
- Expected output: p, SE, MOE, CI.
Hints
- p = 195 / 500
- SE = β(p(1 β p) / n)
- MOE β 1.96 Γ SE
Show solution
p = 195/500 = 0.39
SE = β(0.39 Γ 0.61 / 500) = β0.0004758 β 0.0218
MOE = 1.96 Γ 0.0218 β 0.0427
95% CI = 0.39 Β± 0.0427 β [0.3473, 0.4327]
Self-check checklist
- I identified the correct formula (mean vs. proportion).
- I kept at least 3 decimals in intermediate steps.
- I used βn, not n.
- I stated CI with both bounds and interpretation.
Learning path
- Now: Standard Error Basics (this page).
- Next: Confidence Intervals fundamentals.
- Then: Hypothesis testing (z- and t-tests) and A/B testing basics.
- Later: Power and sample size planning; Bayesian credible intervals (optional).
Mini challenge
A sample of n = 64 orders has mean AOV = 48 and s = 20. A separate marketing test finds p = 0.28 conversions in n = 400 visitors.
- Task 1: Compute SE and 95% CI for the mean AOV.
- Task 2: Compute SE and 95% CI for the conversion proportion.
- Bonus: Which estimate is more precise relative to its scale? Explain briefly.
Peek answers
- Mean: SE = 20/8 = 2.5; CI β 48 Β± (1.96 Γ 2.5) β 48 Β± 4.90 β [43.10, 52.90]
- Proportion: SE = β(0.28 Γ 0.72 / 400) = β0.000504 β 0.0224; CI β 0.28 Β± 0.0439 β [0.236, 0.324]
- Precision: Compare MOE to the estimate scale; the proportion has smaller absolute MOE but consider relative terms.
Next steps
- Use SE to build confidence intervals for your next report.
- Compare SEs across different sample sizes to communicate data needs.
- Move on to confidence intervals and hypothesis testing to complete the inference toolkit.
Take the Quick Test
Test your understanding below. Your score will be shown instantly. Anyone can take it for free; only logged-in users will have progress saved.