Subject
2 entries
Sample Size
Bookmarks
Fun with Stats: How Big of a Sample Size Do I Need?
Julia Evans walks through sample size calculation for experiments, grounding statistical power and significance in a concrete worked example. A good entry point for engineers who run A/B tests but haven't internalized what sample size actually buys you.
Deriving Formulas for Sample Size in A/B Tests
Mathematical derivation of the expected sample size needed in A/B tests using frequentist power analysis. Derives the N formula from effect size, significance level (α), and power (1-β) — useful for anyone designing experiments who wants to understand where 'you need at least X users' comes from.