A/B Testing Blog

Practical guides on experiment planning, statistical methods, and conversion rate optimization frameworks.

Ideas9 min read

47 A/B Test Ideas That Actually Lift Conversions (2026)

A curated bank of 47 high-impact A/B test ideas for landing pages, checkout, pricing, CTAs, and email — each with the psychology behind why it works and an ICE-style impact estimate.

A/B test ideasconversion optimizationexperiment backlog
Read more
Statistics8 min read

9 A/B Testing Statistics Mistakes That Wreck Your Results

The statistics errors that make A/B test results lie: peeking, p-hacking, ignoring power, misreading confidence intervals, multiple comparisons, and more — explained simply with fixes.

A/B testing statisticsstatistical significancep-value
Read more
Strategy8 min read

Why Most A/B Tests Fail (and How to Spot Losers Early)

Roughly 70-80% of A/B tests don't produce a winner. Here are the real reasons tests fail — weak hypotheses, underpowered samples, peeking, local maxima — and how to catch losers before you waste traffic.

A/B testingexperiment failurestatistical power
Read more
Statistics5 min read

How to Calculate Sample Size for an A/B Test

Learn the exact formula and inputs needed to calculate the right sample size for your A/B test. Covers baseline rate, MDE, significance, power, and common mistakes.

sample sizestatistical significancepower analysis
Read more
Statistics5 min read

How Long Should You Run an A/B Test?

The definitive guide to A/B test duration. Learn why minimum runtime matters, how to calculate it, and the costly mistakes teams make by stopping too early.

test durationstatistical significancepeeking problem
Read more