Glossary · Conversion

Minimum Detectable Effect (MDE)

Definition

Minimum detectable effect is the smallest change between test groups that an experiment is designed to detect reliably with its planned sample size.

Also called: MDE, minimum detectable lift

Before a test begins, you choose how small a lift you care about detecting. That choice is the minimum detectable effect. It is usually written as a relative change against the baseline, such as a 10% lift in conversion rate. Together with your baseline rate, significance level (often 95%) and statistical power (often 80%), the MDE decides how many visitors each variant needs.

The relationship is steep. Detecting a small effect takes far more traffic than detecting a large one: halving the MDE roughly quadruples the sample size needed.

Why it matters for eCommerce

MDE is the reality check that stops wasted tests. If your product page gets modest traffic, a test of button color aimed at a 2% lift may need months of traffic to reach a reliable answer. Knowing the MDE up front tells you whether a test is worth running, whether to test a bolder change, or whether to test on a higher-traffic page or a higher-funnel metric instead.

How it works in practice

Relative MDE = (target variant rate − baseline rate) ÷ baseline rate. For example (illustrative numbers): a collection page converts at 3.0% and you want to detect a lift to 3.3%. That is a relative MDE of (3.3 − 3.0) ÷ 3.0 = 10%. Enter the baseline, MDE, significance and power into a sample size calculator to get the visitors needed per variant, then divide by your daily traffic to estimate how long the test must run. If the answer is many months, raise the MDE by testing a bigger change.

Common mistakes

  • Skipping the calculation and running tests that could never reach a clear result.
  • Setting the MDE to whatever makes the test finish quickly, rather than the smallest lift worth acting on.
  • Treating a non-significant result as proof of no effect, when the test was only able to detect large changes.

Put the numbers to work

Our free calculators turn these definitions into your numbers, and the Free Profit Audit shows which ones cost you the most.

Free Profit Audit