A/B Test Significance Calculator

Enter control and variant visitors and conversions to check statistical significance, p-value, and lift. Updates instantly.

Control (A)
Variant (B)
—Control rate
—Variant rate
—Lift
—p-value
—Significant?

How to use

  1. Enter visitor and conversion counts for your control (A) and variant (B).
  2. Select your confidence level (95% is standard).
  3. Check whether the result is statistically significant and review the lift.

Frequently asked questions

What is statistical significance?

It tells you whether the difference between conversion rates is likely real or random noise. p < 0.05 at 95% confidence is the standard threshold.

What p-value should I use?

95% confidence (p < 0.05) is standard. Use 99% for high-stakes decisions.

What is lift?

Lift is the relative improvement of the variant over the control. 2% → 2.5% = +25% lift.

How many visitors do I need?

Depends on baseline conversion rate and minimum detectable effect. Lower rates need larger samples.

Last updated

Powered by maratool