Explore / Market and grow / A/B testing
A/B testing · checked 11 November 2026
Change one thing, decide the win and the sample size before you start, split traffic at random, and do not stop the test early.
Write a hypothesis, pick one metric and work out how many visitors you need, because stopping the moment a result looks significant produces false winners. Google Optimize closed on 30 September 2023; GrowthBook is free for up to 3 users and PostHog runs experiments on a free monthly allowance. If your traffic is too low to reach the number, test bigger changes or talk to users instead.
The steps 3 answers
- How do I run an A/B test? Starting Up
- I barely get 500 visits a week. What should I A/B test first, and can I even trust the results? D2C
- How do I run a growth experiment properly when my user numbers are too small for statistical significance? Starting Up
Tools that do it for you
The readingMost used across these answers
- What to Do When You Don't Have Enough Traffic to A/B Test Read · 2 answers
- The Case Against A/B Testing at Early-Stage Startups Read
- How Not To Run an A/B Test Read
- [Sunset September 2023] Google Optimize Read
- A/B test titles and thumbnails (YouTube Test & compare) Read
- About A/B testing for Meta Ads Read
- What Is A/B Testing? The Complete Guide: From Beginner to Pro Read
- 148-Point Shopify CRO Audit Checklist Use
- Conversion Optimization Minidegree Use
The terms
eChai Partner Brands
The partnership →
