We plan to bring eChai across 100 cities in India. It starts with eChai Startup Demo Day on 26 September, all in person. 11 cities confirmed, 158 founders registered. Any city that reaches 20 interested founders is on too. See your city
Build your online store

I barely get 500 visits a week. What should I A/B test first, and can I even trust the results?

At low traffic, your first move isn't a split test - it's a structured audit that fixes the obvious, high-confidence leaks (broken mobile add-to-cart, missing trust signals, slow load, a confusing checkout) without testing them; you don't need statistics to know a 6-second load time is bad. Save real A/B tests for genuinely ambiguous, high-impact bets, and don't call a winner early - CXL's rough rule of thumb is 350+ conversions per variation before you trust a result, which at 500 visits/week can take months. Most testing tools will happily flag 'significance' at 40 conversions; that's noise, not truth.

Go deeper

4 resources, 2 link-checked.

🛠️ Tool
✓ Link checked Freemium Intermediate

Instead of guessing what to test, GoodUI hands you patterns backed by hundreds of real A/B tests across ecommerce and SaaS sites - the fastest way to build a low-traffic-friendly test backlog with evidence behind it.

GoodUI - A/B Tested Patterns for Higher Conversion

From goodui.org by GoodUI

  • 141 documented UI patterns based on 627 compiled A/B tests (counts grow as more tests are added).
  • Each pattern shows the underlying test data, not just the idea, so you can judge confidence before building it.
  • Useful as a running idea backlog once you've fixed the obvious usability issues.
Open goodui.org
📋 Template
✓ Link checked Free Beginner

A free, structured audit across homepage, PDP, cart, checkout, mobile and speed - the checklist to run yourself in an afternoon before spending a rupee on tools or tests.

148-Point Shopify CRO Audit Checklist

From cleancommit.io by Clean Commit

  • 148 checks spanning homepage, product pages, cart, checkout, mobile UX and site speed.
  • Built to take roughly 2-3 hours to run end to end.
  • Use it to find your single biggest leak before choosing your first A/B test.
Open cleancommit.io
📄 Article
Free Intermediate

The most rigorous free explainer on running valid tests without fooling yourself with noise - essential reading before you're tempted to call a test 'significant' after 40 conversions.

What Is A/B Testing? The Complete Guide: From Beginner to Pro

From cxl.com by CXL

  • Calculate sample size ahead of time rather than eyeballing a dashboard - a rough rule of thumb is 350+ conversions per variation before trusting a result.
  • Conversion research, not guessing, is what generates test ideas actually worth running.
  • Test the biggest friction point you can find, not the ten-minute button-color change.
Open cxl.com
🎓 Course
Paid Advanced

The closest thing to a structured, practitioner-built curriculum in CRO - 20 courses across research, testing and psychology for a founder ready to move past ad-hoc fixes into an actual testing program.

Conversion Optimization Minidegree

From cxl.com by CXL Institute

  • Covers conversion research methodology, A/B testing statistics and behavioural psychology across roughly 20 courses.
  • Built for marketers and growth leads who want to run a real experimentation program, not just one-off tests.
  • A genuine time and money investment - worth it once you have enough traffic to actually run tests on.
Open cxl.com

People also ask

Also in Starting Up

The same ground, over in Brand, web & content, our Starting Up track.

eChai Partner Brands