What is AB Test Plan?

AB Test Plan is a free AI-powered tool that predicts A/B test outcomes using synthetic persona simulation. Instead of spending weeks of real traffic, you get a prediction in 60 seconds — complete with a Run/Iterate/Kill verdict, persona-by-persona reasoning, and specific iteration suggestions.

How does the A/B test prediction work?

AB Test Plan generates 6 diverse synthetic personas, each with real economic constraints (fixed budgets, time pressure), specific behavioral patterns (skepticism levels, decision styles), and existing workflow investments (switching costs). Each persona independently evaluates your control and variant, then the tool synthesizes their responses into an actionable prediction with a Run, Iterate, or Kill verdict.

Why should I trust synthetic persona predictions?

Unlike generic AI chatbots, AB Test Plan's personas have rigid constraints that force honest trade-offs — like a real person deciding whether to spend their limited budget on your tool vs. keeping their current workflow. The behavioral anchoring methodology is based on Stanford Generative Agent research and forces personas to prioritize rather than agree.

How does ICE scoring work?

ICE scoring rates each experiment idea on three dimensions: Impact (how much will this move the needle, 1-10), Confidence (how sure are you it will work, 1-10), and Ease (how easy is it to implement, 1-10). The total ICE score helps you prioritize which experiments to run first. Higher scores indicate better candidates for testing.

What frameworks does AB Test Plan use?

AB Test Plan uses ICE Scoring for prioritization, Reforge Growth Loops, Cialdini's 6 Principles of Persuasion, Fogg Behavior Model, Jobs-to-be-Done framework, loss aversion, cognitive load theory, behavioral anchoring, and trade-off forcing methodology for realistic persona simulation.

How do I calculate the right sample size for an A/B test?

The built-in calculator determines sample size based on your baseline conversion rate, minimum detectable effect (MDE), statistical significance level (typically 95%), and statistical power (typically 80%). It tells you exactly how many visitors per variation you need and how many days the test will take based on your daily traffic.

Is AB Test Plan free?

Yes, AB Test Plan is completely free. Generate experiment ideas, build hypotheses, calculate sample sizes, preview variants, and run persona predictions at no cost. No account or credit card required.

How long should I run an A/B test?

Run your test until it reaches statistical significance (typically 95% confidence) and has run for at least 1-2 full business cycles (7-14 days minimum). But first, run it through AB Test Plan's prediction simulation to make sure the test is worth running at all — 70-80% of A/B tests lose or are inconclusive.

Know before you spend traffic

One winning test pays for a year of Pro. One avoided loser pays for two.

Free

For trying the workflow on a real campaign.

3 simulations per month (up to 25 personas each)
5 asset generations per month
5 experiment idea batches per month
1 saved campaign
Landing page, email, ad copy, and social variants
ICE scoring, hypothesis builder, sample-size calculator

Start free

Run it

Pro

For growth teams running tests every week

$79/month

or $790/year (2 months free)

50 simulations per month with the full 1,000-persona panel
Segment analysis: archetypes, skepticism bands, industries
Audience calibration from your own campaign data (5 profiles)
200 asset generations per month
Unlimited saved campaigns
Clean HTML downloads (no watermark)

Get Pro

What makes the 1,000-persona panel different from asking ChatGPT?

Each persona has fixed budgets, switching costs, skepticism levels, and decision styles. They make trade-offs instead of complimenting your idea, and the panel is large enough to break results down by segment.

How does audience calibration work?

Upload past campaign results (CSV) or describe your customers. We derive who converts, who churns, and how to weight the panel, with editable weights so you stay in control. Every simulation then reacts the way your audience does.

Can I cancel anytime?

Yes. Billing is handled by Stripe and you can cancel from Settings with one click. Your campaigns and results stay accessible on the free plan.

The panel is waiting.

1,000 customers, zero traffic spent, one verdict.

Simulate my campaign