Improve

Experiments without a stats degree

Test the live version of a quiz against one variant, pick the metric that matters, and read a plain summary of who is winning. Phoenix handles the math and the guardrails.

Sun exposure imagesRunning
Control · 50%Latest quiz version
Variant B · 50%v5
Viewed2,204
Started1,427
Started64.7%
Finished62.0%
Biggest dropSun exposure · 38.0%
Phoenix's reviewToo early to call. Variant B is ahead on finished, and email opt-in is holding. Check back after day 7.
Experiments · Phoenix AI
Based on my quiz stats over the past 30 days, can you recommend an experiment to improve conversion rates?
Sun Exposure loses 12.9% of shoppers, the biggest drop. The answer images look like raw screenshots. I built a variant with generated photos in the style of question 2. Shall I start a 50/50 test, protecting email opt-in?
Ask what to improve

Start with a question, not a spreadsheet

Ask the assistant what to improve. It finds the page losing the most shoppers, explains why, and builds the variant for you. You approve the test.

Start the split test

The live version against one variant

Split traffic 50/50 or set your own split. Each visitor sticks to the version they first saw. Pick the metric that decides the test and the metrics a variant must not harm.

Experiments are on Plus and Enterprise.

Decision metric
Completion rateEmail opt-in rateOrder conversionRevenue per visitand others
Protected metrics

A variant cannot win if it harms these, even when it leads on the decision metric.

Email sign-ups
Results you can trust

Guardrails, so a lucky week cannot fool you

The summary tells you who is winning, or that it is too early to say, in plain words.

At least 7 days

Every test runs a full week minimum, so weekday and weekend traffic both count.

One big order cannot tip it

A single unusually large order does not decide a revenue test on its own.

A plain summary

Who is winning, by how much, or that it is too early. No p-values to decode.

The winner goes live

End the test your way, publish in one step

When the test ends, the winner publishes and the test closes in a single step. No copying changes across by hand.

End the test
By handStop it whenever you decide.
When the result is clearPhoenix ends it once a winner is certain.
On a dateSet an end date up front.
Let the assistant decideHand the call to Phoenix.
✓ Winner publishes and the test ends in one step

Start with one quiz

You don't need a perfect plan to begin. Start small, and let Phoenix help you improve from there.