Make real-time collaboration a breeze

A/B Testing Plan Template

A. Hypothesis

The key part of a A/B test is formulating your hypothesis as this basically guides the whole A/B test plan. In formulating the hypothesis, first you need to define the problem you want to solve. Then you need to make a hypothesis as in what causes those bottlenecks and what you can do to improve. It’s also important to plan how you are going to measure your results.

• Problem: What problem are we trying to solve with this experiment? Its impact?
• Hypothesis: Describe a change you’d like to testAmy
• SteveResult and success metrics: What is the hypothesised result? How are you going to measure it?

Developers Work Required

In this section, layout the items that the engineering team would need to provide help on. Link to related tasks here so you can see the progress easier.

Trello

Development tasks for Experiment ABC

C.Results & Learnings

So at the end of the planned experiment period, you get all the stats but does a better conversion rate for one variation really conclude that variation is really better? You need to run a test of statistical significance to see whether your results are really statistically significant.

Document any learnings you got from this experiment so that it can help you better plan your future ones.