When deciding to run an A/B test, your team discusses the length of time you want to run your test for. What should you and your team do to define the time range?

✅  The correct answer is:

We should review past emails we’ve sent to see where opens and clicks start to drop off, then identify the time frame we want to test in.

Question:

When deciding to run an A/B test, your team discusses the length of time you want to run your test for. What should you and your team do to define the time range?

Solution:

  • Decide that three hours is long enough because people never check our emails after that.
  • Try to test for 24 hours to give us enough time to produce statistically significant results.
  • Three hours is too long. We should only run it for an hour so we can make our decision faster.
  • We should review past emails we’ve sent to see where opens and clicks start to drop off, then identify the time frame we want to test in.