Peeking

Peeking is a problem in A/B testing when the user of an A/B testing tool keeps looking at the latest results and decides to continue/stop the experiment based on the latest reported significance.

Solutions:
 * Don't look at intermediate results
 * Look but adjust the significance threshold lower each time