The Surprising Power of Online Experiments
Getting the most out of A/B and other controlled tests.In the fast-moving digital world, even experts have a hard time assessing new ideas. Case in point: At Bing a small headline change an employee proposed was deemed a low priority and shelved until one engineer decided to do a quick online controlled experiment—an A/B test—to try it out. The test showed that the change increased revenue by an astonishing 12%. That experience illustrates why it’s critical to adopt an “experiment with everything” approach.
Report Snap Shot
- Properly design and execute A/B and other controlled tests
- Ensure test integrity
- Interpret results and avoid pitfalls