Questions created by ted-zarceczny
-
When to determine that a change DIDN'T affect conversion rates
Hi everyone, Description of test: We're a lead gen site trying to add more value by providing users with real, live quotes after they submit a lead. However, we don't want showing the quotes to tank our lead conversion rates. So we're running a test where 50% of leads see quote results and 50% don't, and we compare the lead conversion rates for each. The best possible outcome is to show that showing the quotes DIDN'T negatively affect conversion rates. My issue: When do we conclude the test? In the end, we're hoping to see that the change didn't cause a statistically significant difference between the control and version B, which is the opposite of every other test I've ever run. So, at what point do we conclude that the changes in version B didn't have a significant effect on lead conversions? Currently the control is doing 5% better than the variation with a p-value of .379
Conversion Rate Optimization | | ted-zarceczny0 -
Flux in Bing/Yahoo search rankings?
Has anyone else noticed any flux in Bing/Yahoo desktop search rankings in the start of March? Our weekly MSN search traffic was steady and then starting dropping off around March 3 or 4. Weekly desktop traffic now down about 20% Anyone see anything similar or have any resources for learning more about this?
Algorithm Updates | | ted-zarceczny0