A/B Tests: How To Verify Difference In Average Order Value?
-
Hi there! When the data from an A/B test shows a difference in AOV between the variants, how do you determine if this difference is statistically probable or not? Best Regards, Martin
-
Thank you, David.
-
Perhaps this will get your on the right track, from http://flintanalytics.com/how-to-determine-if-you-should-advertise-higher-priced-goods-to-mac-users/
Average Order Value Statistical Significance
To do this you need to download the transaction data for both variants, because you need to be able to determine the variance in order value. You can download this data by going to conversions > ecommerce > transactions in Google Analytics. Once there, Google only lets you export 500 rows of transactions at one time, so to keep it simple I ensured my date ranges were under 500 transactions.
Once you get the order values for each set of customers in Excel you need to perform a t-test so that you can compare the means of the two groups. This t-test will give you the p-value that you will use to determine if the difference in average order values between the groups is significant. Yout formula in excel should look like the following:
=t.test(array of group 1, array of group 2,two-tailed distribution, two-sample equal variance homoscedastic)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
PDF best practices: to get them indexed or not? Do they pass SEO value to the site?
All PDFs have landing pages, and the pages are already indexed. If we allow the PDFs to get indexed, then they'd be downloadable directly from google's results page and we would not get GA events. The PDFs info would somewhat overlap with the landing pages info. Also, if we ever need to move content, we'd now have to redirects the links to the PDFs. What are best practices in this area? To index or not? What do you / your clients do and why? Would a PDF indexed by google and downloaded directly via a link in the SER page pass SEO juice to the domain? What if it's on a subdomain, like when hosted by Pardot? (www1.example.com)
Reporting & Analytics | | hlwebdev1 -
Avg Page Load Time (sec) Comppared to site average - what does it mean?
Hi All, In google analytic In Site Speed -> Page Timings we have two columns a) Page Views & b) Avg Load Time (sec) compared to site average. Now in "b" column I am able to below % one in green and another in brown so what does it mean? Can anyone please explain me? Image attached Thanks! bNbBA
Reporting & Analytics | | amu1230 -
How to do Google Multivariate Testing via Google Tag Manager with Universal Analytic?
Hello All, How to do Google Multivariate Testing via Google Tag Manager with Universal Analytic? Thanks!
Reporting & Analytics | | dsouzac0 -
Www.google-analytics.com/analytics.js what is this link doing on my website?
Hello Expert, I am using google tag manager and google analytic is already configured in that now i just want to confirm when i do inspect element of my home page in that i can see this link - http://www.google-analytics.com/analytics.js where as if i do view source of my page then it is not visible. so what is this link - www.google-analytics.com/analytics.js and what role it play? Do we really need this link to be present on website? Regards, Raghuvinder
Reporting & Analytics | | raghuvinder0 -
How to find goo.gl/ URLs in Google Analytics
Hello! How does one go about finding the impact of goo.gl/ shortened URLs in Google Analytics? (I know I should be using Campaigns, but this was for an old project.) Thanks in advance! Erik
Reporting & Analytics | | SmileMoreSEO0 -
Testing IP Exclusion Filters in Google Analytics
(I hope I haven't missed something simple 😉 I have add IP exclusion filters in Google Analytics. What I haven't been able to determine is how to test to see if it is working. I'd imagine there would be a dip in traffic but if a site is low volume it might not even register. Thanks!
Reporting & Analytics | | AUDigitalMarketing0 -
Switching Blog to domain/blog... worth it?
So we have a great business. Let's say: Service.com. And years ago we launched a great blog. Let's call it ServiceDiscussion.com. So, both are PR5 sites. The BUSINESS gets about 50k page views a month. But the BLOG is getting about 100k page views a month. So, my question is... is it time to fold the blog into the business domain? Let's say we did a 301 redirect and turned it into Service.com/blog. We'd be folding all this extra traffic into the business domain. Would the google juice be worth doing this?
Reporting & Analytics | | brianmcc0 -
Seeing / and no / in Google Analytics
When I look at my Google Analytics code, I see that the same content will show up twice, once with a / at the end of the URL, and once without. My site is at http://www.skypeenglishclasses.com. Does anyone know why this would happen? Is it duplicate content?
Reporting & Analytics | | Paulguy0