A/B Tests: How To Verify Difference In Average Order Value?
-
Hi there! When the data from an A/B test shows a difference in AOV between the variants, how do you determine if this difference is statistically probable or not? Best Regards, Martin
-
Thank you, David.
-
Perhaps this will get your on the right track, from http://flintanalytics.com/how-to-determine-if-you-should-advertise-higher-priced-goods-to-mac-users/
Average Order Value Statistical Significance
To do this you need to download the transaction data for both variants, because you need to be able to determine the variance in order value. You can download this data by going to conversions > ecommerce > transactions in Google Analytics. Once there, Google only lets you export 500 rows of transactions at one time, so to keep it simple I ensured my date ranges were under 500 transactions.
Once you get the order values for each set of customers in Excel you need to perform a t-test so that you can compare the means of the two groups. This t-test will give you the p-value that you will use to determine if the difference in average order values between the groups is significant. Yout formula in excel should look like the following:
=t.test(array of group 1, array of group 2,two-tailed distribution, two-sample equal variance homoscedastic)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Recover/Claim Ownership of a Google Analytics Account in easy steps
Hi All, I just found this useful article on Recover/Claim Ownership of a Google Analytics Account , I've seen same question asked by website owners, webmasters very frequently in many forums so I decided to share the article. **No affiliation, sponsorship, nor any partnerships with ohow.co Thanks
Reporting & Analytics | | Alick3000 -
Gets traffic on both domain.dk and domain.dk/default.asp
Hi. Im runnning a couple of sites. And in my analytics/webmastertool I get both traffic on domain.dk and domain.dk/default.asp which are both essentially the same page. I'm pretty sure it would be better, if I somehow could make the default.asp "redirect" to "/". I dont wanna loose the linkjuice thou. Any smart suggestions for an easy fix? /Kasper
Reporting & Analytics | | KasperGJ0 -
Difference between External Followed Links and Total External Links?
Hello, could someone please elaborate on what is meant by "External Followed Links" vs. "Total External Links"? Does "External Followed Links" mean the number of links that are generating traffic to the site? Or is there some other way to conceptualize it? Any help would be appreciated! Thank you in advance.
Reporting & Analytics | | lincolndigitalgroup1 -
Google Analytics Goals - Different Domain
Hi, We currently need to setup a goal that involves a different domain. Any guidance would be greatly appreciated. more info: the checkout process is redirected to a secure.domain Just let me know if I can provide any additional info that may helpful.
Reporting & Analytics | | opusvo0 -
Difference in incoming links between web masters tool and moz
Why are incoming links to my site in Google Webmasters tools totally different then in MOZ? Which is correct? According to Google as of this week I have hundreds of links coming from linkarena (dot) com (Never heard) Does any one know who they are or if they are hurting me? I definitely did not pay them to put me on there. It looks like a German site. Thank you.
Reporting & Analytics | | omakad0 -
Which Algorithm Change Hurt the Site? A causation/correlation issue
The attached graph is from google analytics, a correlation of about 14 months of Organic Google visits with algo changes, data from moz naturally 🙂 Is there any way to tell from this which will have affected the site? for example #1 or #2 seems to be responsible for the first dip, but #4 seems to fix it and it broke around 6, or is the rise between 4 and 7 an anomaly and actually 1 or 2 caused a slip from when it was released all the way to when 7 was released. Sorry if the graph is a little cloak and dagger, that is partly because we don't have permissions to reveal much about the identity, and partly because we were trying to do a kind of double blind, separating the data from our biases 🙂 We can say though the different between the level at the start and end of the graph is at least 10,000 visits per day JarMzoK.png
Reporting & Analytics | | Fammy0 -
Number of clicks / organic traffic - different data in Google Analytics and Webmaster Tools
Hi. I have a little problem. When I open Google Webmaster Tools I see 3000 clicks (in Traffic - Search queries - Clicks). But when I open Google Analytics I see much more visits from search engine (Google) - it´s 4-5 times more! It´s a huge difference, don´t you think? Do you know, where is the problem? What causes this diffence? thanks a lot
Reporting & Analytics | | mysho0 -
Core audience, daily / weekly uniques
In Google analytics or site catalyst, is there anyway to target IP addresses to see how many of my daily uniques are daily, weekly, monthly and what % are just 'tourists'/'one-offs'? My site is a local news site... Or is there another way to find this info. I am trying to work out what my core audience is (that keeps coming back every day or every week). Kind regards
Reporting & Analytics | | MirandaP0