How to hold a variable constant for an A/B test
-
For example, let's say you want to A/B test a title tag change. You are hoping to identify whether a title tag change increases CTR. But, position is always fluctuating a bit and that affects CTR, too. So, I'm interested in how you could hold position constant in order to isolate the change in CTR that is due to the title tag change. Does anyone know of resources/tools/tutorials for how to do this?
It's been... a very long time since I took statistics (-: I have access to Excel, MS Access, and R studio.
-
Thanks for the reply. I'll check out the links you included.
I thought it might be helpful to show an example of what got me thinking along these lines. This is a study about A/B testing of title tag changes. They don't say they accounted for position fluctuation; maybe they didn't, but it seems like you'd have to in order to have meaningful results.
-
I don't see a way of doing this accurately. With organic rank fluctuations, seasonality, competition it's near impossible to "hold" a position. However, if you have a position in serps for a specific keyword with little fluctuation and get decent traffic you can establish this as your baseline. Once the title is updated and appears in the serps, begin monitoring w/search console, analytics or etc. and see if you see any decent jumps. Some links for additional information: Finding the ROI of Title tag changes using Google's CausalImpact R package, SEO Split Testing & A Beginner’s Guide to A/B Testing: Effective SEO Landing Pages. Would love to hear if anyone else has a better way.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
301 Redirect Only Home Page/Root Domain via Domain Registrar Only
Hi All, I am really concerned about doing a 301 redirect. This is my situation: Both Current and New Domain is registered with a local domain registrar (similar to GoDaddy but a local version) Current Domain: Servers are pointing to Wix servers and the website is built and hosted with Wix I would like to do a 301 redirect but would like to do it in the following way with a couple of factors to keep in mind: 99% of my link are only pointed to the home page/root domain only. Not to subdirectories. New Domain: I will register this with wix with a new plan but keep the exact sitemap and composition of current website and launch with new domain. Current Domain: I want to change server pointing to wix to point to local domain registrar servers. Then do a 301 redirect for only the home page/root domain to point to the new domain listed with wix. So 301 is done via local registrar and not via Wix. Another point to mention is it will also change from Http to Https as well as a name change. Your comments on the above will be greatly appreciated and as to whether there is risk in trying to do a 301 redirect as above. Doing it as above it also cheaper if I do the 301 via the wix platform I will need to register a full new premium plan and run it concurrently to the old plan whereas if I do it as mentioned above will only have the additional domain annual fee. Look forward to your comments. Mike
Intermediate & Advanced SEO | | MikeBlue10 -
Hold Off on SEO Changes After Domain Migration?
We migrated our domain on April 4th. Our domain authority has dropped from 22 to 8. Traffic is down from 90 visits a day to 10. Search console has indexed about 120 out of 600 pages. I have been told it may take several months to recovers some element of domain authority. My SEO consultant has planned on implementing the following changes immediately: 1. Change in URL structure
Intermediate & Advanced SEO | | Kingalan1
2. Build internal links (my site has very few).
3. Optimize URLs for specific keywords
4. Keyword optimization of URLs using Yoast.
5. Modify Schema Do we risk confusing Google further by making these changes until are domain authority and traffic has recovered? Is it safe to proceed with some "softer" changes such building internal links and keyword optimizing text whicl avoiding more disruptive changes such as re-writing URLs? Are we better off focusing on off site ranking factors such as link building and local SEO until domain authority recovers? How about only adding new content to the site such as blog posts and listings? To complicate matters the site is old and dated and we are working on a new UX design. So perhaps it would be better to launch the new UX at the exact same time as the onsite SEO optimization occurs. This could be less work and less disruptive. At the same time I would very much like to enjoy benefits of optimizing SEO now. Any thoughts????? Also, my domain migration has killed traffic. It is very concerning!! Is a 90% drop in traffic normal in the first ten days!? Thanks everyone!!!
Alan1 -
High charts, anyone used them? SEO impact/things to take into consideration
Hi there Moz Community, Our org is looking into implementing Highcharts, interactive charts on our website instead of having regular static chart images. I found this post recently about how Moz implemented them a while back, a couple years ago. https://moz.com/community/q/question-for-moz-developers-highcharts Moz made a pretty good case for them over alternatives. They would certainly keep people on the page longer, which is good, but is there anything else that I should take into account or think of before going ahead with this from an SEO perspective? Does anyone else have experience with them on their websites? Thanks
Intermediate & Advanced SEO | | Brian_Dowd0 -
<aside>Tag Use</aside>
Hi Guys, Just after some clarification - I have recently been told that by placing content in <aside></aside> tags spiders will ignore the content. Is this the case? I always thought that content placed in these tags was to identify related content. To put the query into some context, we have the same content on multiple pages on a site, which is relevant to the main body copy - but could throw up duplicate content issues... Thanks in advance.
Intermediate & Advanced SEO | | SEOBirmingham811 -
No Results for Google/Bing Keyword Search by Domain Name
My site is bestwebconsult [dot] com When I do a search for my exact domain name in Google and bing, it does not appear at all. I have submitted a sitemap to Webmaster Tools. It is a relatively new site completed with in the last month. Built with Joomla. This leads me to believe that something is misconfigured on the website. Please advise, thanks!
Intermediate & Advanced SEO | | crave811 -
Article Marketing / Article Posting
I am working on the SEO on a few different websites and I have built out an article marketing campaign so that I can get high quality backlinks for my website. I have been writing the content myself and I have been manually building out the top Web 2.0, Article Directory, and Doc Sharing sites. today I was creating an account on squidoo and I wondered if it mattered if I had the username be one of two things: my keyword as a user name, like: [keyword+geotag] example: roofinghouston just my first and last name as the username (or just a username I always use) (The reason behind #1 would be to have the optimized keyword and location I am trying to rank for, inside of the username. The reason for #2 would be that I don't want to get into trouble by having "too much" optimization.) I know a bit about optimization and that getting your keyword out there is great in a lot of areas, but I am not sure if it looks "suspicious" if I have my username be the keyword+geotag. I am just worried that all of this hard work will be torn down if I look like I'm trying too hard to be optimized, etc etc. There is no one answer, I am mainly looking for shared experiences. If you do have a definite answer, then I would like that too 🙂 Thanks SEOMoz!
Intermediate & Advanced SEO | | SEOWizards0 -
Reciprocal Links and nofollow/noindex/robots.txt
Hypothetical Situations: You get a guest post on another blog and it offers a great link back to your website. You want to tell your readers about it, but linking the post will turn that link into a reciprocal link instead of a one way link, which presumably has more value. Should you nofollow your link to the guest post? My intuition here, and the answer that I expect, is that if it's good for users, the link belongs there, and as such there is no trouble with linking to the post. Is this the right way to think about it? Would grey hats agree? You're working for a small local business and you want to explore some reciprocal link opportunities with other companies in your niche using a "links" page you created on your domain. You decide to get sneaky and either noindex your links page, block the links page with robots.txt, or nofollow the links on the page. What is the best practice? My intuition here, and the answer that I expect, is that this would be a sneaky practice, and could lead to bad blood with the people you're exchanging links with. Would these tactics even be effective in turning a reciprocal link into a one-way link if you could overlook the potential immorality of the practice? Would grey hats agree?
Intermediate & Advanced SEO | | AnthonyMangia0 -
What is the best practice when a client is setting up multiple sites/domains
I have a client that is creating separate websites to be used for different purposes. What is the best practice here with regards to not looking spammy. i.e. do the domains need to registered with different companies? hosted on different servers, etc? Thanks in advance for your response.
Intermediate & Advanced SEO | | Dan-1718030