A/B Split Testing - Rankings Drop? Need an expert opinion...
-
We are running an A/B split test (Started on 12/12), and a few days after we started the test, we fell from position 9/10 (about 3 weeks on page 1) to position 11/13, and we've been there ever since.
We are still running the test. We disallowed the test page in robots.txt, but that's all.
- no canonical
- no noindex
-no Google Experiments code.
Theoretically, Google could crawl the site, and find the page, but then the page is disallowed. The alternate page is not indexed.
Could this explain the rankings drop?
-
It's a big site, and the most important category page. It explains a lot.
-
How big is your site? Is the page being A/B tested a pretty strong page (PA, PR)?
Let's say you've got a relatively small site, with a few dozen pages, and the page in question is one of only a couple linked to from the main nav. So it's one of the stronger pages on the site. Blocking it in robots.txt means Google isn't going to continue to distribute link juice from that page to other pages on your site, so all of those other pages get slightly weaker.
In general, robots.txt isn't the place to block Google, as you throw away the outbound link juice from that page that's blocked. Instead, you'd want to do a meta robots noindex,follow on the page itself.
If you've got a big site, and this particular landing page isn't a major portion of the overall site in terms of PA, then you shouldn't have seen an effect like I've described.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to hold a variable constant for an A/B test
For example, let's say you want to A/B test a title tag change. You are hoping to identify whether a title tag change increases CTR. But, position is always fluctuating a bit and that affects CTR, too. So, I'm interested in how you could hold position constant in order to isolate the change in CTR that is due to the title tag change. Does anyone know of resources/tools/tutorials for how to do this? It's been... a very long time since I took statistics (-: I have access to Excel, MS Access, and R studio.
Intermediate & Advanced SEO | | LivDetrick0 -
What does Disallow: /french-wines/?* actually do - robots.txt
Hello Mozzers - Just wondering what this robots.txt instruction means: Disallow: /french-wines/?* Does it stop Googlebot crawling and indexing URLs in that "French Wines" folder - specifically the URLs that include a question mark? Would it stop the crawling of deeper folders - e.g. /french-wines/rhone-region/ that include a question mark in their URL? I think this has been done to block URLs containing query strings. Thanks, Luke
Intermediate & Advanced SEO | | McTaggart0 -
Why I am loosing my ranking?
My website is lonestarperio.com, I am loosing my website ranking, Is SEO agency doing any black hat SEO or doing anything wrong to my website?
Intermediate & Advanced SEO | | bondhoward1 -
Rankings Tanked since new Site redesign land new url Structure ? Anything Glaringly Obvious I need to check ?
Hi All, I've just checked my rankings and everything on my eCommerce Site has pretty much tanked really badly since my new URL structure and site redesign was put in a place 2 weeks ago. My url structure was originally long and had underscores but we have now made it clean, shorter and use hyphens. We also have location specific pages and we have incorporated these into the new url structure.Basically it now pretty much follows the breadcrumb trail on our website. We were originally a general online hire site but now we have become niche and only concentrating on one types of products, so we got rid of all the other categories/products and pages we do not deal with anymore. Our Rankings issue , was only bought to light in the most recent MOZ Ranking report so it's looking site google hates our new store. Someone mentioned the other day, that Google may have been doing a Panda/Penguin refresh last weekend, but I am surprised to have dropped like 20 to 50 places for most of my keywords. We have set up the 301 redirects, We have also made the site alot smaller and set up a few thousand 404's to get rid of a lot of redundant pages . We have cut down massively on the thin/duplicate content and have lots of good new content on there. We did new sitemaps , set up schema.org. , increase text to code ratio . Setup our H1-H5 tags on all our pages. made site mobile responsive.. Basically , we are trying to do everything right. Is there anything glaringly obvious , I should be checking ?. I attach a Short url link if anyone wants to have a quick glance- http://goo.gl/7mmEx i.e Could it be a problem with the new urls or anything else that I should be looking at ?.. I.e how can I check to make sure the link juice is being passed on to the new url ? Or is all this expected when doing such changes ? Any advice greatly appreciated .. Pete
Intermediate & Advanced SEO | | PeteC120 -
Not ranking on Bing but is on Google?
Hi What are the main differences between Bing and Google in terms of ranking sites? My site is ranking well in Google but in Bing it is very low down and does not deliver much traffic. In Bing webmaster tools there are no warning messages and I had sent in a sitemap back in 2011 and 77 pages are listed, but I had not submitted a URL could this be why my pages are not ranking highly? Or does anybody have a checklist on what a site should offer to get ranking on Bing?
Intermediate & Advanced SEO | | ocelot0 -
Sitemaps / Google Indexing / Submitted
We just submitted a new sitemap to google for our new rails app - http://www.thesquarefoot.com/sitemap.xml Which has over 1,400 pages, however Google is only seeing 114. About 1,200 are in the listings folder / 250 blog posts / and 15 landing pages. Any help would be appreciated! Aron sitemap.png
Intermediate & Advanced SEO | | TheSquareFoot0 -
Home Page Rankings Drop
Hi all we have being working with a small local client in the last few weeks getting good rankings using onsite op, and business listings we have been getting good ranking ie top 15 then today we drop right out the top 50, after completing manual checks i see the keywords as all related | glasgow catering | Not in Top 50 | down > 42 | |
Intermediate & Advanced SEO | | Will_Craig
| catering glasgow | Not in Top 50 | down > 41 | |
| glasgow caterers | Not in Top 50 | down > 39 | |
| caterers in glasgow | Not in Top 50 | down > 37 | |
| caterers glasgow | Not in Top 50 | down > 32 | Also when completing manual checks on the above keywords, the home page is not ranking what so ever, infact its missing i went 300 results deep and cant find it, other inner pages rank but not the home. The only other recent change is that we now have a listing under the Google maps section of the homepage on page 1 any advice www.georgieporgies.co.uk0 -
Social Signals...I Need More
Hi, Having used the Open Site Explorer (page specific metrics) tool I've realized I'm lacking in the Social Signals area...I have only 1 tweet and ZERO for everything else (Facebook shares, Likes, Google +1 etc). So I have 2 quesitons: How can I get more social signals (is there a service I can use to do it)? How long will the new social signals take to appear in the Open Site Explorer information? I've just paid someone on Fiverr.com to share my website link on his Facebook account, to tweet it, and also to use PingFM... Any other ideas would be GREAT - I can see this is a real weakness for my websites... Thanks, James
Intermediate & Advanced SEO | | James10