Creating duplicate site for testing purpose. Can it hurt original site
-
Hello,
We are soon going to upgrade the cms to latest version along with new functionlaities - the process may take anywhere from 4 week to 6 weeks.
may suggest - we need to work on live server, what we have planned
-
take exact replica of site and move to a test domain, but on live server
-
Block Google, Bing, Yahoo - User-agent: Google Disallow: / , User-agent: Bing Disallow: / User-agent: Yahoo Disallow: / in robots.txt
-
Will upgrade CMS and add functionality - will test the entire structure, check url using screaming frog or xenu and move on to configure the site on original domain
The process upgradation and new tools may take 1 - 1.5 month....
Concern is that despite blocking Google, Bing & Yahoo through User agent disallow - can still the url can be crawled by the search engines - if yes - it may hurt the original site as will read on as entire duplicate or is there any alternate way around.. Many thanks
-
-
Thanks, am using it through Password Protected & meta noindex tag
Its been kept out of search engine crawl !!
-
Hey Gagan,
So I think you're question is will content on your staging site still get indexed despite using robots.txt? The answer is yes, sometimes that does happen especially if a lot of people link to it. The best way to keep content out of the index would be to use the meta robots tag with noindex, nofollow. Search engines are much better about adhering to those than robots.txt.
Let us know if you run into any problems!
-Mike
-
Hi Gagan,
Google are generally more than happy for sites to test new pages, layouts and functionality. They even have some free tools for that purpose.
Content Experiments
https://support.google.com/analytics/answer/1745147?ref_topic=1745207&rd=1
I'm not sure about the viability of of using Content Experiments to test a whole new site, but it would be worth looking into.
Let us know how you get on.
Neil.
-
Ahaa.. Thanks Mr. Robert for your views
However, does any kind of duplicate url can still occur - can google can still crawl the url despite been blocked through robots - can the original running site can suffer in any way, if we create duplicate site
Its a content based site - covering Auto reviews, updates with news, forum & blog updates. There is no ecommerce shopping or products involved
Our tentative time frame to add on features, test all changes and do major upgrade for latest version of cms will be approx 45 days. Do you feel any issue - if both original site and a duplicate one on test domain (despite blocked by robots), but on real time server goes on simultaneously for that period.
Also - you referred other way of testing changes - is it possible to share them ?
-
Gagan
I think this is a great and interesting question. First, you are adding functionality, etc. to a site and you are curious as to the effect of that on visitors to the site once they are on it. This is data anyone in SEO should want to see for their sites.
I would first say that you need to define the test period (assuming you already know what you want to measure) for the site. If it is a week for example, I do not think you need worry about whether a site with three major engines blocked will in some way run into duped content issues. (NOTE: If this is a large site and/or one with a critical revenue need - one that cannot afford to have any type of slight but temporary downturn - I would look for another way to test the changes. Even if I was sure there were no other issues.)
I am assuming that if an ecommerce site for example, there will be the ability for a shopper to purchase on both, etc.
I would not run the test for any long period of time for a site that creates leads, revenue, etc. as I think it could cause customer confusion which can be more critical than duped content.
Let us know how it works out,
Thanks
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why Google cached another site, not mine?
Hi Guys, please help me. I need your help regarding my business website i.e. https://www.kamagratablets.com/. Before 8-10 days it was ranked in top 10 from home page but I lost my position and ranking page also changed by Google. If you will check caching of this website then you will see Google cache another site - http://www.hiphoptoptower.com/ - I have checked my code and nothing found related to this website. Please check and help me on this point, how can I remove this site from caching and get my previous ranking in Google.
White Hat / Black Hat SEO | | Devtechexpert0 -
Wordpress Category Archives - Index - but will this cause duplication?
Okay something I am struggling with Using YOAST - but have a recipe blog - However the category archives have /are being optimized and indexed as I am adding custom content to them , then listing the recipes below. My question is if I am indexing the Category Archives and using these to add custom content above - then allows the recipe excerpts from the category to be listed underneath - will these recipe excerpts be picked up as duplicate content?
White Hat / Black Hat SEO | | Kelly33300 -
Competitors Linking to My Site
One of the more successful competitors in my niche has embarked on new strategy that seems to be working well for him. I noticed that many new links began to appear to my site from my competitor's stable of many websites. It appears that he has setup a link wheel to benefit a site that has been in the top Google position for several months now. The rim of the wheel links back to authority sites, including my own main site (established 7 years, now hanging on to the lowly 10th place on the serp). So the strategy seems to be: a) create a dozen sites that no-follow link back to authority sites including competitors, b) place links in a such a manner (bottom of page, uncolored links, from images) that a customer is unlikely to ever click on it, c.) do-follow to your own site and blast it to the top of Google. I don't think this competitor is worried about getting penalized. I've been watching this for years. When one site gets burned, he just shifts things around and brings up another one of his sites. He seems to age them for years, calling them up one by one as they are needed. Has anyone else noticed this? Is it a trend? Because it sure seems to work. He's crowded the front page now with 4 of his sites. Would it be appropriate for me to "disavow" his links? Would it matter?
White Hat / Black Hat SEO | | DarrenX0 -
Lots of websites copied my original content from my own website, what should I do?
1. Should I ask them to remove and replace the content with their unique and original content? 2. Should I ask them to link to the URL where the original content is located? 3. Should I use a tool to easily track these "copycat" sites and automatically add links from their site to my site? Thanks in advance!
White Hat / Black Hat SEO | | esiow20130 -
Inbound Links Inquiry for a New Site
For a site that is only one to two months old, what is considered a natural amount of inbound links if you're site offers very valuable information, and you have done a marketing push to get the word out about your blog? Even if you are receiving backlinks from authority websites with high DA, does Google get suspicious if there are too many inbound links during the first few months of a sites existence? I know there are some sites that blow up very fast and receive thousands of backlinks very quickly, so I'm curious to know if Google puts these kind of sites on a watchlist or something of that nature. Or is this simply a good problem to have?
White Hat / Black Hat SEO | | WebServiceConsulting.com0 -
Alt tag best practices for a mutli gallery site with hundreds of images
I have neglected to add alt tags to one of my sites, and am ready to tackle the project. I want to make sure I do not do something that will have a negative impact on rankings....and I have not been able to find info that fits my situation. The pics are all about a product I make and sell through the site. I have a free gallery section that has about 10 galleries with about 20 pics each. Each gallery page has a different model and/or context of how the product. might be used. These are not sales pages directly just thumbnail galleries linked to larger images for the viewers enjoyment. I have 10 or so keyword phrases that would be good to use, with the intent to start getting listed in google images and other rank enhancements. Can I choose one keyword phrase as my alt tag choice for a whole gallery and give each individual large pic in the gallery that same alt tag, And use a different phrase for the next gallery's pics etc.? Or is that thought of as stuffing, and I would have to come up with a different keyword phrase for each pic? I hope that makes sense. Thanks Galen
White Hat / Black Hat SEO | | Tetruss0 -
Site ranking position 1, after 1 day existing
Hi, I'm working in the Online gaming and since a few months there was a website called 'Htmlwijzer.nl', it ranked page 1 for 'online casino' in Google.nl which is of course a high competive keyword and remained there for about 2 months. This website didn't come up slowly in Google.nl from page 10 to 1, it just was there one day at page 1. This one only had HTML-related information content and did rank for 'online casino' with a layer ad on it's site which would only be showed to users in the Netherlands. Now that website received a penalty after 2 months, and since today a new site is in Google at position 1, called www.casinowijzer.nl. It has completely no backlinks (online a 301 from the former domain). It just popped up there.. Does anyone know how this website could have gotten here? It's obviously blackhat, but for a keyword like 'online casino' it's quite amazing. Thanks,
White Hat / Black Hat SEO | | iwebdevnl0 -
Is there a way to check if your site has a Google penalty?
Is there a way to find out if your site has an over optimization penalty?
White Hat / Black Hat SEO | | RonMedlin0