Staging site - Treated as duplicate?
-
Last week (exactly 8 days ago to be precise) my developer created a staging/test site to test some new features. The staging site duplicated the entire existing site on the same server.
To explain this better -My site address is - www.mysite.com
The path of the new staging site was www.mysite/staging
I realized this only today and have immediately restricted robot text and put a no index no follow on the entire duplicate server folder but I am sure that Google would have indexed the duplicate content by now?
So far I do not see any significant drop in traffic but should I be worried? and what if anything can I do at this stage?
-
Yes, it would show up in your analytics as an active user but the fact that the query returns no results means it's not been indexed. All good.
Peter
-
Hey Peter,
The Analytics code could have helped to get the site indexed. Or even a G +1/Facebook Like/share/Stumble/etc button clicked by error.
@Rajat
Doing the search Peter suggested should return any indexed page.
-
Got it. No, no results show up but interestingly when I go to www.mysite.com/staging, it does show up as 1active user on analytic report, which is what got me worried and made me realize of this problem.
-
Hi Rajat,
No what I mean is put the following query into the search box
site:<yourdomainname>/<yourstagingfolder></yourstagingfolder></yourdomainname>
where yourdomainname is your domain name (e.g. mysite.com) and yourstagingfolder is your staging folder (e.g. staging), so ike this:
site:mysite.com/staging
Peter
-
Thanks Pete. When I search for mysite.com/staging on google, I only see mysite.com as first result...and nothing at all on staging. Is that what you mean I should check?
-
Hi Rajat
The analytics code may have given some signals to Google of pages to index but to test it the staging server's pages are in Google use site:mysite.com/staging (NB. no spaces between site and the domain name).
Peter
-
Thanks Federico. That's re-assuring. Also, a related point, since the whole site was duplicated, so was the Google analytic code.
Does that have any impact?
Also, is there a way to check if the test server was in fact indexed or not?
-
Hi Rajat
I agree with Federico. Also, if there was no active link on mysite.com to mysite.com/staging then it's unlikely Google would have found it unless the staging site had been submitted to Google via a sitemap for indexing. You should be fine.
Peter
-
You have done the necessary steps (disallowing in robots plus setting a noindex tag). There's shouldn't be anything to worry about. If you want to be entirely sure, you can add some HTTP authentication to the folder so only those knowing the credentials can access (you could find that some robots may not follow the disallow flag or noindex tag).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Our Sites Organic Traffic Went Down Significantly After The June Core Algorithm Update, What Can I Do?
After the June Core Algorithim Update, the site suffered a loss of about 30-35% of traffic. My suggestions to try to get traffic back up have been to add metadata (since the majority of our content is lacking it), as well ask linking if possible, adding keywords to alt images, expanding and adding content as it's thin content wise. I know that from a technical standpoint there are a lot of fixes we can implement, but I do not want to suggest anything as we are onboarding an SEO agency soon. Last week, I saw that traffic for the site went back to "normal" for one day and then saw a dip of 30% the next day. Despite my efforts, traffic has been up and down, but the majority of organic traffic has dipped overall this month. I have been told by my company that I am not doing a good job of getting numbers back up, and have been given a warning stating that I need to increase traffic by 25% by the end of the month and keep it steady, or else. Does anyone have any suggestions? Is it realistic and/or possible to reach that goal?
Algorithm Updates | | NBJ_SM2 -
Condensing content for web site redesign
We're working on a redesign and are wondering if we should condense some of the content (as recommended by an agency), and if so, how that will affect our organic efforts. Currently a few topics have individual pages for each section, such as (1) Overview (2) Symptoms and (3) Treatment. For reference, the site has a similar structure to http://www.webmd.com/heart-disease/guide/heart-disease-overview-fact. Our agency has sent us over mock-ups which show these topics being condensed into one and using a script/AJAX to display only the content that is clicked on. Knowing this, if we were to choose this option, that would result in us having to implement redirects because only one page would exist, instead of all three. Can anyone provide insight into whether we should keep the topic structure as is, or if we should take the agency's advice and merge all the topic content? *Note: The reason the agency is pushing for the merging option is because they say it helps with page load time. Thank you in advance for any insight! Tcd5Wo1.jpg
Algorithm Updates | | ATShock1 -
We recently transitioned a site to our server, but Google is still showing the old server's urls. Is there a way to stop Google from showing urls?
We recently transitioned a site to our server, but Google is still showing the old server's urls. Is there a way to stop Google from showing urls?
Algorithm Updates | | Stamats0 -
Duplicate Product Pages On Niche Site
I have a main site, and a niche site that has products for a particular category. For example, Clothing.com is the main site, formalclothing.com is the niche site. The niche site has about 70K product pages that have the same content (except for navigation links which are similar, but not dupliated). I have been considering shutting down the niche site, and doing a 301 to the category of the main site. Here are some more details: The niche sites ranks fairly well on Yahoo and Bing. Much better than the main site for keywords relevant to that category. The niche site was hit with Penguin, but doesn't seem to have been effected much by Panda. When I analyze a product page on the main site using copyscape, 1-2 pages of the niche site do show, but NOT that exact product page on the niche site. Questions: Given the information above, how can I gauge the impact the duplicate content is having if any? Is it a bad idea to do a canonical tag on the product pages of the niche site, citing the main site as the original source? Any other considerations aside from duplicate content or Penguin issue when deciding to 301? Would you 301 if this was your site? Thanks in advance.
Algorithm Updates | | inhouseseo0 -
Is there a we to get Google to index our site quicker?
I have updated some pages on a website, is there a way to get Google to index the page quicker?
Algorithm Updates | | webguru20140 -
Top resulting sites sites for a specific keyword
I'm teaching myself SEO so that I can speak more intelligently to it with my clients. I've spent a great deal of time on seomoz and love it. The more I learn, the more I realize I don't know and that brings me to my current question. I can search on a keyword and see results, however I see every URL available. I'm looking for a simple way to see the root domains for the top 100-500 resulting websites for a specific keyword. Is there an easy way to get this information I'm sure it's right in front of me, but I can't find it. Many thanks, ahossom
Algorithm Updates | | ahossom0 -
Youtube dofollow link to web site
Is there still a dofollow link back from a youtube channel to your web site? I filled in the site url in the profile, which in my understanding used to be the single dofollow link back to your web site. However, when I view the page source for the youtube channel it shows up as a nofollow link. Also, in OSE the link does not appear. Has this changed or am I just not doing this correctly?
Algorithm Updates | | uwaim20120 -
Is there a way to know what rank my site is listed on google ?
My current client web page was listed at the 4th page 1 month ago. Im trying real hard to make him understand that the traffic from beiing on the first page is important and that he need to give me additionnal ressource to make it happen ( i don't prog at all). So i had the idea of checking every page to see whats is current rank. but instead of looking from page 1 to page X, i was wondering if there was something somewhere that could give me my rank right away. It woud help saving time. Thx.
Algorithm Updates | | Promoteam0