Duplicate Content? Designing new site, but all content got indexed on developer's sandbox
-
An ecommerce I'm helping is getting a complete redesign.
Their developer had a sandbox version of their new site for design & testing. Several thousand products were loaded into the sandbox site.
Then Google/Bing crawled and indexed the site (because developer didn't have a robots.txt), picking up and caching about 7,200 pages. There were even 2-3 orders placed on the sandbox site, so people were finding it.
So what happens now?
When the sandbox site is transferred to the final version on the proper domain, is there a duplicate content issue?
How can the developer fix this? -
That would seem to be reasonable, with the information you've given. Best of luck!
-
Thank you for the very clear response!
The sandbox is on a subdomain of the developer's website. ourSite.theirDevSite.com/sandbox/
Their robots.txt actually redirects to their main website (why? no idea).
But the developer should verify the subdomain sandbox site in GWT/BWT, then disallow everything with robots.txt (and stop redirecting it), then request the entire site to be removed. Anything I'm missing?
-
Is the sandbox on its own subdomain or own domain? If so, verify the site in Google/Bing webmaster tools (subdomains verify as their own site), put in a robots.txt excluding everything, then go and request URL removal of the entire site in the webmaster tools.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to Redirect Old Domain to a New Domain?
One of my clients has chosen a new domain for her website so we will redirect the old domain to the new. I understand that once redirected, most of the authority built up over the years for the old domain will pass through to the new domain. Is this correct? Can this be done through the Wordpress dashboard, say with a plugin perhaps? I have a plugin called 404 Redirected I was going to try to use for this purpose. Finally, the client has other domains (5 total) she has used for one reason or another. She wants to consolidate all of them and have everything redirected to her new domain. Do you see any downside to this in terms of crawling, Google trust and authority? I know there are some user experience issues to deal with, but we're addressing those. I just don't want to do anything that may cause Google not to trust the new domain. Thanks, Dino
Web Design | | Dino640 -
Ecommerce Site - SEO
We have a Business Catalyst Site with the Same product Listed in 2 different catalogs. Each product page is the same page with different URLs you can see it here: http://www.yourpharmacy.co.nz/beauty/clarins-skincare/clarins-advanced-extra-firming-eye-contour-cream-20ml http://www.yourpharmacy.co.nz/clarins/clarins-advanced-extra-firming-eye-contour-cream-20ml Any suggestions welcome
Web Design | | OnlineAssetPartners0 -
Should I Use An Animated Javascript Responsive Site
Hi, hope someone might be able to help me with this. I am setting my son up with a website for his small painting and decorating company. However, I am a wordpress stalwart and he has seen a theme which is a javascript animated responsive theme from template monster. Its not my choice just he is adamant that he wants it. However, I am slightly concerned that Google cannot index as well with these kind of sites as they would with a standard HTML site. I would be grateful if someone could confirm if they can be indexed etc. The content appears in what I can only describe as lightboxes. Thanks
Web Design | | denismilton0 -
Will launching this site get my E-commerce site penalized?
Hello.. I am wondering if you guys think launching a site like this is a good or a bad idea. All of the links on it go directly to the exact corresponding page on the ecommerce site. Do you think Google will penalize my site for launching sites (i have many other domains that i will be setting up similar to this) like this? Thanks...
Web Design | | Prime850 -
How serious is duplicate page content?
We just launched our site on a new platform - Magento Enterprise. We have a wholesale catalog and and retail catalog. We have up to 3 domains pointing to each product. We are getting tons of duplicate content errors. What are the best practices for dealing with this? Here is an example: mysite.com/product.html mysite.com/category/product.html mysite.com/dynamic-url
Web Design | | devonkrusich0 -
How will a sites ranking be affected??
Hey guys, My MD has just put this to me, we have a site the is currently ranked in top 3 for all there chosen search terms. The company is undergoing an overhaul of their design and want a new site to match this. They have asked how changing the site design will affect their rankings. More content is going to be added with this there will be new pages links etc Any information would be greatly appreciated.. Thanks Anthony
Web Design | | Anthonykal-group0 -
Indexing Dynamic Pages
Hi, I am having an issues among others, regarding indexing dynamic pages. Our website, www.me-by-melia, was just put live and I am concerned the bottom naviagtion pages (http://www.me-by-melia.com/#store, http://www.me-by-melia.com/#facebook, etc) will not be indexed and create duplicate pages. Also, when you open these pages in a new tab, it takes you to homepage. The website was created in HTML5. Please advise.
Web Design | | Melia0 -
What is value in site aggregation?
If one was to own 5 sites that were in a similar vertical and at some point decide that managing 5 sites was more of a pain than managing 1,2, or 3, is it possible to combine sites via 301 redirects and increase the overall DA, and for urls that are similar, PA? So, we have site Hairbrush.com, comb.info, trimmer.com, hairmud.org, and barber.net: Assuming that they have a DA of Hairbrush.com = 32 Comb.info = 36 Trimmer.com = 27 Hairmud.org = 21 Barber.net = 44 Is there any testing that has shown combining the first 4 would increase the Comb.info from DA of 36 to DA of 51, etc? Is there any testing regarding the same, but with Page Authority? Thanks PS Assume other variables are equal. I also realize this could look as if they were all ECommerce, but what if they were service or bricks and mortar?
Web Design | | RobertFisher0