Duplicate Content? Designing new site, but all content got indexed on developer's sandbox
-
An ecommerce I'm helping is getting a complete redesign.
Their developer had a sandbox version of their new site for design & testing. Several thousand products were loaded into the sandbox site.
Then Google/Bing crawled and indexed the site (because developer didn't have a robots.txt), picking up and caching about 7,200 pages. There were even 2-3 orders placed on the sandbox site, so people were finding it.
So what happens now?
When the sandbox site is transferred to the final version on the proper domain, is there a duplicate content issue?
How can the developer fix this? -
That would seem to be reasonable, with the information you've given. Best of luck!
-
Thank you for the very clear response!
The sandbox is on a subdomain of the developer's website. ourSite.theirDevSite.com/sandbox/
Their robots.txt actually redirects to their main website (why? no idea).
But the developer should verify the subdomain sandbox site in GWT/BWT, then disallow everything with robots.txt (and stop redirecting it), then request the entire site to be removed. Anything I'm missing?
-
Is the sandbox on its own subdomain or own domain? If so, verify the site in Google/Bing webmaster tools (subdomains verify as their own site), put in a robots.txt excluding everything, then go and request URL removal of the entire site in the webmaster tools.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Site appears then disappears from Google
Hi, This is my first post to the Moz community. I hope someone can help me, as I'm at my wits end 🙂 Since mid to late April, my client's home page keeps dropping from Google rankings on and off on the desktop in incognito and non-incognito browsing. It seems to always be visible on mobile phones though. One day it's on page 4, the next day it's not anywhere to be found (even though some of her other pages rank). The site is here: evgeniaribinik.com I have done some blog writing (just text) for this client over the last few months, and recently she asked for some SEO help. After looking at her website, I noticed that she had a plugin called WordPress SEO on her site. She wasn't using this for the blogs, however. I don't think she did much of anything with SEO, but she did say that for the last few years, she was always on page 3 or 4 of Google. In mid/late April, she saw that she wasn't ranking at all for the keyword "boudoir photography nyc" anymore, despite a few years of ranking for it. I told her Yoast would be good to use. However, after she installed it, the same issues keep happening. Right now, she has Yoast and WordPress SEO plugins installed (I'm not sure if this is causing an issue as well). But I really can't figure out why she keeps going on and off page 4. She also asked me to optimize older blogs that she wrote herself for SEO. When I look at them, they don't have meta descriptions, good titles or good keywords. I realize this is hurting her, but why would her site be fine for years and all of a sudden not now? Thank you in advance for any help you can give me! Jill
Web Design | | lobeng770 -
Content thin for new home page been told to change it? any suggestions?
Hi guys, I'm newbie.... I have been told that my home page is content thin, and if I want to rank really well in the search i need to have more relevant content on my homepage - the site is only new 2months and I can see we are now at 39th place in the search, if i make changes to the home page design and add more content will this effect this current ranking?
Web Design | | edward-may0 -
Who's best but affordable custom shopping cart provider (e.g. 3dcart, big commerce, shoppingcart)?
I'm planning to put up a buy and sell site for shoes where people can upload shoe listings on their own something like ebay.com though we're not the ones who will process the payment. The site we're planning doesn't have a buy/checkout button and paypal integration so it will look like a catalog. We will just add a contact number/email in the product listing so a buyer can contact and personally meet the seller. Let me know if this can be done in Wordpress + e-commerce plugins. I would also like to know if there are custom shopping cart providers that allow Facebook or Twitter login/sign up integrated in the platform. Let me know if this is also possible in Wordpress by adding a plugin. Thanks in advance!
Web Design | | esiow20130 -
Many errors from previous ecommerce site. Domain is now just a localized wordpress site.
Many errors from previous ecommerce site. Do I need to redirect every single page that no longer exists at this domain? loveyourcabinets.com used to be loveyourkitchenandbath.com but we have since changed course. We want loveyourkitchenandbath.com to be our local site on Long Island and NYC. Loveyourcabinets.com will be an ecommerce project that I'll be revamping in the coming months. I think Moz as well as Google still has all of the old ecommerce pages indexed. And of course, Moz is shooting me a bunch of error all regarding pages from the ecommerce site that used to be on loveyourkitchenandbath.com. Any thoughts? Commentary? Thx
Web Design | | loveyourkitchen0 -
Duplicate Content & Canonicals
I am a bit confused about canonicals and whether they are "working" properly on my site. In Webmaster Tools, I'm showing about 13,000 pages flagged for duplicate content, but nearly all of them are showing two pages, one URL as the root and a second with parameters. Case in point, these two are showing as duplicate content: http://www.gallerydirect.com/art/product/vincent-van-gogh/starry-night http://www.gallerydirect.com/art/product/vincent-van-gogh/starry-night?substrate_id=3&product_style_id=8&frame_id=63&size=25x20 We have a canonical tag on each of the pages pointing to the one without the parameters. Pages with other parameters don't show as duplicates, just one root and one dupe per listing, So, am I not using the canonical tag properly? It is clearly listed as:Is the tag perhaps not formatted properly (I saw someone somewhere state that there needs to be a /> after the URL, but that seems rather picky for Google)?Suggestions?
Web Design | | sbaylor0 -
Duplicate Page Content mysite.com and mysite.com/index.html MOZ Dashboard
According to MOZ Dashboard my site shows Duplicate Page Content mysite.com and mysite.com/index.html .What i can do for that .redirect mysite.com/index.html to mysite.com .then how can i do that using .htaccess file .
Web Design | | innofidelity0 -
What's so great about Thesis framework?
I keep hearing about how great Thesis is for SEO. But when I look at the code, it doesn't look like anything special to me -- they followed the basics (proper title, header usage, etc.), pages load quickly, and they packaged things like title and meta control with the theme itself, but none of those things seem particularly special to me. Plenty of SEO plugins give you the same control over title & meta (and the best ones go beyond what Thesis offers) and it's easy to make sure the code is clean. What am I missing?
Web Design | | EricOliver1 -
New URL Strucutre
Hello all! I'm new to SeoMoz and would like to introduce myself and say thanks for all of the great content. This is definitely the premium website I have been looking for. My question is regarding a new URL structure that will be implemented with our website redesign. We are looking to make our URL's more user and SEO friendly. We will be using 301 redirects to reroute our existing structure when the site goes live. Background
Web Design | | kauffmantire
I work in a company that retails automotive tires. I would consider class (performance, off-road, highway, etc.) to be the most important category, but based on our analytics we receive much more traffic from brand terms. This is most likely because our customers are not educated on specific tire classes and generally do head term searches or search by brand / product name. Ultimately the will have to buy from a certain class based on driving habits. Link and URL Structure
(Parameters) The model page includes links to individual tire size specific pages. We are using the model page as our primary SEO page because the only difference from the 5 - 60 tire size specific pages per model will be the tire size itself. This means that all of the remaining content will be duplicated multiple times over. All links to the tire size specific page from the model page will have a rel="nofollow" attribute attached to it. All tire size specific pages will have a rel="canonical" tag pointing back to the model page Out of the following structures, which would you consider to be the best format: 1. http://www.company.com/category/brand/model
or
2. http://www.company.com/brand/category/model
or
3. http://www.company.com/tires/category/model We will append the specific tire-size to the URL on the item specific pages. Any other options or strategies will be greatly appreciated. Thanks in advance for your help!0
