Duplicate Content? Designing new site, but all content got indexed on developer's sandbox
-
An ecommerce I'm helping is getting a complete redesign.
Their developer had a sandbox version of their new site for design & testing. Several thousand products were loaded into the sandbox site.
Then Google/Bing crawled and indexed the site (because developer didn't have a robots.txt), picking up and caching about 7,200 pages. There were even 2-3 orders placed on the sandbox site, so people were finding it.
So what happens now?
When the sandbox site is transferred to the final version on the proper domain, is there a duplicate content issue?
How can the developer fix this? -
That would seem to be reasonable, with the information you've given. Best of luck!
-
Thank you for the very clear response!
The sandbox is on a subdomain of the developer's website. ourSite.theirDevSite.com/sandbox/
Their robots.txt actually redirects to their main website (why? no idea).
But the developer should verify the subdomain sandbox site in GWT/BWT, then disallow everything with robots.txt (and stop redirecting it), then request the entire site to be removed. Anything I'm missing?
-
Is the sandbox on its own subdomain or own domain? If so, verify the site in Google/Bing webmaster tools (subdomains verify as their own site), put in a robots.txt excluding everything, then go and request URL removal of the entire site in the webmaster tools.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Making html table as 'seofriendly' as possible
Hi, On my website I have a table with a list of products, on every row I have a different product and a different property on each column. The table is made with css so the html code is clean. The problem is (I guess) that google doesn't 'understand' what its inside on the table. So if I do a google search that page appears on the page 87, there is any way to improve my SEO without changing the table? Or to improve my SEO I must change the format of my content? In resume, I want to improve the SEO page of a page that contains information organized inside a table. I don't know if there is a specific answer to this question. Any help is welcome. Regards
Web Design | | jcobo0 -
"Design by" footerlinks of webdevelopment firms
Hi Guys, Since our company does a lot of web development jobs next to our SEO work, we came across the topic of the “Design by” or “Webdesign by” links that our competitors are placing in the footer of clients websites. When I did some backlink analysis of our competitors these links make up the biggest part of their backlink profile. That way, I think they are important for the promotion and SEO of web development companies. I would love to have your opinion about how to use these links for SEO 1. Side wide vs homepage I think there are two ways here, going for a link at the bottom of every page or just one link at the bottom of the homepage. When you look at exposure the most ideal situation would be a side wide link (more eyeballs). From a SEO standpoint this might cause trouble. 2. Follow vs nofollow I think this is a very interesting one since there seems to be a lot of different opinions about if this is advertisement or not. A normal banner in a sidebar would get the nofollow tag to match Google’s guidelines but what about this “designed by” link? I know few designers and “putting a stamp” on their work is pretty common and more likely viewed as something that they deserve then an act of commerce. Besides this discussion adding the nofollow tag could prevent any issues with side wide links but reduces any SEO benefits to zero. Another option is adding the nofollow tag to all the links expect the one on the homepage. 3. Anchor text and descriptive text Since anchor texts play a big role in SEO (and in detecting spam) I’m interested in your opinion about the use of anchor texts with such links. Just the company name or the web address sounds like a safe choice (especially with side wide links) but it’s pretty attempting to link words like “Webdesign” instead of the company name. Do you think it’s safe to use this, or any other keywords in 0,5,10,15,20,25% of the times? And do you think the descriptive text “Webdesign and SEO by” got any value (or causes potential risks) when added before the link? 4. Alternatives or extra link opportunities Here are some other options I found and thought about considering getting links from client websites. Asking, or earning a link in their first blogpost. Yjpiieee our website is online, thanks guys of company X. Links in the disclaimer or legal parts of the website. Link in the main content of the about us. Most likely in the bottom a little section about the credits of the design etc. Links on partner / friend / links pages of the website. I saw all of these links in the backlink profiles of our competitors. Last but not least, my current standpoint: At this moment we ask our clients if we may place a small text and link in the footer of their website next to the copyright claim. We use texts like “Webdesign and SEO by Web Whales”. With only our brand name as anchor text (to avoid penalties). It’s a side wide follow link. Side wide because we want the exposure and follow because we want the SEO benefit. We considered just making the homepage link follow, but this kind of feels like manipulation so we just went for all follow since this is pretty normal on the web. Beside that we celebrate new websites with our clients to increase the change getting mentioned on the first blog or partner page. Occasionally we ask them for links on these pages. What’s your opinion about this topic?
Web Design | | Bob_van_Biezen0 -
Duplicate items across different pages?
On our new website we have a testimonials page which you can cycle through them. We also have the testimonial on the our work / project page. Essentially this is duplicate content from another page, what's the best thing to do here? In the sake of SEO, remove the duplicate content and only have one? Or won't it make much difference?
Web Design | | vortexuk0 -
HELP! IE secure page display issue on new live site
For some reason IE 7, 8, & 9 do not display the following page: https://www.jwsuretybonds.com/protools.htm All they show is the Norton seal. It shows properly in all other browsers without issue (including IE 10+), but the earlier versions flash the page for a split second, then hides everything. Can someone shed some light on this? This is a new live site we just launched minutes ago and these browsers account for 12% of our overall traffic. UGH I hate you microsoft!!! Thanks all 🙂
Web Design | | TheDude0 -
Is WP okay for E commerce sites?
Do any of you out there use wordpress for an ecommerce site? I'm getting some mixed reviews on it (but it's the internet, so that's bound to happen). Is there any sort of site traffic or page limit that would make using wordpress a bad idea? Thanks, Ruben
Web Design | | KempRugeLawGroup1 -
Web Developer Using Stock Photos
Hello, The organization is selling a cms system in a niche market across the country. It has the normal SEO challenges, in addition he is using purchased stock images. This seemed ok, while he was smaller but now we are growing rapidly and these images are VERY STOCK- and well used ( I have checked with Tiny Eye). I remember a few years ago this was a flag to the search engines who went through manual review, is this still true? It seems to me that the theme's that come with the images, are duplicated ( including navigation & footers), so having the duplicated images would be another negative. Thank you for your suggestions!
Web Design | | TammyWood0 -
Panda and Penquin Fall - Could HTML Design an Issue?
Hi, We were hit hard by Panda 3.4 on March 23rd 2012. Then Penguin came along and slapped us down a little farther on April 24th. White hat SEO for 13 years on the site. I have been trying to discover the reason we got hit so hard, to date 90% down. We ae wiped. I have a couple of keywords still #2 and #3 and we see up and down changes in Google webmaster tools, i.e. a keyword is supposedly up 50 points then another down 50. All other 150 keywords that we used to rank on the first page for are not even showing up. I have a person that is about to do a full link analysis but since we never went after links I just never had the feeling that is where our problem is at, but definitely going to explore it. The reason for my post is that last night I spoke with an SEO person that has some pretty good credentials (9 years experience and works currently at large online marketing company with seo with clients like Honda) and he was nice enough to just take a quick look at the site. He said he saw nothing really wrong and did not think that we were hit for any of the normal issues people are listing, i.e. duplicate content, backlinks. His first impression was that we were knocked down because the site is "hard to index". He said the site still uses tables and a lot of our Doc Statements were for HTML 4.01 from 1999. As we all know, there are 'many' experts in this industry. So I wanted a little feedback from the community. Our main site was built in Dreamweaver using tables. We do have a Wordpress blog that is very small and just now posting to add fresh content. (posts seem to rank pretty good, this is why I thought, you know he may be right) Would an older site be penalized like this for using tables? What would you do at this stage if you had a site that is not recovering? I have now reached panic mode and have to do something, just not sure of the next step. I will be happy to post the URL if anyone wants to help with advice. Thanks,
Web Design | | Force7
Force70 -
Content position on page
I am in a limo service industry where people are not looking for great content or product description, all they want is a nice Lincoln Town car and a competitive price. Because I need to get more pictures in front of my customers rather than more content I am not sure if by not having the content high up in the page will affect my rankings. We are transitioning to a new template where we have more control over the layout of the website but because of the slider that we have on the homepage the content needs to go further down. We could insert some content in each of the slides but the page would start looking too "busy". We want the customers to see very clearly what we offer. They see the picture, click for more info and book the service. How important still is to have your keywords in the first hundred words on a certain webpage? Can we get away with having the content read by search engines after 3 - 4 slides and their description (about 20 words total) ?
Web Design | | echo10