How to move domain content w Penguin Penalty?
-
Hey guys,
I've come to the conclusion the sheer amount of crap links a site of ours has is un repairable. We own a .net version with the same brand name so I'm planning to move our ecommerce store over with all its content.
I can move the site in one swoop but I believe Google will see it as duplicate content if we don't allow the old site to de index first. I would simply take it down for a month but we still get some orders now and then.
Anyone have any ideas? I was thinking of leaving an image up on each page that is no index no follow linked to the new site that explains the site is being moved, etc.
-
If you're trying to completely remove the domain, Anthony's suggestion about using Google's URL removal tool is the quickest way to go.
You'll first want to block crawler access in your robots.txt, then choose the option to "remove directory" in webmaster tools. http://support.google.com/webmasters/bin/answer.py?hl=en&answer=1663427
(Note: robots.txt by itself DOES NOT prevent Google from indexing your pages, it only blocks them from crawling. Using only robots.txt means your pages are likely to stay in the index for quite some time)
That takes care of Google. Bing's process isn't quite as smooth. I'd also throw a meta robots "NOINDEX, FOLLOW" tag on all your pages - this will help with other search engines as well.
You may want to include a message on your old site instructing visitors to update their bookmarks and links - this may help aid with the transition.
Keep in mind, this will severe all links from your old domain, and none of your built up link equity will transfer over. Obviously, you've given this some thought in order to take such a move.
Hope this helps. Best of luck!
-
Per google webmaster tools:
Removing an entire directory or site
In order for a directory or site-wide removal to be successful, the directory or site must be disallowed in the site's robots.txt file. For example, in order to remove the http://www.example.com/secret/ directory, your robots.txt file would need to include:
User-agent: *
Disallow: /secret/
It isn't enough for the root of the directory to return a 404 status code, because it's possible for a directory to return a 404 but still serve out files underneath it. Using robots.txt to block a directory (or an entire site) ensures that all the URLs under that directory (or site) are blocked as well. You can test whether a directory has been blocked correctly using either the Fetch as Googlebot or Test robots.txt features in Webmaster Tools.Only verified owners of a site can request removal of an entire site or directory in Webmaster Tools. To request removal of a directory or site, click on the site in question, then go to Site configuration > Crawler access > Remove URL. If you enter the root of your site as the URL you want to remove, you'll be asked to confirm that you want to remove the entire site. If you enter a subdirectory, select the "Remove directory" option from the drop-down menu.
-
Thanks for the input. So you would put up the new site immediately? Or would you wait a certain amount of time after you take down the old site and put up the new robots.txt file?
I want to make sure Google doesn't see the new site as dup content.
-
I would suggest no index no follow in the old sites robots.txt file. Take down entire site with exception to a blank index page with text stating your site has moved to the new location, and the robots.txt file. I would not have a hot link to new site.
Then bring up the new site. On the next indexing, google should pick up the no index no follow from old site and start the indexing for the new site. I think that would be the best option so that you don't miss out on any potential business or orders.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
New domain or subdirectory?
I noticed my domain authority has dropped slightly in the recent update, and it has me re-thinking a strategy for a website I just recently launched. I purchased the domain name kansasisbeautiful.com about a year ago and have been working on building it for most of that time. Earlier in August, I went ahead and launched it. However, towards the end of the development of the website, I decided to just put it in a subdirectory of my parent company (my photography business) at mickeyshannon.com/kansas and redirected the kansasisbeautiful.com domain to the subdirectory. mickeyshannon.com is my photography business website. The Kansas website has it's own distinct design, but is powered completely by my photography. I created it for a few purposes, including promoting tourism to the state of Kansas and to publish a book on Kansas travel next year, but one of it's main goals is also to help sell my photography prints. I decided to put it in a subdirectory (mickeyshannon.com/kansas) as I had hoped it might drive more traffic into buying photo prints if it lived on my main website. However, I've been re-thinking my strategy and have been wondering if I'm competing against myself too much. Many of my photography prints have the name of a location in them and have their own URL per photo (for example: "Flint Hills Spring Sunrise" is at http://www.mickeyshannon.com/photo/flint-hills-spring-sunset/). It makes me wonder if the new Kansas travel website page for the Flint Hills (http://www.mickeyshannon.com/kansas/flint-hills/) is competing for that keyword. Would I be better moving mickeyshannon.com/kansas to kansasisbeautiful.com? I was worried having so many backlinks back to my photography site would send up red flags with Google as if the kansasisbeautiful.com website was just a spammy website created to push traffic to mickeyshannon.com when it really has it's own purpose. Any thoughts on whether using the domain name or keeping it at the subdomain level is better? Hopefully that made sense. Thanks, Mickey
Intermediate & Advanced SEO | | VSphoto0 -
Domain Authority... http://www.domain.com/ vs. http://domain.com vs. http://domain.com/
Hey Guys, Looking at Page Authority for my Site and ranking them in Decending Order, I see these 3 http://www.domain.com/ | Authority 62 http://domain.com | Authority 52 http://domain.com/ | Authority 52 Since the first one listed has the highest Authority, should I be using a 301 redirects on the lower ranking variations (which I understand how works) or should I be using rel="canonical" (which I don't really understand how it works) Also, if this is a problem that I should address, should we see a significant boost if fixed? Thanks ahead of time for anyone who can help a lost sailor who doesn't know how to sail and probably shouldn't have left shore in the first place. Cheers ZP!
Intermediate & Advanced SEO | | Mr_Snack0 -
Negative SEO penalty, new domain?
One of my clients has just been hit with a Penguin 3.0 penalty. They have been subject to a negative link building attack for the last 5 months and despite my best effort it appears I haven't disavowed enough, someone was building a lot of links to them and all really low quality spam and a lot of forum profiles. They still rank for their brand, the site is in the index but the only rankings I can see are in Google Local. My advice to them for the quickest way back into Google is to get a new domain and relaunch on this new domain. The challenge is, the domain they want to buy used to be used as a domain in the 'erotic video distrubution' industry. It currently has 17 backlinks from 9 domain and the anchor text is mostly brand related but I can see that 70 links have already been deleted. I would consider this to be too high risk but would be interested to see if everyone agrees with me, it would be an awesome domain name if the history wasn't there!!
Intermediate & Advanced SEO | | Karen_Dauncey0 -
Duplicate content on subdomains
Hi All, The structure of the main website goes by http://abc.com/state/city/publication - We have a partnership with public libraries to give local users access to the publication content for free. We have over 100 subdomains (each for an specific library) that have duplicate content issues with the root domain, Most subdomains have very high page authority (the main public library and other local .gov websites have links to this subdomains).Currently this subdomains are not index due to the robots text file excluding bots from crawling. I am in the process of setting canonical tags on each subdomain and open the robots text file. Should I set the canonical tag on each subdomain (homepage) to the root domain version or to the specific city within the root domain? Example 1:
Intermediate & Advanced SEO | | NewspaperArchive
Option 1: http://covina.abc.com/ = Canonical Tag = http://abc.com/us/california/covina/
Option 2: http://covina.abc.com/ = Canonical Tag = http://abc.com/ Example 2:
Option 1: http://galveston.abc.com/ = Canonical Tag = http://abc.com/us/texas/galveston/
Option 2: http://galveston.abc.com = Canonical Tag = http://abc.com/ Example 3:
Option 1: http://hutchnews.abc.com/ = Canonical Tag = http://abc.com/us/kansas/hutchinson/
Option 2: http://hutchnews.abc.com/ = Canonical Tag = http://abc.com/ I believe it makes more sense to set the canonical tag to the corresponding city (option 1), but wondering if setting the canonical tag to the root domain will pass "some link juice" to the root domain and it will be more beneficial. Thanks!0 -
Domain Factors
Now that Page Rank seems to have been 'put out to graze' by Google with no further PR update planned, what would you say is the 'main factor' when looking at a domain? Is it Moz DA? or Moz Links? or Majestic TrustFlow? Or none of the above or is it a combination of the above?! Many thanks Andy
Intermediate & Advanced SEO | | TomKing0 -
Is it safe to redirect our .nl (netherlands) domain that we have just purchased to our .com domain?
Hi all! We've recently developed a German version of our website with German translation and now we have just purchased a .nl domain, but with this one, we want all of the copy to remain in English. Is it ok to redirect our .nl domain to our current .com website or will this give us bad SEO points? Thank you!
Intermediate & Advanced SEO | | donaldsze0 -
Duplicate Content on Blog
I have a blog I'm setting up. I would like to have a mini-about block set up on every page that gives very brief information about me and my blog, as well as a few links to the rest of the site and some social sharing options. I worry that this will get flagged as duplicate content because a significant amount of my pages will contain the same information at the top of the page, front and center. Is there anything I can do to address this? Is it as much of a concern as I am making it? Should I work on finding some javascript/ajax method for loading that content into the page dynamically only for normal browser pageviews? Any thoughts or help would be great.
Intermediate & Advanced SEO | | grayloon0 -
How risky is temporarily moving high value SEO pages to a brand new domain?
Hi, I won't bore you with all the details but we may have to temporarily move part of an existing domain onto a separate domain for a couple of months. The content being moved includes most of our key branded and organic SERP pages. We've owned the new domain for years but it's never been live or indexed. After a couple of months, all the content will move back to the original domain but will move to a slightly different structure and different page names. Most of the page content will remain largely the same. I"m concerned, but don't really have any experience with this kind of thing. Can anyone shed some light. Perhaps on a scale of 1 to 5 you could give me your thoughts: 1. Should be fine, as long as you set up all the redirects properly 5. Do everything in your power not to do it! Using the new domain and other factors will be problematic. Thanks for any help you may be able to provide!
Intermediate & Advanced SEO | | rfjc0