How to move domain content w Penguin Penalty?
-
Hey guys,
I've come to the conclusion the sheer amount of crap links a site of ours has is un repairable. We own a .net version with the same brand name so I'm planning to move our ecommerce store over with all its content.
I can move the site in one swoop but I believe Google will see it as duplicate content if we don't allow the old site to de index first. I would simply take it down for a month but we still get some orders now and then.
Anyone have any ideas? I was thinking of leaving an image up on each page that is no index no follow linked to the new site that explains the site is being moved, etc.
-
If you're trying to completely remove the domain, Anthony's suggestion about using Google's URL removal tool is the quickest way to go.
You'll first want to block crawler access in your robots.txt, then choose the option to "remove directory" in webmaster tools. http://support.google.com/webmasters/bin/answer.py?hl=en&answer=1663427
(Note: robots.txt by itself DOES NOT prevent Google from indexing your pages, it only blocks them from crawling. Using only robots.txt means your pages are likely to stay in the index for quite some time)
That takes care of Google. Bing's process isn't quite as smooth. I'd also throw a meta robots "NOINDEX, FOLLOW" tag on all your pages - this will help with other search engines as well.
You may want to include a message on your old site instructing visitors to update their bookmarks and links - this may help aid with the transition.
Keep in mind, this will severe all links from your old domain, and none of your built up link equity will transfer over. Obviously, you've given this some thought in order to take such a move.
Hope this helps. Best of luck!
-
Per google webmaster tools:
Removing an entire directory or site
In order for a directory or site-wide removal to be successful, the directory or site must be disallowed in the site's robots.txt file. For example, in order to remove the http://www.example.com/secret/ directory, your robots.txt file would need to include:
User-agent: *
Disallow: /secret/
It isn't enough for the root of the directory to return a 404 status code, because it's possible for a directory to return a 404 but still serve out files underneath it. Using robots.txt to block a directory (or an entire site) ensures that all the URLs under that directory (or site) are blocked as well. You can test whether a directory has been blocked correctly using either the Fetch as Googlebot or Test robots.txt features in Webmaster Tools.Only verified owners of a site can request removal of an entire site or directory in Webmaster Tools. To request removal of a directory or site, click on the site in question, then go to Site configuration > Crawler access > Remove URL. If you enter the root of your site as the URL you want to remove, you'll be asked to confirm that you want to remove the entire site. If you enter a subdirectory, select the "Remove directory" option from the drop-down menu.
-
Thanks for the input. So you would put up the new site immediately? Or would you wait a certain amount of time after you take down the old site and put up the new robots.txt file?
I want to make sure Google doesn't see the new site as dup content.
-
I would suggest no index no follow in the old sites robots.txt file. Take down entire site with exception to a blank index page with text stating your site has moved to the new location, and the robots.txt file. I would not have a hot link to new site.
Then bring up the new site. On the next indexing, google should pick up the no index no follow from old site and start the indexing for the new site. I think that would be the best option so that you don't miss out on any potential business or orders.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Domain name change
Here's the scenario... Client has two domain names: domain.com - targeting one country (Australia) otherdomain.com - targeting all other countries Both have identical products, but different currencies (AU$ and US$). The problem (as most of you will know) is that without using a sub-domain or country-code top-level domains, Google has no idea which domain should be served for which domain. Furthermore, because the root domain is different, Google doesn't see any connection between the two - other than the fact they have identical products! My recommendation to the client is to change to: domain.com to domain.com.au otherdomain.com to domain.com Arguably, we could leave the second one alone. But I think it's better for the brand to use the same root domain for each. Obviously this means both will need to be redirected. Since NONE of the pages within the sites will change, do we need to redirect every page, or just the root domain? Any other risks or concerns we should know about?
Intermediate & Advanced SEO | | muzzmoz0 -
Interstitial Penalty?
We have an ecommerce website, and we show a popup for first time visitors to our desktop site to join our email list. Google has cached pages with the popup. Can I assume that this is a problem?
Intermediate & Advanced SEO | | AMHC0 -
Single domain or a subfolder?
One of my clients is wondering whether they should move they stand alone business website to a subfolder of their brand website. For example, from http://www.johnlewisforbusiness.com to http://www.johnlewis.com/business. Do you guys think it's a good idea from SEO point of view? Can you recommend any articles on this? What is the expected loss of current value by changing domain and migrating URLs?
Intermediate & Advanced SEO | | Adido-1053990 -
Removing duplicate content
Due to URL changes and parameters on our ecommerce sites, we have a massive amount of duplicate pages indexed by google, sometimes up to 5 duplicate pages with different URLs. 1. We've instituted canonical tags site wide. 2. We are using the parameters function in Webmaster Tools. 3. We are using 301 redirects on all of the obsolete URLs 4. I have had many of the pages fetched so that Google can see and index the 301s and canonicals. 5. I created HTML sitemaps with the duplicate URLs, and had Google fetch and index the sitemap so that the dupes would get crawled and deindexed. None of these seems to be terribly effective. Google is indexing pages with parameters in spite of the parameter (clicksource) being called out in GWT. Pages with obsolete URLs are indexed in spite of them having 301 redirects. Google also appears to be ignoring many of our canonical tags as well, despite the pages being identical. Any ideas on how to clean up the mess?
Intermediate & Advanced SEO | | AMHC0 -
Meta canonical or simply robots.txt other domain names with same content?
Hi, I'm working with a new client who has a main product website. This client has representatives who also sells the same products but all those reps have a copy of the same website on another domain name. The best thing would probably be to shut down the other (same) websites and redirect 301 them to the main, but that's impossible in the minding of the client. First choice : Implement a conical meta for all the URL on all the other domain names. Second choice : Robots.txt with disallow for all the other websites. Third choice : I'm really open to other suggestions 😉 Thank you very much! 🙂
Intermediate & Advanced SEO | | Louis-Philippe_Dea0 -
Moving to a new domain
We currently rank well in our niche on a long (and ambiguous) domain, but want to rebrand and have a shorter and more memorable domain. Keeping in mind we're already pointing good links at the new domain (301ing them to the old site), how long should we age the domain before switching the content and 301ing the old site?
Intermediate & Advanced SEO | | errspy0 -
301 Redirecting multiple domains to brand new domain
Hi guys, I have read quite a bit of stuff on 301 redirects after Penguin. Hoping someone could help me out. im looking at a way to do a legit 301 redirect without passing the penalty. I have acquired two businesses, business1 and business2, that both had websites that were hit by penguin. Ive anaylsed there backlinks and theres a lot of spammy forum links and comments and I was also informed they were both using buildmyrank. A side note, buiness2 only started using BMR after it noticed business1 have large amounts of high PR links. business1.com was ranking at position 1 till the penguin hit. Business2.com was ranking around page 2 I work in the same arena as these two businesses and didnt generate any business via the internet. When these 2 businesses failed (due to loss of rankings and traffic) i decided to take them over. What I am thinking of doing is 301'ing both business domains to my brand new, zero links, domain which will be the name of my new company. I will combine the content from both sites, around 1000 pages, in to the new one. So my question is, does 301'ing multiple domains, that target the same keywords, and operate in the same niche, look less "spammy" then 301'ing 1 domain? I'm trying to look at it in the eyes of google. It is a legit merging of businesses. Thanks for your help, really appreciate your time
Intermediate & Advanced SEO | | JohnPeters0 -
Root domain or sub domain? WWW. or NOT WWW......
I am a little confused! I use vidahost whom I have to say I find very helpful. I currently have the domains www.fentonit.co.uk and www.fentonit.com, now the websites was set up using the www.fentonit.com and I have www.fentonit.co.uk as a parked domain pointed to the www.fentonit.com. Confused yet? Now because I wanted the website to show www.fentonit.co.uk I added some code I was given by the guys to the .hta access file and viola up it comes as the .co.uk which is what I wanted. So if your still here and havent A: Killed yourself yet or B: Went to the Pub Then my questions are: 1. Is there going to be an issue from an SEO point of view having my site set up this way and if so how do I resolve it? 2. Would I be better using the root domain fentonit.co.uk (I think this is the root domain, although it iscurrently parked and pointed) as opposed to the sub www domain?.......and finally.......? 3. If it is set up as I stated what exactly would be my root domain, would it be the .co.uk or the .com? Sorry and I completely understand if your not interested in answering it but if you do.....Thanks in advance and I'll take you to the pub...lol Craig www.fentonit.co.uk ( i think)
Intermediate & Advanced SEO | | craigyboy1