New Site Launch - Redirecting Hundreds of Old Invalid URLs?
-
We have a client whose WMT shows a ton of "Not found" crawl errors after a new site launched. The URLs are largely a bunch of files that they had previously uploaded on their old site which have external links pointing at them.
What is their best course of action, if they don't have files on the new site that correspond with these old files? Redirect to the home page? Leave them 404ing? Customize 404 message?
(Note: They're mostly generic, non-human friendly URLs that are difficult to identify like /gallery3.php/ppage/3, g/interior.php/pid/3/sid/24, /uploads/1213196781.pdf)
-
Thanks Dirk, this is the direction we were leaning.
-
Thanks for the suggestions Patrick.
-
If the external links to these pages are ok in terms of quality, and you don't have a similar page on the new site, I would redirect these pages to the homepage. It would be a bit of a waste to loose good links to your site.
For the ones that have no (quality) incoming links - you could put a 404 (or in your case probably better a 410 - The requested resource is no longer available at the server and no forwarding address is known. This condition is expected to be considered permanent) - see also this video of Matt Cutts on this topic. As Patrick indicates - a custom version is more user friendly compared to a standard one.
rgds,
Dirk
-
Hi there
If these files are no longer relevant and have no where to go on the new site - make sure these files and pages have a custom 404.
Here are some suggestions on what to put on your custom 404.
You can also list these pages in your robots.txt file.
Hope this helps! Let me know if you need anything else - good luck!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Old product URLs still indexed and maybe causing problems?
Hi all, Need some expertise here: We recently (3 months ago) launched a newly updated site with the same domain. We also added an SSL and dropped the www (with proper redirects). We went from http://www.mysite.com to https://mysite.com. I joined the company about a week after launch of the new site. All pages I want indexed are indexed, on the sitemap and submitted (submitted in July but processes regularly). When I check site:mysite.com everything is there, but so are pages from the old site that are not on the sitemap. These do have 301 redirects. I am finding our non-product pages are ranking with no problem (including category pages) but our product pages are not, unless I type in the title almost exactly. We 301 redirected all old urls to new comparable product, or if the product is not available anymore to the home page. For better or worse, as it turns out and prior to my arrival, in building the new site the team copied much of the content (descriptions, reviews, etc) from the old site to create the new product pages. After some frustration and research I am finding the old pages are still indexed and possibly causing a duplicate content issue. Now, I gather there is supposedly no "penalty", per se, for duplicate content but a page or site will simply not show in the SERPs. Understandable and this seems to be the case. We also sell a lot of product wholesale and it turns out many dealers are using the same descriptions we have (and have had) on our site. Some are much larger than us so I'd expect to be pushed down a bit but we don't even show in the top 10 pages...for our own product. How long will it take for Google to drop the old and rank the new as unique? I have re-written some pages but much is technical specifications and tough to paraphrase or re-write. I know I could do this in Search Console but I don't have access to the old site any longer. Should I remove the 301s a few at a time and see if the old get dropped faster? Maybe just re-write ALL the content? Wait? As a site note, I'm also on a Drupal CMS with a Shopify ecommerce module so maybe the shop.mysite.com vs mysite.com is throwing it off with the products(?) - (again the Drupal non-product AND category pages rank fine). Thoughts on this would be much appreciated. Thx so much!
Intermediate & Advanced SEO | | mcampanaro0 -
Redirecting Old Websites to New Websites
Hi Everyone, We are about to take down a number of websites in favour of a new singular B2B hub and would be looking to redirect all of these sites to the new home. For SEO purposes, what would be the best way to do this? Due to the difference in setups and scale of the site, it would be difficult to correctly match up each page to page between the sites for individual 301 redirects. Could someone advise on the best plan of action? Thanks.
Intermediate & Advanced SEO | | chbiz0 -
Site-wide Canonical Rewrite Rule for Multiple Currency URL Parameters?
Hi Guys, I am currently working with an eCommerce site which has site-wide duplicate content caused by currency URL parameter variations. Example: https://www.marcb.com/ https://www.marcb.com/?setCurrencyId=3 https://www.marcb.com/?setCurrencyId=2 https://www.marcb.com/?setCurrencyId=1 My initial thought is to create a bunch of canonical tags which will pass on link equity to the core URL version. However I was wondering if there was a rule which could be implemented within the .htaccess file that will make the canonical site-wide without being so labour intensive. I also noticed that these URLs are being indexed in Google, so would it be worth setting a site-wide noindex to these variations also? Thanks
Intermediate & Advanced SEO | | NickG-1230 -
4000 new duplicate products on our ecommerce site, potential impact?
Hello, We've currently got 9500 products live on our site at the moment with ~2000 in this category that we're adding the new products in. All of these products we're adding are coming from a site that we own and we're trying to expand the range on our site (the 9500 product site has a lot more visitors than the 4000 product site). However, all these products imported I believe are atleast duplicates from the 4000 product site, but the first ones I have seen (500) are manufacturer duplicates. What issues are we potentially going to run in to? Just for extra information: We have no control over canonical/noindex/robots etc
Intermediate & Advanced SEO | | ThomasHarvey0 -
How to build PA and DA for a new site?
Hi Guys, Any good tips on how to build PA and DA for a new website about 3 months old now, and our DA is at 5 while PA 1. Any good ideas from past experiences on how to build these up? Cheers
Intermediate & Advanced SEO | | edward-may0 -
Move to new domain with new design and url
I have an e-commerce website that is template based and I have absolutely no control over it. Each product have quite good ranking in google. However, we are creating new website using asp.net mvc and host in azure. It has totally new design. Since I have no control over my old website, I cannot force the server to redirect each product page to my new website product page. This is what I have done so far. I told my old website provider to point my domain (ex. domainA.com) to new nameserver at dyndns I created a new zone and add a http redirect service to new domain (http://www.domainB.com) with 301 redirect I'm pretty sure that this is not enough since there is a difference in url like this Old: www.domainA.com/product/70/my-product-name New: www.domainB.com/product/1/my-new-product-name New route config: {product}/{id}/{name} As you can see, the structure is similar but the product id and name is different. Do I need to catch the incoming id and name from old website and 301 redirect it again to the correct one? If so, this will cause double 301 redirect and would this be a SEO problem? Thank you in advance for your answer.
Intermediate & Advanced SEO | | as142208080 -
New URL : Which is best
Which is best: www.domainname.com/category-subcategory or www.domainname.com/subcategory-category or www.domainname.com/category/subcategory or www.domain.com/subcategory/category I am going to have 12 different subcategories under the category
Intermediate & Advanced SEO | | Boodreaux0 -
New Site: Use Aged Domain Name or Buy New Domain Name?
Hi,
Intermediate & Advanced SEO | | peterwhitewebdesign
I have the opportunity to build a new website and use a domain name that is older than 5 years or buy a new domain name. The aged domain name is a .net and includes a keyword.
The new domain would include the same keyword as well as the U.S. state abbreviation. Which one would you use and why? Thanks for your help!0