New Site Structure and 404s. Should I redirect everything?
-
Hi fellow Mozzers,
I've recently re-released a site and also took the opportunity to change/clean up the URL structure. As a result of this Google is starting to report many 404s such as below;
blog/tag/get-fit/
blog/tag/top-presents/
Most of these 404 errors are from tag or category pages which simply don't exist any more (because they were unnecessary, crap or irrelevant). Although there's also a few posts I've removed.
My question is whether it's worth redirecting all these tags and pages to the root directory of the site's new blog (as there isn't really a new page which is similar or appropriate) or just to leave them as 404 errors. Bearing in mind;
-
They don't really rank for anything
-
There's little if any links pointing to these pages
Thanks.
-
-
The 410 Gone essentially means "I'm aware that page used to be here, but it has been taken away on purpose and it won't be coming back". Whereas 404 Not Found means "I don't know anything about that page - as far as I know it never existed".
You can see how the first scenario applies to your pages much more specifically than the second.
But as Tom points out, if you don't have the URLs in your sitemap or xml sitemap and nobody's linking to them, the 404s will eventually cause the Search engines to drop the URLs from their index.
Frankly I'd just let the URLs drop and spend the time on something more valuable. Go earn a few more links
Paul
-
ok, I'll probably seek out any pages with the chance of link juice and get those re-directed to the root.
Anything which is utterly pointless or too rubbish to care about, I think I'll let die.
Thanks again
-
Hi Paul,
Yes, that's where my thoughts were heading - it's nice to get confirmation
A 410 code?... interesting. I hadn't considered that
Thanks
-
Your mileage may vary, but I've redirected a lot more than 100 before to a root domain and everything has gone OK. If you could split it up, it might ease your worries - but as you said earlier, there isn't a relevant page to point these URLs to, so the root domain should suffice.
I would definitely consider what Paul has to say below, which is what I was trying to get at in my second point. There's also a point that if 404s are a perfectly normal occurrence for websites. Again, provided that there isn't a gregarious amount (which ~100 definitely isn't), it won't be an issue to return a few 404s. It only would be if it interrupted a user journey, which I can't imagine /tag/ subfolders would.
Either way mate, I think you'll be fine how you pursue.
-
You've pretty much answered all the standard questions that would lead to a decision, Alex - and the answer is "no".
- Do the existing pages have any rank? Nope
- Any valuable incoming links? Nope
- Does the new site have equivalent or equally relevant content to point to? No again
So you knew exactly the questions to ask, and your instincts were right on. Perfect scenario where the urls should just be left to die.
Technically, this sort of url should return a 410 Gone server response, but that would take some extra coding. Returning 404 Not Found in this instance is pretty common and will do the job.
Hope that helps;
Paul
-
Hi Tom,
thanks for the reply.
Do you think it's fine to re-direct them all to the blog's root page?
The concern I have is that, there's probably about 100 pages and I won't be re-directing to a page which is really relevant to the original. I don't want it to appear manipulative in anyway.
-
Provided that there aren't an absolute ton of them (like thousands/tens of thousands), then I would 301 redirect them. If there was a massive ammount, too many redirects in your .htaccess can slow your site, but that's only in extreme cases.
Having said that, if there are no links pointing to the page and the URLs aren't in the sitemap, then eventually Google will stop trying to crawl them (as there's nothing pointing to the URL). I'd just 301 redirect anyway - any little bit of "strength/juice" that they did have could help another page.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What's the best way to use redirects on a massive site consolidation
We are migrating 13 websites into a single new domain and with that we have certain pages that will be terminated or moved to a new folder path so we need custom 301 redirects built for these. However, we have a huge database of pages that will NOT be changing folder paths and it's way too many to write custom 301's for. One idea was to use domain forwarding or a wild card redirect so that all the pages would be redirected to their same folder path on the new URL. The problem this creates though is that we would then need to build the custom 301s for content that is moving to a new folder path, hence creating 2 redirects on these pages (one for the domain forwarding, and then a second for the custom 301 pointing to a new folder). Any ideas on a better solution to this?
Intermediate & Advanced SEO | | MJTrevens0 -
Redirecting Pages During Site Migration
Hi everyone, We are changing a website's domain name. The site architecture will stay the same, but we are renaming some pages. How do we treat redirects? I read this on Search Engine Land: The ideal way to set up your redirects is with a regex expression in the .htaccess file of your old site. The regex expression should simply swap out your domain name, or swap out HTTP for HTTPS if you are doing an SSL migration. For any pages where this isn’t possible, you will need to set up an individual redirect. Make sure this doesn’t create any conflicts with your regex and that it doesn’t produce any redirect chains. Does the above mean we are able to set up a domain redirect on the regex for pages that we are not renaming and then have individual 1:1 redirects for renamed pages in the same .htaccess file? So have both? This will not conflict with the regex rule?
Intermediate & Advanced SEO | | nhhernandez0 -
What's the best way to A/B test new version of your website having different URL structure?
Hi Mozzers, Hope you're doing good. Well, we have a website, up and running for a decent tenure with millions of pages indexed in search engines. We're planning to go live with a new version of it i.e a new experience for our users, some changes in site architecture which includes change in URL structure for existing URLs and introduction of some new URLs as well. Now, my question is, what's the best way to do a A/B test with the new version? We can't launch it for a part of users (say, we'll make it live for 50% of the users, an remaining 50% of the users will see old/existing site only) because the URL structure is changed now and bots will get confused if they start landing on different versions. Will this work if I reduce crawl rate to ZERO during this A/B tenure? How will this impact us from SEO perspective? How will those old to new 301 URL redirects will affect our users? Have you ever faced/handled this kind of scenario? If yes, please share how you handled this along with the impact. If this is something new to you, would love to know your recommendations before taking the final call on this. Note: We're taking care of all existing URLs, properly 301 redirecting them to their newer versions but there are some new URLs which are supported only on newer version (architectural changes I mentioned above), and these URLs aren't backward compatible, can't redirect them to a valid URL on old version.
Intermediate & Advanced SEO | | _nitman0 -
Google cache is showing my UK homepage site instead of the US homepage and ranking the UK site in US
Hi There, When I check the cache of the US website (www.us.allsaints.com) Google returns the UK website. This is also reflected in the US Google Search Results when the UK site ranks for our brand name instead of the US site. The homepage has hreflang tags only on the homepage and the domains have been pointed correctly to the right territories via Google Webmaster Console.This has happened before in 26th July 2015 and was wondering if any had any idea why this is happening or if any one has experienced the same issueFDGjldR
Intermediate & Advanced SEO | | adzhass0 -
What to do about old urls that don't logically 301 redirect to current site?
Mozzers, I have changed my site url structure several times. As a result, I now have a lot of old URLs that don't really logically redirect to anything in the current site. I started out 404-ing them, but it seemed like Google was penalizing my crawl rate AND it wasn't removing them from the index after being crawled several times. There are way too many (>100k) to use the URL removal tool even at a directory level. So instead I took some advice and changed them to 200, but with a "noindex" meta tag and set them to not render any content. I get less errors but I now have a lot of pages that do this. Should I (a) just 404 them and wait for Google to remove (b) keep the 200, noindex or (c) are there other things I can do? 410 maybe? Thanks!
Intermediate & Advanced SEO | | jcgoodrich0 -
Organic keywords have dropped significantly in a short time period when relaunching site, but all 301 redirects are working properly.
We redesigned a site and relaunched it on the same domain. All 301 redirects were completed and are working properly. Around the same time, they fired an seo company who was published inbound links to their site on spammy directories (and this was during the same time period that Google's Hummingbird algorithm change took place). After the website relaunch, their keyword rankings fell off dramatically; and in all of our research, we're not seeing what has caused this issue. I'm not seeing any red flags in their moz reports or even in their google analytics traffic; but organic keywords are way down, and now leads from organic traffic are also way down. Help??
Intermediate & Advanced SEO | | grapevinemktg0 -
How best to structure wordpress site.
I need help on how to structure my wordpress site to avoid duplicate content issues. Basically I have a main category page for each of my targeted keywords (about 12). From each of those though I want to create a category for each county in the uk and then about 15 towns within each county. This means I'm creating a LOT of categories. Eg: /plumbers/lincolnshire/lincoln x 15 other counties and towns /local-plumbers/cambridgeshire/cambridge x 15 other counties and towns (I have about 12 main keywords I'm going after) I'm basically creating a category for every town in the UK going after long tail keywords. What is the best way to manage this in wordpress? Advice from another question I posted on here is to write a unique category description for each one as the posts in each category are almost identical. The other problem here is I'm ending up with hundreds of links on a page. (They can't all be seen by the user as I'm using a drop down menu plugin). Any advice appreciated.
Intermediate & Advanced SEO | | SamCUK0 -
New Domain name vs Low Ranked Existing Site
I am going to build a new site. I could hang it off an existing site with similar content or buy a new keyword rich domain and start over. The existing site does not have much trust or authority beyond the domain being registered for 5 plus years. I would prefer to start over and build linksfrom scratch but I realize we are starting at the bottom. The keywords we will be competing against are not super competetive so I think we can get ranking within 6 months or so. These post Panda days I am rethinking everything so any input is appreciated. I did a similar niche site a few years ago and found the site ranked well fairly quickly for its little nice. Today though it may be different. I have no experience in buying domains and would have no idea where to start there. New or existing? Thanks for any input.
Intermediate & Advanced SEO | | Reportcard0