480,000 Redirects - Is this hurting my SEO? PLEASE HELP!
-
Hello everyone,
I have over 480,000 internal rewrites in my Magento site. The reason I have so many is because I have over 1,500 products on my site and I update inventory every day via Bulk Import Extension. For the first few months I didn't realize that the URL was changing by a single digit every time I imported the .xml with new inventory counts. This of course created thousands and thousands of 404s.
I figured out how to avoid the digit change and then I started redirecting the 404s via a Bulk Rewrite Extension. I managed to rewrite over over 50,000 404s but new ones still pop up every day and there is no end to them in sight.
My traffic is terrible. Only about 40 organics daily. It's been like that for months. I can't get it off the ground and I think it's because of this excessive rewrite and 404 issue.
My question is, does having so many internal rewrites and 404s hurt my SEO efforts?
Would it be better just to start from scratch with a new site, new domain, new everything?
Please help me. I'm going crazy with this. Thank you.
Nico.
-
Hello Nicolas,
You're welcome! I am glad you found the answer helpful. I direct the SEO strategy for seOverflow, and yes we do work with small businesses. Fill out our contact form and we'll be in touch. You can also look into other reputable SEO agencies and freelancers listed here on Moz.com.
Nice site.
-
Thank you Everett. You don't know how much this helps me. I was dreading having to start the site from scratch, so I will continue with the one I have and work on it for as along as it takes. This is the site by the way: http://devilswink.com/
Do you offer SEO consulting services for small businesses in the U.S. Everret?
-
Nico,
Great question. Technically speaking, a permanent 301 redirect should stay up indefinitely. However, I have heard more than one Google employee say publicly that they should stay up for "at least a year". At that point I think you can take them down and the destination page will retain the link juice from the old links since Google will have supposedly updated their link graph. However, I don't trust that most Google employees really know what's going on under the hood all the time, and recommend leaving any redirects from pages with external links in place for as long as you have control over it (e.g. you obviously couldn't leave them in place across domains if you sold the old domain).
If the page doesn't have any internal or external links pointing to it you can safely remove the 301 redirect at any time. A year would be plenty.
-
Hi Everett,
Thank you very much for your feedback.
This does put me at ease because I was ready to pull the plug and start a new site from scratch.
Quick question, do old Rewrites disappear after a while? In others words, do they keep getting crawled?
If so, can I deleted them after a few months for example, or after a year, or do search engines need them to exist permanently because other wise they would generate new 404s?
Thank you.
Nico.
-
Hello Nico.
I think I have some good news for you. Unless there is live link to those URLs (internal or external) there is no need to redirect them. In my experience more than 99% (an educated guess) of product pages do not have any external links. So assuming you have not cleaned up your internal linking (if you haven't, you should) there really is no need for the 301 and you can just let it resolve as a 404.
As long as the old URLs return a 404 status code they should be removed from the index within a matter of weeks. However, if they don't have any external or internal links - again, most of those pages probably do not - it may take months for Google to decide to recrawl an indexed page without any link paths to it. Googlebot couldn't just "crawl" its way there, but would have to retrieve the URL from a database just to check it, which would take longer. I have a tested and recommended solution to this issue, which can be found here on the Moz.com blog.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Our clients Magento 2 site has lots of obsolete categories. Advice on SEO best practice for setting server level redirects so I can delete them?
Our client's Magento website has been running for at least a decade, so has a lot of old legacy categories for Brands they no longer carry. We're looking to trim down the amount of unnecessary URL Redirects in Magento, so my question is: Is there a way that is SEO efficient to setup permanent redirects at a server level (nginx) that Google will crawl to allow us at some point to delete the categories and Magento URL Redirects? If this is a good practice can you at some point then delete the server redirects as google has marked them as permanent?
Technical SEO | | WillyGx0 -
Images on Website for SEO
Good Morning, We have a magento website with hundreds of different products that have slight size variations. The image for each of these products looks the same (the only difference between the products is some of the dimensions) .... Would you recommend using the same image for each of these products and just use a generic file name that describes the overall product or would you give each product its own image with it's specific product name as the file name? Should I use 1 image for 500 different sku's or should i rename the file the name of each individual sku and load an individual image? The end user will not know the difference since all of the images will appear identical, simply asking from an SEO perspective. Thanks
Technical SEO | | Prime850 -
Canonical redirects
Hello, I have a quick question: I use wordpress for my website. I have a plugin for translating the website in other languages. Thus, I have 2 versions of urls, one with /en, one without (original languale). This has been seen as duplicate content. I have been advised that the best to do is to use canonical redirect. Should I use it on the general header.php (the only header I can find in the CMS), or should I redirect each page singularly? I believe the second is the best way, but I can't find headers and txt documents for each page in my FTP. As well I have seen this post, in which is explained that canonical redirects can be done directly in the general header.php http://www.bin-co.com/blog/2009/02/avoid-duplicate-content-use-canonical-url-in-wordpress-fix-plugin/ Is it true? You have any suggestion?
Technical SEO | | socialengaged
Thanks! 🙂 Eugenio0 -
Help needed please with 301 redirects in htaccess file.
In summary, we're currently having issues with our htaccess file. 301 redirects are going through to the new described URL but in addition the new URL is followed by a ? and the old URL. How can we get rid of the ? and previous URL so they don't appear as an ending. None of the examples we've found re this issue online appear to work. Can anyone please offer some advice? Can we use a RewriteRule to stop this happening? Here's a summary of the htaccess file REDIRECT CODE BEGINS HERE LONG LIST OF REDIRECTS, which appear to be set up perfectly fine. REDIRECT CODE ENDS DirectoryIndex index.php <ifmodule mod_rewrite.c="">RewriteEngine On Options +FollowSymLinks
Technical SEO | | petersommertravels
DirectoryIndex index.php
RewriteEngine On
RewriteCond $1 !^(images|system|themes|pdf|favicon.ico|robots.txt|index.php) [NC]
RewriteRule ^.htaccess$ - [F]
RewriteRule ^favicon.ico - [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule ^(.*)$ /index.php?/$1 [L]</ifmodule> DirectoryIndex index.php0 -
Help with google adsense
Hi i wonder if anyone can help me with google adsense. I am having trouble making money with google adsense. I have been altering my pages to try and get better results with google adsense but nothing works. my traffic at the moment is about 3000 visitors a day but this should be doubled to around 6000 a day within the next two months. here is the layout of a typical page and i would be grateful for any advice on how to alter it to make money with google adsense http://www.in2town.co.uk/showbiz-gossip/rihanna-news/rihanna-shocks-fans-over-her-sexy-body-claims
Technical SEO | | ClaireH-1848860 -
Seo on a dk site
hi my client has asked if we can seo their dk site , my question is does all link building and article submission have to be in danish
Technical SEO | | Westernoriental0 -
My home page 301 redirects - is this an SEO problem
When ever a browser calls my site canineconcepts.co.uk, it is automatically 301 redirected to canineconcepts.co.uk/en I am not sure if I should be concerned about this from an SEO perspective or not. Any thoughts?
Technical SEO | | CanineConcepts0 -
Redirect Multiple Domains
This is a follow-up question from one posted earlier this month. I can't linked to that because it's a private question so I'm trying to summarize it below. We have a number of domains – about 20 - (e.g. www.propertysharp.com) that point to our main domain ip adress (www.propertyshark.com) and share the same content. This is no black-hat strategy whatsoever, the domains were acquired several years ago in order to help people who mistyped the websites url to reach their desired destination. The question was whether to redirect them to our main domain or not. Pros were the reportedly millions of incoming links from these domains - cons was the fact that lots of issues regarding duplicate content could arise and we actually saw lots of some pages from these domains ranking in the search engines. We were recommended to redirect them, but to take it gradually. I have a simple question - what does gradually mean - one domain per week, per month?
Technical SEO | | propertyshark0