A Client Changed the Link Structure for Their Site... Not Just Once, but Twice
-
I have a client who's experiencing a number of crawl errors, which I've gotten down fo 9,000 from 18,000. One of the challenges they experience is that they've modified their URL structure a couple times.
First it was: site.com/year/month/day/post-name
Then it was: site.com/category/post-name
Now it's: site.com/post-nameI'm not sure of the time elapsed between these changes, but enough time has passed that the URLs for the previous two URL structures have been indexed and spit out 404s now.
What's the best/clean way to address this issue?I'm not going to create 9k redirect rules obviously, but there's got to be a way to address this issue and resolve it moving forward.
-
That looks like a very useful plugin Keri
-
Look for the "Redirection" plugin for Wordpress, that can help you make redirects easily. It's also an easy way to let you see what's a 404 on your site, and make redirects from the page listing the 404s.
-
Sure, here's the mod_rewrite guide straight from the horse's mouth
http://httpd.apache.org/docs/2.0/misc/rewriteguide.htmlHere's a nice beginner's guide:
http://www.addedbytes.com/for-beginners/url-rewriting-for-beginners/...with a little cheatsheet for some of the common commands:
http://www.cheatography.com/davechild/cheat-sheets/mod-rewrite/ -
Wow guys! Thanks for the responses. You've given me a couple things to think about.
The suggestions from Thomas and GYMSN might be the way I choose to plod ahead. Though, the rewrite rule seems like an interesting play. I have no idea what either of those lines mean. Heh. Is there a reference you could recommend, Woj, that might shed more light on rewrite rules?
A couple technical pieces to throw out there:
1. It's a WordPress site, so they don't have "folders," per se.
2. They run on linux, with an apache web server
-
Ryan is absolutely spot on.. you can create some redirection rules in the .htaccess (assuming the site's on apache)
something along the lines of..
RewriteRule ^([0-9]{4})/([0-9]{2})/([0-9]{2})/(.*)$ /$4 [R=301,NC,L]
RewriteRule ^category/(.*)$ /$1 [R=301,NC,L]
(of course if totally depends on your site structure & I'd test these on a staging server if possible)
-
Thomas did what we did and it worked fine. We lost a ton of Yahoo rankings for significant keywords though. I now personally never change /url/keywords unless I don't care about the Yahoo traffic (or there is none). Google has no problem with it.
-
You could do this with one or two clever regex commands, the composition of which I can't think of cos its too close to quitting time on Friday. But yeah you don't need 9000 rules.
-
Have you tried creating a redirect rule for each of the folders? From you example above the "post-name" has remained consistent. Therefore if you create a redirect from each folder then you should see a proper resolution with just appending the "post-name"
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moving html site to wordpress and 301 redirect from index.htm to index.php or just www.example.com
I found page duplicate content when using Moz crawl tool, see below. http://www.example.com
Intermediate & Advanced SEO | | gozmoz
Page Authority 40
Linking Root Domains 31
External Link Count 138
Internal Link Count 18
Status Code 200
1 duplicate http://www.example.com/index.htm
Page Authority 19
Linking Root Domains 1
External Link Count 0
Internal Link Count 15
Status Code 200
1 duplicate I have recently transfered my old html site to wordpress.
To keep the urls the same I am using a plugin which appends .htm at the end of each page. My old site home page was index.htm. I have created index.htm in wordpress as well but now there is a conflict of duplicate content. I am using latest post as my home page which is index.php Question 1.
Should I also use redirect 301 im htaccess file to transfer index.htm page authority (19) to www.example.com If yes, do I use
Redirect 301 /index.htm http://www.example.com/index.php
or
Redirect 301 /index.htm http://www.example.com Question 2
Should I change my "Home" menu link to http://www.example.com instead of http://www.example.com/index.htm that would fix the duplicate content, as indx.htm does not exist anymore. Is there a better option? Thanks0 -
When the site's entire URL structure changed, should we update the inbound links built pointing to the old URLs?
We're changing our website's URL structures, this means all our site URLs will be changed. After this is done, do we need to update the old inbound external links to point to the new URLs? Yes the old URLs will be 301 redirected to the new URLs too. Many thanks!
Intermediate & Advanced SEO | | Jade1 -
Should I try to change these links or no?
Hey guys, I need some advice on a link profile I'm currently working on. Our client sells a product in the hunting industry and has been around for over ten years. I just finished up classifying and looking at all of their links today and found that around half of them are sponsor links, links on "link pages," and a few directory links with almost all of them being followed. Because we are the first company to do SEO for them, I know that these aren't maliciously solicited links, but I'm worried that they may be having a negative impact on the site. Most of the links are coming from other non-competing websites in the outdoor industry which typically tends to have very antiquated sites with very antiquated practices. Essentially, I don't want to go out and try to nofollow or disavow all of these links that the website has had for a long time on other related websites if they're helping us, but I also don't want to be leaving anything up that could algorithmically be identified as spam. Below are some examples to show you what I'm referring to by the sponsor links and link resource pages. Any advice would be much appreciated. Thanks! Sponsored - http://www.becomeabetterhunter.com/ or http://outdoorobsession.tv/ or http://thehollywoodhunter.com/ Link Resource Pages - http://bowhuntamerica.com/links or http://cornerarchery.com/CompanyLinks.html
Intermediate & Advanced SEO | | CaddisInteractive0 -
Unpaid Followed Links & Canonical Links from Syndicated Content
I have a user of our syndicated content linking to our detailed source content. The content is being used across a set of related sites and driving good quality traffic. The issue is how they link and what it looks like. We have tens of thousands of new links showing up from more than a dozen domains, hundreds of sub-domains, but all coming from the same IP. The growth rate is exponential. The implementation was supposed to have canonical tags so Google could properly interpret the owner and not have duplicate syndicated content potentially outranking the source. The canonical are links are missing and the links to us are followed. While the links are not paid for, it looks bad to me. I have asked the vendor to no-follow the links and implement the agreed upon canonical tag. We have no warnings from Google, but I want to head that off and do the right thing. Is this the right approach? What would do and what would you you do while waiting on the site owner to make the fixes to reduce the possibility of penguin/google concerns? Blair
Intermediate & Advanced SEO | | BlairKuhnen0 -
Structure: Should an eCommerce blog have main menu links to each of the store category pages?
Hi, Should my eCommerce site's blog have menu links to the store's category pages? (like in the store itself) The meaning is that every blog post page will have links to category pages that are not related and probably weakens the in-text relevant links. The other option is to have menu links only to the blog category pages and in-article links to the relevant store category pages (maybe add menu button "Go to Store"). Thanks
Intermediate & Advanced SEO | | BeytzNet0 -
Link juice site structure?
If we have a top nav with contact us, about us, delivery, FAQ, Gallery, how to order ect but none of these we want to rank and then we have the usual left hand nav.are we wasting juice with the top nav and would we be better either removing it and putting them further down the page or consolidating them and adding an extra products tab so the product pages are first.
Intermediate & Advanced SEO | | BobAnderson0 -
Does duplicate content penalize the whole site or just the pages affected?
I am trying to assess the impact of duplicate content on our e-commerce site and I need to know if the duplicate content is affecting only the pages that contain the dupe content or does it affect the whole site? In Google that is. But of course. Lol
Intermediate & Advanced SEO | | bjs20100 -
How to properly link network of microsites and main sites?
Law firm has a main brand site (lawfirmname.com) with lots of content focusing on personal injury related areas of law. They also do other unrelated areas of law such as bankruptcy and divorce. They have a separate website for bankruptcy and a separate one for divorce. These websites have good quality content, a backlinking campaign, and are fairly large websites, with landing pages for different cities. They also have created local microsites in the areas of bankruptcy and divorce that target specific smaller cities that the main bankruptcy site and divorce site do not target well. These microsites have a good deal of original content and the content is mostly specific to the city the website is about, and virtually no backlinks. There are about 15 microsites for cities in bankruptcy and 10 in divorce and they rank pretty well for these city specific local searches. None of these sites are linked at all, and all 28 of the sites are under the same hosting account (all are subdomains of root domain of hosting account). Question, should I link these sites together at all and if so how? I considered making a simple and general page on the lawfirmname.com personal injury site for bankruptcy and divorce (lawfirmname.com/bankruptcy and lawfirmname.com/divorce) and then saying on the page something to the effect of "for more information on bankruptcy go to our main bankruptcy site at ....." and putting the link to the main bankruptcy site. Same for divorce. This way users can go to lawfirmname.com site and find Other Practice Areas, go to bankruptcy page, and link to main bankruptcy site. Is this the best way to link to these two main sites for bankruptcy and divorce or should I be linking upward? Secondly, should I link the city specific microsites to any of the other sites or leave them completely separate? Thirdly, should all of these sites be hosted on the same account or is this something that should be changed? I was considering not linking the city specific sites at all, but if I did this I didn't know if I should create different hosting accounts for them (which could be expensive). The sites work well in themselves without being linked, but wanted to try to network them in some way if possible without getting penalized or causing any issues with the search engines. Any help would be appreciated on how to network and host all of these websites.
Intermediate & Advanced SEO | | broca777110