Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Mass URL changes and redirecting those old URLS to the new. What is SEO Risk and best practices?
-
Hello good people of the MOZ community,
I am looking to do a mass edit of URLS on content pages within our sites. The way these were initially setup was to be unique by having the date in the URL which was a few years ago and can make evergreen content now seem dated. The new URLS would follow a better folder path style naming convention and would be way better URLS overall.
Some examples of the **old **URLS would be
https://www.inlineskates.com/Buying-Guide-for-Inline-Skates/buying-guide-9-17-2012,default,pg.html
https://www.inlineskates.com/Buying-Guide-for-Kids-Inline-Skates/buying-guide-11-13-2012,default,pg.html
https://www.inlineskates.com/Buying-Guide-for-Inline-Hockey-Skates/buying-guide-9-3-2012,default,pg.html
https://www.inlineskates.com/Buying-Guide-for-Aggressive-Skates/buying-guide-7-19-2012,default,pg.htmlThe new URLS would look like this which would be a great improvement
https://www.inlineskates.com/Learn/Buying-Guide-for-Inline-Skates,default,pg.html
https://www.inlineskates.com/Learn/Buying-Guide-for-Kids-Inline-Skates,default,pg.html
https://www.inlineskates.com/Learn/Buying-Guide-for-Inline-Hockey-Skates,default,pg.html
https://www.inlineskates.com/Learn/Buying-Guide-for-Aggressive-Skates,default,pg.htmlMy worry is that we do rank fairly well organically for some of the content and don't want to anger the google machine.
The way I would be doing the process would be to edit the URLS to the new layout, then do the redirect for them and push live.
Is there a great SEO risk to doing this?
Is there a way to do a mass "Fetch as googlebot" to reindex these if I do say 50 a day? I only see the ability to do 1 URL at a time in the webmaster backend.
Is there anything else I am missing?I believe this change would overall be good in the long run but do not want to take a huge hit initially by doing something incorrectly. This would be done on 5- to a couple hundred links across various sites I manage.
Thanks in advance,
Chris Gorski -
Hey K.
Happy you found value in everyone's response here.
For your URL, I see your structure resemble a blog structure with your subfolder being "learn" instead of "blog". So if it is, your final URL that you described is fine (learn/buying-guide-for-inline-skates).
As a counterpoint, if you had this content as a hub page (some form of content pillar/topic cluster) for example, it would've been a good possibility to just change the URL structure since you have many Buying Guides. Different types of content, different ways to put it on your site.
Like so: /buying-guide/inline-skatesAt the end of the day, the structure needs to be logical and reflective of where your content is. I think you got it right anyway.
For the execution part;
- I would not recommend using the "crawl as Googlebot" function in search console. It would be way too time-consuming for you, and it is not really designed for that kind of work.
- Instead, update your sitemap with the final URLs and send it again via SearchConsole / Bing Webmastertools.
- Also, don't forget to go ahead and change the internal links pointing to the old URL to point directly to the new ones or else you'll just have a bunch of 301's crawled by Google. Make it seamless.
- Monitor. Monitor. Monitor.
Hope that helped!
-
Thanks all the for responses and I am taking to heart all your suggestions. I will make all the URLs lowercase as this is something I didn't take into account.
Due to site hosting platform limitation for the URL structure I need to have a value in the bold areas below:
https://www.inlineskates.com/learn/buying-guide-for-inline-skates,default,pg.html
The first value "learn" doesn't have to be unique but the 2nd "learn/buying-guide-for-inline-skates" is the driver for the URL and must be unique, so the short URL like https://www.inlineskates.com/buying-guide/Inline-Skates,default,pg.html wouldn't work since I would only be able to use it 1x for inline skates and have several content pieces that I would need to add that to, size guides, charts, etc.
My main concern is about the process of doing the redirects, say I do 50 in one day, what is my next step? Is there a way to run the fetch as googlebot to a handful of pages as I only see the ability to add 1 URL at a time in the webmaster backend. If I go ahead and do this I just want to do it in the smartest way possible.
Thanks, Chris
-
And to add to that, Moz has a great resource on how to write them (emphasis mine);
-
Keeping URLs as simple, relevant, compelling, and accurate as possible is key to getting both your users and search engines to understand them.
-
URLs should be definitive but concise.
-
When necessary for readability, use hyphens to separate words. URLs should not use underscores, spaces, or any other characters to separate words.
-
Use lowercase letters. In some cases, uppercase letters can cause issues with duplicate pages.
-
Avoid the use of URL parameters, if possible, as they can create issues with tracking and duplicate content. If parameters need to be used (UTM codes, e.g.), use them sparingly.
Source - https://moz.com/learn/seo/url
-
-
The new URLs seem pretty verbose.
If this was my site, I would consider...
https://www.inlineskates.com/Buying-Guide/Inline-Skates/
https://www.inlineskates.com/Buying-Guide/Kids-Inline-Skates/
https://www.inlineskates.com/Buying-Guide/Inline-Hockey-Skates/
https://www.inlineskates.com/Buying-Guide/Aggressive-Skates/My breadcrumbs would look similar....
Home >> Buying Guide >> Inline Skates
-
I've heard recent claims that you no longer lose link juice when 301ing, but I've also had personal experience with taking a hit to organic traffic when doing this type of major URL restructuring. You're right, in the long run, it does pay off, but you're also right that there may be a ding in the short term.
While you're in there, I would highly, highly recommend taking the additional step of removing ",default,pg" from your URLs. There are two problems with that string - one is it contains commas, which can be problematic. Anything other than plain text and hyphens is generally discouraged in URLs. The other problem is that "default pg" part is watering down your URL and does not contribute to making the links short and easy to type and understand for humans. Since you are undertaking such a massive restructuring, now is the time to make these additional tweaks - as it's less painful to do All The Things at once and take one hit, than it would be to take a hit now and another hit later when you tackle that separately. I personally also always use only lowercase characters in my URLs as it's easier to type and depending on the server OS improper capitalization may make it so they don't reach the right page, but that is more of a UX preference than an SEO enhancement.
Another couple of tips: I find it extremely helpful to map everything out on a spreadsheet in this type of migration. Helps me make sure I have the old and the new mapped out, and also helps to have a checklist to go through systematically. I also tend to group related pages in batches, as presumably related pages will be linked to each other, and once Google comes crawling back over one page it will see the new URLs and crawl those too, faster than it would crawl unrelated pages. Finally, use a HTTP header check tool (google that and you'll find several) after you add the redirects just to make 100% certain you've set everything up correctly. And where possible, mass-redirect in a single .htaccess rule rather than one by one.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEO Best Practices regarding Robots.txt disallow
I cannot find hard and fast direction about the following issue: It looks like the Robots.txt file on my server has been set up to disallow "account" and "search" pages within my site, so I am receiving warnings from the Google Search console that URLs are being blocked by Robots.txt. (Disallow: /Account/ and Disallow: /?search=). Do you recommend unblocking these URLs? I'm getting a warning that over 18,000 Urls are blocked by robots.txt. ("Sitemap contains urls which are blocked by robots.txt"). Seems that I wouldn't want that many urls blocked. ? Thank you!!
Intermediate & Advanced SEO | | jamiegriz0 -
Best practice for deindexing large quantities of pages
We are trying to deindex a large quantity of pages on our site and want to know what the best practice for doing that is. For reference, the reason we are looking for methods that could help us speed it up is we have about 500,000 URLs that we want deindexed because of mis-formatted HTML code and google indexed them much faster than it is taking to unindex them unfortunately. We don't want to risk clogging up our limited crawl log/budget by submitting a sitemap of URLs that have "noindex" on them as a hack for deindexing. Although theoretically that should work, we are looking for white hat methods that are faster than "being patient and waiting it out", since that would likely take months if not years with Google's current crawl rate of our site.
Intermediate & Advanced SEO | | teddef0 -
Best Practices for Converting PDFs to HTML
We're working with a client who gets about 80% of their organic, inbound search traffic from links to PDF files on their site. Obviously, this isn't ideal, because someone who just downloads a PDF file directly from a Google query is unlikely to interact with the site in any other way. I'm looking to develop a plan to convert those PDF files to HTML content, and try to get at least some of those visitors to convert into subscribers. What's the best way to go about this? My plan so far is: Develop HTML landing pages for each of the popular PDFs, with the content from the PDF, as well as the option to download the PDF with an email signup. Gradually implement 301 redirects for the existing PDFs, and see what that does to our inbound SEO traffic. I don't want to create a dip in traffic, although our current "direct to inbound" traffic is largely useless. Are their things I should watch out for? Will I get penalized by Google for redirecting a PDF to HTML content? Other things I should be aware of?
Intermediate & Advanced SEO | | atourgates0 -
Best-practice URL structures with multiple filter combinations
Hello, We're putting together a large piece of content that will have some interactive filtering elements. There are two types of filters, topics and object types. The architecture under the hood constrains us so that everything needs to be in URL parameters. If someone selects a single filter, this can look pretty clean: www.domain.com/project?topic=firstTopic
Intermediate & Advanced SEO | | digitalcrc
or
www.domain.com/project?object=typeOne The problems arise when people select multiple topics, potentially across two different filter types: www.domain.com/project?topic=firstTopic-secondTopic-thirdTopic&object=typeOne-typeTwo I've raised concerns around the structure in general, but it seems to be too late at this point so now I'm scratching my head thinking of how best to get these indexed. I have two main concerns: A ton of near-duplicate content and hundreds of URLs being created and indexed with various filter combinations added Over-reacting to the first point above and over-canonicalizing/no-indexing combination pages to the detriment of the content as a whole Would the best approach be to index each single topic filter individually, and canonicalize any combinations to the 'view all' page? I don't have much experience with e-commerce SEO (which this problem seems to have the most in common with) so any advice is greatly appreciated. Thanks!0 -
How to de-index old URLs after redesigning the website?
Thank you for reading. After redesigning my website (5 months ago) in my crawl reports (Moz, Search Console) I still get tons of 404 pages which all seems to be the URLs from my previous website (same root domain). It would be nonsense to 301 redirect them as there are to many URLs. (or would it be nonsense?) What is the best way to deal with this issue?
Intermediate & Advanced SEO | | Chemometec0 -
301 redirect subdirectory to new domain
I'm planning on using 301 redirects to spin out a subdirectory of my current website to be its own separate domain. For instance, I currently have a website www.website.com and my writers write tech news at www.website.com/news. Now I want to 301 redirect www.website.com/news to www.technews.com. Will this have any negative impact on SEO? What are some steps that I can take to minimize these impacts?
Intermediate & Advanced SEO | | Chris_Bishop1 -
How do I go about changing a 302 redirect to a 301.
Hello Friends! Thanks for viewing my question. Ok,My question today is How do I go about redirecting a 302 link to a 301 link. I understand the benefits of doing this as far as link juice and how the Search Engines views the two Re-Directs. I am wanting to know where I would start to do this. Thank you in advance for any help or suggestions!
Intermediate & Advanced SEO | | FrontlineMobility0 -
Htaccess Redirect with %C2%A0 in URL
Below is my setup for redirects in .htaccess file in my root word press installation. The www to non-www works well, so no problems there Other page redirects work well, too (example: redirect 301 /some-page/ http://mysite.com/another-page/ (I didn't post those because I have a few too many : ) So here it goes... RewriteEngine On
Intermediate & Advanced SEO | | pepsimoz
RewriteCond %{HTTP_HOST} ^www.mysite.com$ [NC]
RewriteRule ^(.*)$ http://mysite.com/$1 [R=301,L] BEGIN WordPress <ifmodule mod_rewrite.c="">RewriteEngine On
RewriteBase /
RewriteRule ^index.php$ - [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /index.php [L]</ifmodule> END WordPress redirect 301 /archives/10-college- majors/ http://mysite.com/archives/10-college-majors/ redirect 301 /archives/10-college-%20majors/ http://mysite.com/archives/10-college-majors/ redirect 301 /archives/10-college-%C2%A0majors/ http://mysite.com/archives/10-college-majors/ I'm having a problem with the last 301 redirect: redirect 301 /archives/10-college-%C2%A0majors/ http://mysite.com/archives/10-college-majors/ not working... As you can see I've tried using other varations of the "space" but no go. I also used a redirect in cPanel's Redirect screen; testing all the possible options + wildcard I've also tried this: http://serverfault.com/questions/201829/using-special-characters-in-apache-mod-rewrite-rule (perhaps unsuccessfully, because it caused a 500 server error and it's a different situation in my case) I also saw something here: http://www.webmasterworld.com/apache/3908682.htm but I don't know if it works and how I would implement that + do so without compromising ALL other redirects. Note: the URL displays with a space in the address bar of all major web browsers: http://mysite.com/10-college- majors/ and goes to a 404 page I have a goregous page / PR6 / high authority site linking to the URL on my site, but they copied the URL with a space somehow. I contacted the person responsible for the website and he claims it works fine (aka he didn't check it). Is there a clean way to redirect ONLY this problematic URL without compromising other redirects, etc? Any ideas would be great. I'll respond with progress. Thanks in advance. UPDATE the redirect works, and it did work. Even so, when looking at source of page linking to mine, the URL looks like this: ``` http://mysite.com/archives/10-college- majors/ Clicking the URL in Source View in FireFox takes me to ``` http://mysite.com/archives/10-college-%C2%A0majors/ none of my 301 redirects should direct there. I don't have any redirect plugins either.0