Massive URL Migration with thousands of 301
-
Hey Everyone!
I'm currently working on a project that we have A Lot of product pages and we have thousands of URL's that need to be 301'd over. I know this can be a major issue and could lead to tons of errors. What is everyone's thought of doing such a huge Migration, Should I do it all in phases? or should I do them all at once so they can all be indexed together?
What would you suggest to be the best way to go about doing such a massive migration?
-
I have never done a migration of a website with so many URL's it is kind of overwhelming. I do have a 404 page with the catchall rule in place. See i'm coming from the business side of SEO i'm not really the developer getting in there and actually doing the migration ( I tip my hat to all you developers without you I am nothing but a voice). I'm guiding my developer to the safest route. Doing the migration all at once does make sense to prevent both sites being cached
-
Webmaster's Tools has been pretty good to me regarding telling me about 404s I may have missed after a migration, but using the tactic I described really limits missed URLs, assuming you have a good grasp on the subdirectories of your site.
Phasing is an option, but say, in the case of a redesign or domain migration, I like to do it all at once. That way Google isn't trying to index the website on two different URL structures or domains. Doing it in one shot makes it clear to Google what has happened, since everything is now moved, instead of just a fraction at a time. I'm sure this is a point of debate, and not necessarily the definitive way to do it.
-
Hey Thanks for the response!
I'm currently dealing with a site that has a large duplication problem and i'm Canon tagging them all to then 301 them all over. Why shouldn't I do a phase approach though? Wouldn't it be easier to see where errors happen if I come at this migration with a phased approach?
-
Assuming not all of your pages hold incredible value and don't get visited a lot, I don't think you'd need to do it in phases. You can save yourself some time by throwing in some regex to grab large chunks of URLs at a time and redirect them that way.
Your more valuable pages should be one-to-one redirected as to not confuse users and to retain the most juice to the right place, but for less important pages, grab a bunch at a time.
One way to do this is:
redirectmatch 301 ^/sub/directory/(.*)$ http://site.com/newdirectory
This would grab all pages under site.com/new/directory/ANYTHING to site.com/newdirectory/.
Hope that helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Park Or 301
We main domain is **.com, but we have the other domain by name .ir.
Intermediate & Advanced SEO | | Pintapin
So now we want to remove (.ir).
what should we do? ,301? , park domain? Disallow?
Which is better for SEO?0 -
Preserve domain on 301 redirect?
We have a domain solely used for print advertising that does a 301 redirect to a landing page (a department home page) on our "real" domain that is indexed on Google. Example: www.bmwrepairs.com redirects to www.repairshop.com/bmwrepairs. Is there a way to do a 301 redirect so that when they get redirected, the URL in the browser address bar remains www.bmwrepairs.com?
Intermediate & Advanced SEO | | Jazee1 -
We 410'ed URLs to decrease URLs submitted and increase crawl rate, but dynamically generated sub URLs from pagination are showing as 404s. Should we 410 these sub URLs?
Hi everyone! We recently 410'ed some URLs to decrease the URLs submitted and hopefully increase our crawl rate. We had some dynamically generated sub-URLs for pagination that are shown as 404s in google. These sub-URLs were canonical to the main URLs and not included in our sitemap. Ex: We assumed that if we 410'ed example.com/url, then the dynamically generated example.com/url/page1 would also 410, but instead it 404’ed. Does it make sense to go through and 410 these dynamically generated sub-URLs or is it not worth it? Thanks in advice for your help! Jeff
Intermediate & Advanced SEO | | jeffchen0 -
Dealing with 404s during site migration
Hi everyone - What is the best way to deal with 404s on an old site when you're migrating to a new website? Thanks, Luke
Intermediate & Advanced SEO | | McTaggart0 -
HTML for URL markup
Hi, We are changing our URLs to be more SEO friendly. Is there any negative impact or pitfall of using <base> HTML-tag? Our developers are considering it as a possible solution for relative URLs inside HTML-markup in the Friendly URL context.
Intermediate & Advanced SEO | | theLotter0 -
Is this URL Structure SPAMMY
Hey guys/gals I have tried asking this very specific question 3-4 times already and some how my specific question seems to be getting side tracked and my very specif question pertaining to my URL structure keeps getting bypassed and overlooked. I am wondering about if this URL structure would become a possible issue in the somewhat near future with GOOGLE considering what I have seen go down in the SEO world the past 2 years. Does this URL Structure look SPAMMY? http://www.pcmedicsoncall.com/computer-repair/laptop-repair/ www.pcmedicsoncall.com/computer-repair/laptop-repair/laptop-screen-repair/ Below is a Screen shot of the Site which I designed where I have created a SILO Site Architecture. .....PLEASE... Look at the Picture Thank you Marshall SEOMOZ-PC-MEDICS-ON-CALL-1.jpg
Intermediate & Advanced SEO | | MarshallThompson310 -
How important is it to clarify URL parameters?
We have a long list of URL parameters in our Google Webmasters account. Currently, the majority are set to 'let googlebot decide.' How important is it to specify exactly what googlebot should do? Would you leave these to 'let googlebot decide' or would you specify how googlebot should treat each parameter?
Intermediate & Advanced SEO | | nicole.healthline0 -
Targeting Keywords at Home page or 301 URL?
Background info This is a new site and I am using Wordpress for a CMS not a blog and I have set a static page as the home page. The problem is when I configure the home page as a static page in wordpress it sets a 301 redirect to that page, which is this domain.com/software-consultancy (so the software-consultancy page is now domain.com). I thought about creating a separate Home page but I didn't see the point as the pages would be almost identical. **"Should I target keywords to the home page?" ** If I start link building using the phrase "software consultancy" to the home page should I link to domain.com or the 301 redirect URL domain.com/software-consultancy ? My thoughts are that if the URL has the keywords I am targeting in it will help with SEO. Or should I create a separate home page and just link the company name back to the home and have a separate page for "software consultancy" my thought is that having exactly what the company does on the home page would be better. But I don't want to lose out on search engine traffic by not having the keywords in the URL I am going to be link building for. I guess if I link build to the 301 redirect URL I can always revert back to this URL if I want to change? FYI here is my site structure: The site is for a small software consultancy and I have the following structure: domain.com/software-consultancy -- (Set as Wordpress static Page so essentially a 301 redirect to / ) domain.com/software-consultancy/areas domain.com/software-consultancy/areas/london domain.com/software-consultancy/areas/new-york I would really appreciate some feedback on this, even if it's experience / advice and there is no exact answer. Many Thanks, J
Intermediate & Advanced SEO | | SEOKeith0