301ing entire E-Com website - Using TopPages Report as a Guide
-
Hi Folks,
My company is in discussions with an ERP provider to migrate our existing website to a new backend system, new url structures..the whole 9 yards.
We have over 15,000 products, and a lot of "odd" url structures created by an outdated system that we were unable to adjust. All and all, if you're talking about a raw url count, it's in the 100s of thousands.
During discussions, we were told that bulk 301 redirects would be a problem. They could be performed manually though (greaaattt).
Due to this, I ran an OpenSite Explorer report, and isolated our top pages. After exporting the CSV, I was able to breakout "all" urls that have links from other domains.
My question is, has anyone used the OpenSite Explorer on a website of similar size, to form the basis of a migration? Do you have enough confidence in the tool to use it in this way, or should we re-negotiate our agreement until a way can be found to mass 301 ALL urls. I'm at least a little concerned that OpenSite Explorer isn't indexing all of the links out there. Gasp..or would there be a better tool to accomplish what I'm trying to do?
Thanks!
-
As much as we love OSE here, it is not a good bet for doing a complete inventory of your entire current site. I'd probably recommend a desktop crawler, like Xenu or Screaming Frog. See my comparison post here:
http://www.seomoz.org/blog/crawler-faceoff-xenu-vs-screaming-frog
I've got to believe that there's some logic that could connect the old and new URLs, though, even if it has to go through a database look-up. Creating 15,000 manual redirect rules isn't only going to be a huge pain, it may cause a huge processing bottleneck. I'd really push back on what "can't" means and why it can't be done. Too often, "can't" is code for "don't want to", in my experience.
-
OK...that makes it more difficult.
I was hoping that you might have some files whose filenames would be retained and would only need to move from one directory location to another within your new site structure.
Since it is possible to redirect the entire contents of a directory to another directory with a single line of code, this would have made it easier.
Sha
-
Hi Sha, thanks for your response.
1. Yes, we will use the same domain but structure will be completely changed.
2. Unfortunately, our current CMS is so backward, that it will be a complete file name and, directory change.
Thanks!
-
Thanks..great answer..and yeah, that's pretty much how I feel with that last sentence..ugghhh..
-
Just to clarify what you are doing here, a couple of questions:
- ... am I correct in assuming that you are wanting to use the same domain, but the site structure will be changed?
- Also, will there be ANY pages within the new structure that might simply be moved to a different location within the same domain (for example move from root directory to /sub directory), but retain the same file name?
These things will make a difference as to how you can approach the issue.
Sha
-
As far as I can tell, Open Site Explorer doesn't show all the links - in fact it shows only a very tiny proportion of the links to your site. Yahoo site Explorer, while it's still available, is a more accurate list of links to your site. For example on our little site, OSE shows 30 in bound links, but Yahoo shows almost 300!! As painful as it may be, I would 301 every page, but do them in SE Rank order, it only has to be done once, and when it's done it's done. That said, I'm surprised your web company can't find a way to automate it?!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Key words that my target segment uses
Using SEOMoz (or what other tools do you recommend), how can I find the most common key words that my target segment uses in Google search - about any subject? Say my target segment of customers is teens aged 13-18 in Mexico (using Spanish) or in Turkey (using Turkish language). Thank you in advance 🙂
Moz Pro | | Cenktukel0 -
Ranktracker entire subdomain option
About http://ranktracker.seomoz.org ... if I search on Google for "my phrase" I can see **www.**mysite.com on first place Doesn't this mean that I should see a similar position on ranktracker if I type "http://mysite.com" (without www) and I select the "Entire Subdomain" radio button ? Because this shows that I am NOT in top 50. It does show up if I type my site with www and I select eider "entire subdomain" or "exact url" radio button. Thank you.
Moz Pro | | adrianTNT0 -
Does SEOMOZ use Google Search?
I run a Joomla site and have noticed users having a hard time finding what they are looking for. The default Joomla search is lacking and the latest Joomla search component I added is better but still not great. I've always been able to find what I'm looking for on SeoMoz, do you guys use Google Site Search?
Moz Pro | | mr_w0 -
Very Slow Advanced Reports
Hello All - I've been running some Advanced Reports again lately, and they seem much slower than I remember from last time I ran some. Currently I've got one (Inbound Links) report at 2,500 out of 10,000 links retrieved through LSAPI, and it's been at that point for about 6 hours. Did something get cloggered on the reports, or is it this just the expected performance?
Moz Pro | | icecarats0 -
Crawl reports urls with duplicate content but its not the case
Hi guys!
Moz Pro | | MakMour
Some hours ago I received my crawl report. I noticed several records with urls with duplicate content so I went to open those urls one by one.
Not one of those urls were really with duplicate content but I have a concern because website is about product showcase and many articles are just images with href behind them. Many of those articles are using the same images so maybe thats why the seomoz crawler duplicate content flag is raised. I wonder if Google has problem with that too. See for yourself how it looks like: http://by.vg/NJ97y
http://by.vg/BQypE Those two url's are flagged as duplicates...please mind the language(Greek) and try to focus on the urls and content. ps: my example is simplified just for the purpose of my question. <colgroup><col width="3436"></colgroup>
| URLs with Duplicate Page Content (up to 5) |0 -
In competitive domain analysis my website shows pages that I no longer have.
When I go to my campaign, link analysis, under competitive comparison/followed backlinks, the 5 pages under Anchor Text/Target URL, supposedly on my website, are not on my website anymore. I recently moved my domain name to another server (before signing up for seomoz) and deleted the forum associated with my website. Those 5 pages are all from that now extinct forum. What's going on?
Moz Pro | | ovistomih0 -
Crawl completed but no report available for download?
I put 2 crawls in the same day. One came back and delivered a report that I could download. The other one is completed (says so on the page) but there's no way for me to download the report. How do I get a hold of it? Thanks!
Moz Pro | | LiliArancibia0 -
SEOmoz crawl diagnostics report - what are the duplicate pages urls?
I just see the number of duplicates but not what the urls of the duplicates are? I don't see it in the export either, but maybe I'm missing it Cheers S
Moz Pro | | firstconversion0