301ing entire E-Com website - Using TopPages Report as a Guide
-
Hi Folks,
My company is in discussions with an ERP provider to migrate our existing website to a new backend system, new url structures..the whole 9 yards.
We have over 15,000 products, and a lot of "odd" url structures created by an outdated system that we were unable to adjust. All and all, if you're talking about a raw url count, it's in the 100s of thousands.
During discussions, we were told that bulk 301 redirects would be a problem. They could be performed manually though (greaaattt).
Due to this, I ran an OpenSite Explorer report, and isolated our top pages. After exporting the CSV, I was able to breakout "all" urls that have links from other domains.
My question is, has anyone used the OpenSite Explorer on a website of similar size, to form the basis of a migration? Do you have enough confidence in the tool to use it in this way, or should we re-negotiate our agreement until a way can be found to mass 301 ALL urls. I'm at least a little concerned that OpenSite Explorer isn't indexing all of the links out there. Gasp..or would there be a better tool to accomplish what I'm trying to do?
Thanks!
-
As much as we love OSE here, it is not a good bet for doing a complete inventory of your entire current site. I'd probably recommend a desktop crawler, like Xenu or Screaming Frog. See my comparison post here:
http://www.seomoz.org/blog/crawler-faceoff-xenu-vs-screaming-frog
I've got to believe that there's some logic that could connect the old and new URLs, though, even if it has to go through a database look-up. Creating 15,000 manual redirect rules isn't only going to be a huge pain, it may cause a huge processing bottleneck. I'd really push back on what "can't" means and why it can't be done. Too often, "can't" is code for "don't want to", in my experience.
-
OK...that makes it more difficult.
I was hoping that you might have some files whose filenames would be retained and would only need to move from one directory location to another within your new site structure.
Since it is possible to redirect the entire contents of a directory to another directory with a single line of code, this would have made it easier.
Sha
-
Hi Sha, thanks for your response.
1. Yes, we will use the same domain but structure will be completely changed.
2. Unfortunately, our current CMS is so backward, that it will be a complete file name and, directory change.
Thanks!
-
Thanks..great answer..and yeah, that's pretty much how I feel with that last sentence..ugghhh..
-
Just to clarify what you are doing here, a couple of questions:
- ... am I correct in assuming that you are wanting to use the same domain, but the site structure will be changed?
- Also, will there be ANY pages within the new structure that might simply be moved to a different location within the same domain (for example move from root directory to /sub directory), but retain the same file name?
These things will make a difference as to how you can approach the issue.
Sha
-
As far as I can tell, Open Site Explorer doesn't show all the links - in fact it shows only a very tiny proportion of the links to your site. Yahoo site Explorer, while it's still available, is a more accurate list of links to your site. For example on our little site, OSE shows 30 in bound links, but Yahoo shows almost 300!! As painful as it may be, I would 301 every page, but do them in SE Rank order, it only has to be done once, and when it's done it's done. That said, I'm surprised your web company can't find a way to automate it?!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Using this service
Hello, I have had this service for my free month. I had over 150 errors on my website which I fixed. My problem is that in doing this my traffic is actually worse and I have now fallen completely off google. From the start of my website I would slowly creep to within t he top 3 pages of google for the search term apron and aprons, then suddenly I fall to somewhere around page 20. No one, even people I hired has been able to explain this. I hear google changes, it takes time, etc, etc... Its been 5 years and other newer companies are on the top page right in their first year.. After working with this site for a month, I have looked to page 65 for apron and aprons and still cant find me. And I know some people say Alexa is a gimmick, but now instead of rising to 10 million and falling back down to 23 million, Alexa says there is no info regarding my website whatsoever. Any advice? I was excited to have this service but I cant get my partner to agree to keep it if my month long result is worse then I ever was before. And please dont say it takes time , 5 years is more than enough. Thank you in advance!
Moz Pro | | Gardengirl0 -
My rankings report is giving out wrong information
Hi, i am very puzzled about the rankings report. For some reason the past couple of weeks it is giving wrong information for example, my site www.in2town.co.uk the report says that the keyword gastric band hypnosis is eight in google on page one but when i have checked i cannot find it. It also says the word gastric band hypnotherapy is sixth place in google on page one can anyone please let me know what is going on
Moz Pro | | ClaireH-1848860 -
Plurals and the SEOmoz On Page Report Card
I have some pages on my website that receive an "A" grade with the SEOmoz On Page Report Card if I use a plural term in a phrase (say, "landscape designers in Dallas") but an "F" grade if I use the singular term (say, "landscape designer in Dallas"). Is this a true and accurate reflection of how search engines see the page? Am I going to rank well for plural terms but not for singular, given the specific on-page content I'm using in this example? Or is this an opportunity for SEOmoz to tweak its' algorithm to better reflect the search engines?
Moz Pro | | ahirai1 -
Domain.com and domain.com/index.html duplicate content in reports even with rewrite on
I have a site that was recently hit by the Google penguin update and dropped a page back. When running the site through seomoz tools, I keep getting duplicate content in the reports for domain.com and domain.com/index.html, even though I have a 301 rewrite condition. When I test the site, domain.com/index.html redirects to domain.com for all directories and root. I don't understand how my index page can still get flagged as duplicate content. I also have a redirect from domain.com to www.domain.com. Is there anything else I need to do or add to my htaccess file? Appreciate any clarification on this.
Moz Pro | | anthonytjm0 -
How do I find the corresponding duplicate content pages from my SEOmoz report?
Once I have run my report and the duplicate content pages come up, is there a way to find out which pages have the duplicate content on them? I have one URL but where can I find the duplicate content that corresponds to it? Thanks Barry
Moz Pro | | MrBarrytg0 -
Backlinks using Open Site Explorer
Hey guys, So I was doing some backlink analysis for a client and was utilizing Open Site Explorer, which stated that I had roughly 2,111 External Followed Links. However, I can't seem to find a way to export all 2,111 backlinks. I wanted to make sure if the links I had acquired had been indexed and crawled, and picked up, but I can't seem to access the full list on a domain level, only on the subdomain level. Anybody have any suggestions or advice? Any would be helpful! Best, James
Moz Pro | | sixspokemedia0