301ing entire E-Com website - Using TopPages Report as a Guide
-
Hi Folks,
My company is in discussions with an ERP provider to migrate our existing website to a new backend system, new url structures..the whole 9 yards.
We have over 15,000 products, and a lot of "odd" url structures created by an outdated system that we were unable to adjust. All and all, if you're talking about a raw url count, it's in the 100s of thousands.
During discussions, we were told that bulk 301 redirects would be a problem. They could be performed manually though (greaaattt).
Due to this, I ran an OpenSite Explorer report, and isolated our top pages. After exporting the CSV, I was able to breakout "all" urls that have links from other domains.
My question is, has anyone used the OpenSite Explorer on a website of similar size, to form the basis of a migration? Do you have enough confidence in the tool to use it in this way, or should we re-negotiate our agreement until a way can be found to mass 301 ALL urls. I'm at least a little concerned that OpenSite Explorer isn't indexing all of the links out there. Gasp..or would there be a better tool to accomplish what I'm trying to do?
Thanks!
-
As much as we love OSE here, it is not a good bet for doing a complete inventory of your entire current site. I'd probably recommend a desktop crawler, like Xenu or Screaming Frog. See my comparison post here:
http://www.seomoz.org/blog/crawler-faceoff-xenu-vs-screaming-frog
I've got to believe that there's some logic that could connect the old and new URLs, though, even if it has to go through a database look-up. Creating 15,000 manual redirect rules isn't only going to be a huge pain, it may cause a huge processing bottleneck. I'd really push back on what "can't" means and why it can't be done. Too often, "can't" is code for "don't want to", in my experience.
-
OK...that makes it more difficult.
I was hoping that you might have some files whose filenames would be retained and would only need to move from one directory location to another within your new site structure.
Since it is possible to redirect the entire contents of a directory to another directory with a single line of code, this would have made it easier.
Sha
-
Hi Sha, thanks for your response.
1. Yes, we will use the same domain but structure will be completely changed.
2. Unfortunately, our current CMS is so backward, that it will be a complete file name and, directory change.
Thanks!
-
Thanks..great answer..and yeah, that's pretty much how I feel with that last sentence..ugghhh..
-
Just to clarify what you are doing here, a couple of questions:
- ... am I correct in assuming that you are wanting to use the same domain, but the site structure will be changed?
- Also, will there be ANY pages within the new structure that might simply be moved to a different location within the same domain (for example move from root directory to /sub directory), but retain the same file name?
These things will make a difference as to how you can approach the issue.
Sha
-
As far as I can tell, Open Site Explorer doesn't show all the links - in fact it shows only a very tiny proportion of the links to your site. Yahoo site Explorer, while it's still available, is a more accurate list of links to your site. For example on our little site, OSE shows 30 in bound links, but Yahoo shows almost 300!! As painful as it may be, I would 301 every page, but do them in SE Rank order, it only has to be done once, and when it's done it's done. That said, I'm surprised your web company can't find a way to automate it?!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google RankBrain Update Affecting Ranking Reports?
In the past 2 months we have been seeing a large amount of movement in our ranking reports in Moz Pro. Here is what is going on: We run reports for around 15 different clients using Moz. We also track around an average of 100-150 different keywords for each client (some more, some less). What I have seen lately is that we have a week where the sites do great, next week a large shift down. The week after a large shift up. The next week a large shift down. Rinse, repeat. It makes it very hard to spot the trouble areas on a page or keyword when there doesn't really seem to be a consistent way of knowing what the trends are. It appears to be random, and the next week they seem to recover, along with some that do not. We will see some keywords drop 30 places, only to regain the majority of that drop the following week. Some of the sites have received content updates while others have remained largely untouched. It is very confusing to see this pattern, and I have tracked it for about 2 months. Is anyone seeing a similar pattern in their reports? Could this be related to the rollout of Google's RankBrain, the new AI learning tech from Google? Most of the keywords are tracked are not long tail, and are basic local business/service type of keywords. Plumber in St Louis, etc etc
Moz Pro | | David-Kley1 -
How often is the Moz Local report data updated?
Greetings, After engaging Moz Local I have made several manual edits to individual account listings, but I do not yet see them reflected in the reports. How often is the reporting updated? Thanks!
Moz Pro | | richpalpine0 -
What does Mozcape actually do and what types of businesses use it?
I'm making an effort to use more of the Moz tools, but some I really don't understand...Mozcape would be chief on that list. What does it do exactly and for what purpose? I read the API Wiki, but it sounds to me a lot like Open Site Explorer...but complicated...so I assume I must be missing something or why build the thing? Also, do local businesses even use this or is this more for national e-commerce sites? Thanks, Ruben
Moz Pro | | KempRugeLawGroup0 -
No internal links showing up in OpenSiteExplorer report
Hi there A simple one. I was just looking at our site in opensiteexplorer and notice that it says we have no internal links at all: https://www.evernote.com/shard/s244/sh/dd8cc88f-fee4-4ba2-8ec0-f3f8d5c408db/8d3fc3d2aa6fc9d5406051bc91731402 Rather odd as we do. Is this a bug with OSE that anyone knows about or something else? Any ideas / thoughts gratefully received.
Moz Pro | | ArenaFlowers.com0 -
Competitor using Black hat SEO
I think my competitor is using Black Hat SEO. They are a training institute but when I use the PRO tool to check their inbound links, many are links to porn sites. Is this illegal? Can i do something about it?
Moz Pro | | Jigsaw1230 -
How long does opensiteexplorer take to generate exportable reports
I tried exporting a few reports out of opensiteexplorer. They have been pending for more than 36 hours. Progress bar appears to be stuck. Is this normal? How long does it take to get the reports generated?
Moz Pro | | ibwork0 -
For those using Omniture instead of Google Analytics
Instead of connecting Google Analytics into the SEOMOZ campaign monitor, is there a way to link Omniture or alter their output to plug into SEOMOZ?
Moz Pro | | Dekoda_Jones1 -
Backlinks using Open Site Explorer
Hey guys, So I was doing some backlink analysis for a client and was utilizing Open Site Explorer, which stated that I had roughly 2,111 External Followed Links. However, I can't seem to find a way to export all 2,111 backlinks. I wanted to make sure if the links I had acquired had been indexed and crawled, and picked up, but I can't seem to access the full list on a domain level, only on the subdomain level. Anybody have any suggestions or advice? Any would be helpful! Best, James
Moz Pro | | sixspokemedia0