Replacing a site map
-
We are in the process of changing our folder/url structure. Currently we have about 5 sitemaps submitted to Google.
How is it best to deal with these site maps in terms of either (a) replacing the old URLs with the new ones in the site map and (b) what affect should we have if we removed the site map submission from the Google Webmaster Tools console.
Basically we have in the region of 20,000 urls to redirect to the new format, and to update in the site map.
-
Another thought might be to place a noindex on the new pages to start with and as we migrate and 301 redirect the old to the new remove the noindex on the new pages ?
That can work but it's not an approach i would use. It seems like a lot of extra work, you run the risk of forgetting to remove the noindex tag on some pages, and also you may wind up not having pages properly indexed for a month.
If you publish a page today, Google may crawl the new page and see the noindex tag. You can then remove the noindex tag but Google may not recrawl the page for some time leaving your site without an indexed page.
As part of the process of publishing the page, I would 301 the old URL to the new URL immediately.
-
Another thought might be to place a noindex on the new pages to start with and as we migrate and 301 redirect the old to the new remove the noindex on the new pages ?
Thoughts ??
-
since the site has over 10,000 pages we need to make sure all redirects etc are set-up before we go live with the new URLs ?
Whether your site has 10 pages or a million pages you should ensure all internal links work without the need for redirection. Any old external links should be redirected to the correct page on your site if one exists. Otherwise you can allow the URL to 404 if there is not a current equivalent page.
Set up your site's 404 page so users are offered a basic "page not found" message along with your site's navigation and a search function. You should set up a log to track which URLs are generating 404 errors.
Prior to launching the site run a crawl diagnostic to help ensure nothing has been missed.
-
Perfect thanks. Just one final question, since the site has over 10,000 pages we need to make sure all redirects etc are set-up before we go live with the new URLs ?
What is the best way to go forward with regards launching the site ?
Should we launch the new pages and then go through the URLs redirecting them ?
Thoughts please ??
-
We are changing our site structure for two main reasons
-
Ease of functionality, and having the ability to target friendly URLs suitable for SEO
-
Plus we've a new CMS, that allows this custom written URLs
The current structure has too many folders that are too deep, and is becoming too un-manageable. The new CMS gives us totally control from one control panel.
I understand that we will loose some PR, but believe it will be for the better of the site and user experience.
-
-
We are changing our site structure for two main reasons
-
Ease of functionality, and having the ability to target friendly URLs suitable for SEO
-
Plus we've a new CMS, that allows this custom written URLs
The current structure has too many folders that are too deep, and is becoming too un-manageable. The new CMS gives us totally control from one control panel.
I understand that we will loose some PR, but below it will be for the better of the site and user experience.
-
-
Big question: are you changing folder/url structure for aesthetics or functionality? Often times it's not worth making such a large change in hopes of getting some SEO-friendly URL's, as the weight on SEO-friendly URL's isn't what it once was. And the headache involved, as well as the inevitable loss in traffic, is quite often not worth it at all.
With that said, refresh your entire sitemap with the new URL's once they are made. Remove all old urls.
IMPORTANT: setup 301 redirects, either using .htaccess or PHP (or whatever language your site uses), to redirect all old urls to the respective new urls. You will lose a fair chunk of PR during this change, but if you feel your site will benefit greatly from a structure change, then you will be willing to take the hit.
Don't leave any redirect un-turned. Then, you'll just have to wait it out while Google re-indexes your entire site trying to figure out your new url structure. Could take a week, could take months. All depends on what Google has valued your site as. For example, if CNN changed their entire URL structure, they probably would miss a beat. Smaller websites tend to take much larger hits in the SERP's.
So, just be sure it's a necessary action, trust me. And don't ever remove those 301's from your .htaccess as you never know what Google still has in their index for your site.
-
A sitemap should be a link representation of your site. It should contain a link to every page you wish to be included in Google's index.
How is it best to deal with these site maps in terms of either (a) replacing the old URLs with the new ones in the site map
Just make the switch. If a page no longer exists on your site, remove the link. If you create a new page on your site, add the link.
what affect should we have if we removed the site map submission from the Google Webmaster Tools console
For the most part, none. During the next crawl Google would look for your sitemap at your root address: www.mydomain.com/sitemap.xml. Google will also check your robots.txt file for a path to your sitemap file. If a sitemap is not located, it will crawl your site normally.
The primary purpose of a sitemap is to allow Google to become aware about new pages on your site it otherwise might not find. If your site offers solid navigation, a site map is not necessary at all.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to handle New Page/post with site map
Hi, I've created and submitted to google (through webmaster tool) a site map with the WP plugin XML google maps. Now I've created new pages and posts. My question is: do i have to recreate and re submit another site map to google or can i just submit to google the new pages and posts with the option 'FETCH AS GOOGLE' ? Tx so much in advance.
Technical SEO | | tourtravel0 -
URL Changes And Site Map Redirects
We are working on a site redesign which will change/shorten our url structure. The primary domain will remain the same however most of the other urls on the site are getting much simpler. My question is how should this be best handled when it comes to sitemaps because there are massive amounts of URLS that will be redirected to the new shorter URL how should we best handle our sitemaps? Should a new sitemap be submitted right at launch? and the old sitemap removed later. I know that Google does not like having redirects in sitemaps. Has anyone done this on a large scale, 60k URLs or more and have any advice?
Technical SEO | | RMATVMC0 -
404 Errors After Site Migration
Hello - I'm working on a website selling fashion accessories. The site just went through a site migration from Yahoo! to Big Commerce. Now we have a high level of warnings and errors from the crawl. Few are mentioning sites I never seen before on the Yahoo! platform. I also notice that the pages crawled has doubled. How can I fix or did I do something wrong with migration? I was running the website with minimal errors and now overwhelmed with errors all the error updates. If I can get some assistance on what could be wrong, I would greatly appreciate. Thanks.
Technical SEO | | ShopChameleon0 -
What to do if my site was De-indexed?
Hello fellow SEOs, I have been doing SEO for about a year now, I'm not expert, but I know enough to get the job done. I'm learning everyday about better techniques. So enough about that... Tonight I noticed that my site has, I believe, been de-indexed. Its a fairly new site, as we just launched it a few days ago and I went in and did all the title tags and meta. I still have to go in to do the h1 and h2 tags...plus add some alt tags and anchor text. Well anyways, after a couple of days after the title tags were implemented. I was propagating all over the place. Using my keyword tool here...I was number on the first page in Google for 71 or the 88 keywords. My new site was just indexed yesterday and thats when i noticed all my keywords. Well today I noticed that I am no where to be found, even if i type in my company's name. PLEASE help me out...any advice would be appreciated. Thank you. p.s. could my competitors could have done something to my site? just wondering... The website is www.eggheadconsultants.com
Technical SEO | | Jegghead1 -
Mobile site rank on Google S.E. instead of desktop site.
Hello, all SEOers~ Today, I would like to hear your opinion regarding on Mobile site and duplicate contents issue. I have a mobile version of our website that is hosted on a subdomain (m instead www). Site is targeting UK and Its essentially the same content, formatted differently. So every URL on www exists also at the "m" subdomain and is identical content. (there are some different contents, yet I could say about 90% or more contents are same) Recently I've noticed that search results are showing links to our mobile site instead of the desktop site. (Google UK) I have a sitemap.xml for both sites, the mobile sitemap defined as follows: I didn't block googlebot from mobile site and also didn't block googlebot-mobile from desktop site. I read and watched Google webmaster tool forum and related video from Matt Cutts. I found many opinion that there is possibility which cause duplicate contents issue and I should do one of followings. 1. Block googlebot from mobile site. 2. Use canonical Tag on mobile site which points to desktop site. 3. Create and develop different contents (needless to say...) Do you think duplicate contents issue caused my mobile site rank on S.E. instead of my desktop site? also Do you think those method will help to show my desktop site on S.E.? I was wondering that I have multi-country sites which is same site format as I mentioned above. However, my other country sites are totally doing fine on Google. Only difference that I found is my other country sites have different Title & Meta Tag comparing to desktop site, but my UK mobile site has same Title & Meta Tag comparing to desktop. Do you think this also has something to do with current problem? Please people~! Feel free to make some comments and share your opinion. Thanks for reading my long long explanation.
Technical SEO | | Artience0 -
How do you diagnose if on your site is only 50% crawled?
Good Morning from 7 degrees C, goodbye arctic conditions wetherby UK, If a site had 100 pages for example & that site was plugged into Webmaster Tools how could you diagnose if all the pages had been crawled? The thing is I want to learn how to diagnose crawl issues with sites, is their a known methodology for this? Thanks in advance, David
Technical SEO | | Nightwing0 -
What are the pros and cons of moving one site onto a subdomain of another site?
Two sites. One has weaker sales. What would the benefits and problems for SEO of moving the weak site from its own domain to a subdomain of the stronger site?
Technical SEO | | GriffinHansen0 -
Site Relaunch
Hello, I recently launched my new site (Nov. 25, 2011) but still have the old site live because I still need old customer data from the old admin for customer service issues and I cannot delete the old front-end without deleting the old back-end!. I am seeing a lot of referrals coming from the old site IP address with many backlinks to the new site but dont know if this is actually hurting the new site due to duplicate content, ect .. Any input would be greatly aaaaaapreciated 😉 Thanks in advance, Byron-
Technical SEO | | k9byron0