Google Webmaster tools: Sitemap.xml not processed everyday

[COEDMediaGroup]

Hi,

We have multiple sites under our google webmaster tools account with each having a sitemap.xml submitted

Each site's sitemap.xml status ( attached below ) shows it is processed everyday except for one

_Sitemap: /sitemap.xml__This Sitemap was submitted Jan 10, 2012, and processed Oct 14, 2013._But except for one site ( coed.com ) for which the sitemap.xml was processed only on the day it is submitted and we have to manually resubmit every day to get it processed.Any idea on why it might?thank you

[Dr-Pete]

My initial reaction was that this is more likely technical than something Google is doing - checking the load-time is a good idea. Make sure the sitemap validates and there's nothing odd about it. If you manually re-submit it, does it seem to take?

[RobertFisher]

Just so I am clear, you have been waiting and finally Google processed it, or was it sitting there and someone took an action which caused Google to process it?

I am surprised that nothing happened for nearly two years. Has the site had traffic, etc.? Any warnings, manual actions, etc.?

Thanks

[COEDMediaGroup]

Thanks Paul,

On custom crawl setting, I just verified and they remain same same across all our sites.

Yes, sitemap is dynamic but rendered via cache which refreshed when new content get published, will check on the load time.

thank you

[COEDMediaGroup]

Thanks Robert,

All our sites are getting indexed for sure, but one site ( coed.com ) sitemap.xml on GWT says it was processed only on the day it submitted, while other sites ( collegecandy.com and bustedcoverage.com ) sitemap.xml GWT was getting processed everyday

Our sitemap.xml on all sites updates automatically when new content get published so I believe it has to be processed every day

WOspiY6.png

[ThompsonPaul]

Any chance there's been a custom crawl setting accidentally added to your Google Webmaster Tools, Robert? Some devs do this during development or it can happen accidentally.

Also, your sitmemap takes a ridiculously long time to load - well over 15 seconds for me and over 18 seconds using webpagetest.org. It could be that Google simply isn't waiting for the page to load when it tries to visit. If the sitemap's being generated dynamically, you may have a rendering problem. Otherwise there's something borked when a 50kb file takes that long.

Might also want to try submitting it through Bing Webmaster Tools and see if they are better able to index it consistently for comparison?

Bit of a head-scratcher. Hope that gives you a starting point.

Paul

[RobertFisher]

Robert,

There is no screenshot attached, but I am unaware of sitemaps being processed daily by search engines. What are you trying to achieve by continuously resubmitting the sitemap?

The site is indexed, correct? And when you look at crawl stats it is showing the site being crawled on some semi regular basis? Google does not process your sitemap every day.

Hope that helps,

Robert