Single Page on my client's website is not crawling and indexing new changes. What could be the possible reason?

[MoosaHemani]

I made several changes on client's website on different pages, changed titles, add content on few pages, moved blog from subdomain to sub directory. Everything is crawled but there is one page on the website (not part of the blog) that isn't getting crawled in Google and picking up changes. The last crawl of the website is 2 days back whereas that page was last crawled on 30th sep.

I just wanted to know the possible reasons and has anyone encountered this before?

[Christy-Correll]

Hi Moosa, do you have an update on this issue?

[MattAntonino]

Things I check:

• header check (I've had pages appear 200 OK in webconfs and then massive errors in Browseo so I often check both.)
• Screaming Frog check - does the direct URL start a proper crawl?
• Make sure it's not blocked in WMT under removed pages (some website owners and/or bad SEOs try to demote sitelinks by removing the URL.)
• Meta tags & robots.txt  both of which I assume you already checked.
• Duplicate content being indexed. Take a random sentence & throw it in quotes on Google. If a 100% dupe version comes up on their facebook page, archive.is, or some directory it may just need a content refresh to push through.

If you check all 5 of those off, then I'd definitely like to see the URL.

[DonnaDuncan]

If that doesn't work, please share the page URL.

[MoosaHemani]

Thanks Drik,

I have double check the accessibility of page to crawlers and bots and pages does have decent amount of internal and external links pointing to the page.

Thanks for the Google fetch idea, i am going to try it to see if it works and update you accordingly.

[DirkC]

Hi

I guess you have already checked that the page is accessible for crawlers and has sufficient internal links to be discovered by the bots (if not - try crawling the site with Screaming Frog)

If it's only one page that isn't picked up you could try a fetch like google & submit to index to force the page being indexed.

It could be that Google considers this page as less important and crawls with lower frequency compared to the other pages (to deep in the site, to few links, not enough content,...)

Dirk