Single Page on my client's website is not crawling and indexing new changes. What could be the possible reason?
-
I made several changes on client's website on different pages, changed titles, add content on few pages, moved blog from subdomain to sub directory. Everything is crawled but there is one page on the website (not part of the blog) that isn't getting crawled in Google and picking up changes. The last crawl of the website is 2 days back whereas that page was last crawled on 30th sep.
I just wanted to know the possible reasons and has anyone encountered this before?
-
Hi Moosa, do you have an update on this issue?
-
Things I check:
- header check (I've had pages appear 200 OK in webconfs and then massive errors in Browseo so I often check both.)
- Screaming Frog check - does the direct URL start a proper crawl?
- Make sure it's not blocked in WMT under removed pages (some website owners and/or bad SEOs try to demote sitelinks by removing the URL.)
- Meta tags & robots.txt both of which I assume you already checked.
- Duplicate content being indexed. Take a random sentence & throw it in quotes on Google. If a 100% dupe version comes up on their facebook page, archive.is, or some directory it may just need a content refresh to push through.
If you check all 5 of those off, then I'd definitely like to see the URL.
-
If that doesn't work, please share the page URL.
-
Thanks Drik,
I have double check the accessibility of page to crawlers and bots and pages does have decent amount of internal and external links pointing to the page.
Thanks for the Google fetch idea, i am going to try it to see if it works and update you accordingly.
-
Hi
I guess you have already checked that the page is accessible for crawlers and has sufficient internal links to be discovered by the bots (if not - try crawling the site with Screaming Frog)
If it's only one page that isn't picked up you could try a fetch like google & submit to index to force the page being indexed.
It could be that Google considers this page as less important and crawls with lower frequency compared to the other pages (to deep in the site, to few links, not enough content,...)
Dirk
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does Google's algo look at all traffic mediums with regs to onpage metrics or only organic traffic metrics?
Hi folks, This is something I've pondered for a while. I've ask a couple of Googlers but no reponse yet and I don't I'll get one! In your opinion, do you think Google looks at on page metrics like bounce rate for example from all traffic mediums (organic, paid, email, social referral etc etc) or they only look at on page metrics from organic traffic? I'm not talking about direct correlations from other mediums. I'm only talking about when a user lands on a website, do the actions they take matter with regards to Google's search algo no matter of the referring medium, or do Google only look at onpage metrics on visits which came to the site via organic search as a medium. Option 1 As a very simplified example: Google gives extra weight in the SERPs to website A which has an average bounce rate of 30% from all mediums compared to website B which has a bounce rate of 50% from all mediums. Option 2 Google gives extra weight in the SERPs to website A which has an average bounce rate of 30% from organic traffic only compared to website B which has a bounce rate of 50% from organic traffic only. I'm not sure if anyone outside Google has the answer/proof of this but was keen to get other people's thoughts. If you think the also uses one or the other, can you give an insights/proof of one or the other? For me it would make sense for them only to use onpage metrics from sessions which came from organic seach traffic, but who knows! Merci buckets, Gill.
On-Page Optimization | | Cannetastic0 -
Javascript(0) extension causing an excess of 404's
For some reason I am getting a duplicate version of my urls with /javascript(0) at the end. These are creating an abundance of 404 errors. I know I am not supposed to block JS files so what is the best way to block these? Ex: http://www.jasonfox.me/infographics/page/8/javascript(0) is a 404 http://www.jasonfox.me/infographics/page/8/ is not Thank you.
On-Page Optimization | | jasonfox.me0 -
I'm looking to put a quite length FAQs tab on product pages on an ecommerce site. Am I likely to have duplicate content issues?
On an ecommerce site we have unique content on the product pages (i.e. descriptions), as well as the usual delivery and returns tabs for customer convenience. From this we haven't had any duplicate content issues or warnings, which seems to be the case industry-wide. However, we're looking to add a more lengthy FAQs tab which is still highly relevant to the customer but contains a lot more text than the other tabs. The product descriptions are also relatively small. Do you think this will cause potential duplicate content issues or should it be treated the same as a delivery tab, for instance?
On-Page Optimization | | creativemay0 -
Website redesign and it's impact on ranking
Hey Everyone, I have had a website in place for over 7 years and I am now at the point where I need to implement a redesign in order to sell our product more effectively. -URL's will stay the same
On-Page Optimization | | Justin45
-Content will change but be very similar page-to-page
-Title & Meta tags will remain the same I'm planning on taking the site from a non-backend site to a wordpress site so the navigation will change. Does anyone foresee that this change will have any dramatic effect on site ranking? Thank You!0 -
Will Google re-index the page if content is changed/improved?
Hello,
On-Page Optimization | | wickedsunny1
i have a little question, it seems most of my posts which are 3 years old or even more, all have almost same type of 2-3 lines of text at post starting and then images roundups etc.
which recently stopped getting any traffic from google. Probably becuase of lack in text etc.
So if i now edit those old pages, will they be reindexed in google with this new content/data?
thanks in advance.
cheers0 -
How long does it take Google to index new title tags and meta descriptions?
Hi, I have launched a website ( www.bookkeepingking.com )and would like Google to reflect the latest title tag changes in its results. How long does it typically take to happen? I believe this might be one reason why the site may not be generating any search traffic yet, even though I haven't yet begun any link building yet. A couple of notes: When I enter site:bookkeepingking.com in the search box, the pages show up, but with the old/default title and meta descriptions. I am using the Yoast for SEO plugin I have resubmitted the XML map - Yoast created 2... /page-sitemap.xml and /post-sitemap.xml The changes were made about 1 week ago. WMT says that there are zero errors. Is there something I may have missed? Or do I just need to give it more time? Thanks in advance for your help. Erin
On-Page Optimization | | HiddenPeak0 -
Page authority 1 for new URLs
Hi There Quite a beginner question. I have changed url structure last week and is already avaliable on google.What i find strange is that the PA reported by SEOMOZ is 1 and there's no google cache. If the page has to crawled yet, why it's avaliable on google index already? Dario
On-Page Optimization | | Mrlocicero0 -
Page title getting cut off in SERPS even though it's under 70 characters?
I re-wrote the page title of a home page for a site I'm working on and made sure it's under 70 characters (68 to be exact) to comply with best practices and make sure it doesn't get cut-off in the SERPS. It's still getting cut-off though and right when it gets to the brand/website name. Does a "-" have anything to do with it? Does that translate to an elipsis? Format: keywords - website/brand.com Can anybody tell me why this would be happening?
On-Page Optimization | | MichaelWeisbaum0