Single Page on my client's website is not crawling and indexing new changes. What could be the possible reason?
-
I made several changes on client's website on different pages, changed titles, add content on few pages, moved blog from subdomain to sub directory. Everything is crawled but there is one page on the website (not part of the blog) that isn't getting crawled in Google and picking up changes. The last crawl of the website is 2 days back whereas that page was last crawled on 30th sep.
I just wanted to know the possible reasons and has anyone encountered this before?
-
Hi Moosa, do you have an update on this issue?
-
Things I check:
- header check (I've had pages appear 200 OK in webconfs and then massive errors in Browseo so I often check both.)
- Screaming Frog check - does the direct URL start a proper crawl?
- Make sure it's not blocked in WMT under removed pages (some website owners and/or bad SEOs try to demote sitelinks by removing the URL.)
- Meta tags & robots.txt both of which I assume you already checked.
- Duplicate content being indexed. Take a random sentence & throw it in quotes on Google. If a 100% dupe version comes up on their facebook page, archive.is, or some directory it may just need a content refresh to push through.
If you check all 5 of those off, then I'd definitely like to see the URL.
-
If that doesn't work, please share the page URL.
-
Thanks Drik,
I have double check the accessibility of page to crawlers and bots and pages does have decent amount of internal and external links pointing to the page.
Thanks for the Google fetch idea, i am going to try it to see if it works and update you accordingly.
-
Hi
I guess you have already checked that the page is accessible for crawlers and has sufficient internal links to be discovered by the bots (if not - try crawling the site with Screaming Frog)
If it's only one page that isn't picked up you could try a fetch like google & submit to index to force the page being indexed.
It could be that Google considers this page as less important and crawls with lower frequency compared to the other pages (to deep in the site, to few links, not enough content,...)
Dirk
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Changing existing URL's to improve SEO
Here's a general question: At what PR/page rank (or Moz 'page authority') would you no longer change an existing URL that's cryptic to one that includes the related page keyword or at least relevant terms? Does using a 301 redirect to the new URL preserve the page rank? Thanks!
On-Page Optimization | | flyntime_tx0 -
My company's product is referred to by two different names (SVN and Subversion). When cleaning up our Title tags, is it OK to use either name to keep the title tags around 70 characters?
I am cleaning up title tags that are too long or not correct. In our title tag we reference our product (a version of OSS source code). This product is often referred to as both SVN or Subversion. When writing Title tags is it OK to use one or the other depending on the length of the Title Tag? For instance: Contact Us | Free SVN & Git Hosting | Bug & Issue tracking | CloudForge vs **About CloudForge | Free Subversion & Git Hosting | Bug Tracking ** | |
On-Page Optimization | | CollabNet0 -
Should I buy an established domain that has lost it's high PR due to being offline for several months?
I'm considering purchasing a domain that has sat idle for several months. It was a company's domain that they have owned since the mid1990's but they went out of business. Previously, it had a PR 5 but has since lost it's PR as it has sat 'inactive' with a 'server not found' warning for the past several months. That being said, is there any point in buying the domain (for SEO purposes)? Is there any recourse with Google to try and re-establish the site's credibility or would I be starting over from scratch?
On-Page Optimization | | martybuch230 -
Not using H1's with keywords to simulate natural non SEO'd content?
There has been a lot of talk lately about making a website seem like it is not SEO'd to avoid over optimization penalties with the recent Google Algorithmic updates. Has anyone come across the practice of not using Headings (H1's, H2's etc..) properly to simulate that the current webpage isn't over optimized? I've come across a site that used to use multiple keywords within their headings & now they are using none. In fact they are marking their company name & logo as an H1 and non keyworded H2's such as our work or Contact. Is anyone holding back on their old SEO tactics to not seem over optimized to Google? Thanks!
On-Page Optimization | | DCochrane0 -
Changing the Home Page Title
The following question is for an eCommerce site: We have a home page title that has been the same for a few years. I would like to keep the keywords that already exist, but move them into different positions based on seasonality. Format will be (company name) | (keywords). Current format (company name) - (keywords). Rest of the page titles onsite are formatted (keyword)/(product name) | (company name) I think having the same keywords, but in a different order wouldn't hurt us in the SERPs. What are your thoughts?
On-Page Optimization | | kennyrowe0 -
Does anyone know why my Home page isn't visible in search terms?
If I type in my meta description for my homepage in google search or any of my keywords only my inner pages are returned in the results. I have a PR3 on the homepage so I don't think google is blocking my site and all my inner pages seem to show up.
On-Page Optimization | | Michael.Constable0 -
Post Title - Use the blog's name or not?
In the tile of my post, shoudl I used my blog's name in it at the end or emit the blog name. EX: title of post with keywords | name of blog OR EX: title of post with keywords The site's name is 3 words long, so I'm worrying that those extra words are diluting the keywords in the post's name that I'm trying to target.
On-Page Optimization | | gregalam0 -
Is it possible to get good SEO results with small brochure websites?
Say I have a 5 page website with 300 words and 4 images on each page. No or little dynamic content. No blog. Is it still possible to get good SEO results in a site like this? what would be the best strategy? what challenges would I need to over come? or is it just too much of an up hill battle?
On-Page Optimization | | iSenseWebSolutions0