Single Page on my client's website is not crawling and indexing new changes. What could be the possible reason?
-
I made several changes on client's website on different pages, changed titles, add content on few pages, moved blog from subdomain to sub directory. Everything is crawled but there is one page on the website (not part of the blog) that isn't getting crawled in Google and picking up changes. The last crawl of the website is 2 days back whereas that page was last crawled on 30th sep.
I just wanted to know the possible reasons and has anyone encountered this before?
-
Hi Moosa, do you have an update on this issue?
-
Things I check:
- header check (I've had pages appear 200 OK in webconfs and then massive errors in Browseo so I often check both.)
- Screaming Frog check - does the direct URL start a proper crawl?
- Make sure it's not blocked in WMT under removed pages (some website owners and/or bad SEOs try to demote sitelinks by removing the URL.)
- Meta tags & robots.txt both of which I assume you already checked.
- Duplicate content being indexed. Take a random sentence & throw it in quotes on Google. If a 100% dupe version comes up on their facebook page, archive.is, or some directory it may just need a content refresh to push through.
If you check all 5 of those off, then I'd definitely like to see the URL.
-
If that doesn't work, please share the page URL.
-
Thanks Drik,
I have double check the accessibility of page to crawlers and bots and pages does have decent amount of internal and external links pointing to the page.
Thanks for the Google fetch idea, i am going to try it to see if it works and update you accordingly.
-
Hi
I guess you have already checked that the page is accessible for crawlers and has sufficient internal links to be discovered by the bots (if not - try crawling the site with Screaming Frog)
If it's only one page that isn't picked up you could try a fetch like google & submit to index to force the page being indexed.
It could be that Google considers this page as less important and crawls with lower frequency compared to the other pages (to deep in the site, to few links, not enough content,...)
Dirk
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Page grader says we are keyword stuffing but we arn't. Page source shows different story.
Hi community! We have just run a page grader for the keyword 'LED Bulbs' on whichledlight.com and it comes up that we are keyword stuffing! However, a brief look at the source for the homepage and there's only 6 times that LED Bulbs pops up. We do have the non plural version of the word 'LED Bulb' on the page 27 times.. do we think that would contribute to the keyword stuffing? Thanks!!
On-Page Optimization | | TrueluxGroup0 -
Should a website have the same standard headings for product pages? And how does that affect SEO?
Hello! I hope my question is self-explanatory but let me give you an example. Suppose I have website X selling A, B and C and I have a dedicated page for each of those products. For SEO practises, Is it better to have the same webpage structure for all product pages (i.e. the same headings and sections) or is it better to vary the structure of the page? Or is it really not important? Again going back to the example, is it better for product page A, B and C to have the same sections in the same order (i.e. Pricing, Product Details, Product Reviews) or is it better to keep it as a flowing content page (product page A has same information in B and C but all those pages are different with different headings and questions asked depending on the product)? Many thanks!
On-Page Optimization | | MarketingDude0 -
Corporate Re-Branding, How to best lead into new website?
I have a company that is going to be moving away from a name they have had for 40 years, into a name they have had for the past 10. They are becoming a bigger brand in Canada and want to move away from the west coast name. http://www.wcmachinery.net/ is becoming obsolete. http://shearforce.ca/ will be taking over for both sites. Both of the websites are identically built by a previous web company. The current root domain metrics are shown in the image provided. What do you Mozzers feel would be the best way to phase out the old site without losing the little bit of domain authority wcmachinery.net has gained? west coast machinery is also well know to its customers, so getting the branded search traffic to the shearforce site is also a priority. I am fairly certain this can be handled easily in the about page where it explains the relationship between the two companies. As a side note I have not performed any SEO work on either site as of yet. So please do not judge me based on this site! Thanks for your insights, Randy edit edit
On-Page Optimization | | PixelgemsCreative0 -
Do you handle website on-page/site optimization?
Our website is gaining traction and we are looking for an individual who is an expert at examining websites to see if the structure and on-page optimization is being optimized, and what. Please contact me if you are interested. Thank you.
On-Page Optimization | | balboafinance0 -
In my report of my website it was indicated that I had 19 links/locations blocked by meta-robots. What does this mean and how do I fix it. My website is a Wordpress website.
In my report of my website it was indicated that I had 19 links/locations blocked by meta-robots. What does this mean and how do I fix it. My website is a Wordpress website.
On-Page Optimization | | cyaindc0 -
How to Resolve Google Crawling Issues for My eCommerce Website?
I want to resolve Google crawling issues for my eCommerce website. My website is as follow. http://www.vistastores.com/ Google have crawled only 97 webpages from my website. My website is quite old. (~More than 6 months) But, Google have indexed only 97 webpages. I have created one campaign over SEOmoz tool and found some errors over there. So, I just assumed that due to it Google did not crawled my website. But, I have created one another campaign for my competitor website to know actual status and reason behind it. I found that, my competitor website have more error compare to me but, Google have crawled maximum pages compare to me. So, What is reason behind it? How can I improve my crawling rate and index maximum webpages to Google? [6133009604_af85d29730_b.jpg](img src=) 6133009604_af85d29730_b.jpg 6133009604_af85d29730_b.jpg 6139706697_4e252fdb82_b.jpg
On-Page Optimization | | CommercePundit0 -
Where to Put Content For Product Pages - How To Structure Website?
Currently we have 300+ products. We do not have a CMS or Ecommerce site at the time being for certain reasons. Currently our site is set up with content on almost every single page. The main catagory page, explains everything on the main page, then our products page has a lot of text too. But right now, it seems as if our main pages are only ranking. In the near future I will be using a cms and purchasing a template. I noticed most Ecommerce style websites have just the product with the name and price, then when they click on the product it brings you to that page with a brief product description and some photos. My question is, does each page need content? Or can just the product page itself have content? For example, say we have a link to SHOES. Then the shoes page displays dress, casual and athletic. Then the athletic page brings you to a page with, running, tennis, cross training shoes, and so forth. Is it best to write content on this main catagory page? If so, how much? Or should we focus on putting content on the actual page of the individual product? Along with pictures and specifications? I know Content is Key and we are doing pretty well at that, however, I am starting to wondering if we have to much content or too similar content. What is the best structure to try and recieve GREAT organic rankings?
On-Page Optimization | | hfranz0