Single Page on my client's website is not crawling and indexing new changes. What could be the possible reason?
-
I made several changes on client's website on different pages, changed titles, add content on few pages, moved blog from subdomain to sub directory. Everything is crawled but there is one page on the website (not part of the blog) that isn't getting crawled in Google and picking up changes. The last crawl of the website is 2 days back whereas that page was last crawled on 30th sep.
I just wanted to know the possible reasons and has anyone encountered this before?
-
Hi Moosa, do you have an update on this issue?
-
Things I check:
- header check (I've had pages appear 200 OK in webconfs and then massive errors in Browseo so I often check both.)
- Screaming Frog check - does the direct URL start a proper crawl?
- Make sure it's not blocked in WMT under removed pages (some website owners and/or bad SEOs try to demote sitelinks by removing the URL.)
- Meta tags & robots.txt both of which I assume you already checked.
- Duplicate content being indexed. Take a random sentence & throw it in quotes on Google. If a 100% dupe version comes up on their facebook page, archive.is, or some directory it may just need a content refresh to push through.
If you check all 5 of those off, then I'd definitely like to see the URL.
-
If that doesn't work, please share the page URL.
-
Thanks Drik,
I have double check the accessibility of page to crawlers and bots and pages does have decent amount of internal and external links pointing to the page.
Thanks for the Google fetch idea, i am going to try it to see if it works and update you accordingly.
-
Hi
I guess you have already checked that the page is accessible for crawlers and has sufficient internal links to be discovered by the bots (if not - try crawling the site with Screaming Frog)
If it's only one page that isn't picked up you could try a fetch like google & submit to index to force the page being indexed.
It could be that Google considers this page as less important and crawls with lower frequency compared to the other pages (to deep in the site, to few links, not enough content,...)
Dirk
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Ranking dropped after change single page url, should I change it back?
I was making updates to the content on the following page, and a few days later dropped from #2 SERP ranking to 50+. Things I checked: Yes, 301 redirect was implemented right away. After publishing, I manually requested indexing in search console. Right after publishing I re-submitted the sitemap manually and Google said they had not crawled it in 9 days. My question: should I change the URL back to the old one, or give it a little more time (especially since I re-submitted sitemap) Original URL: https://www.travelinsurancereview.net/plans/travel-medical/ New URL: https://www.travelinsurancereview.net/plans/travel-medical-insurance/
On-Page Optimization | | DamianTysdal0 -
Duplicate Content with ?Page ID's in WordPress
Hi there, I'm trying to figure out the best way to solve a duplicate content problem that I have due to Page ID's that WordPress automatically assigns to pages. I know that in order for me to resolve this I have to use canonical urls but the problem for me is I can't figure out the URL structure. Moz is showing me thousands of duplicate content errors that are mostly related to Page IDs For example, this is how a page's url should look like on my site Moz is telling me there are 50 duplicate content errors for this page. The page ID for this page is 82 so the duplicate content errors appear as follows and so on. For 47 more pages. The problem repeats itself with other pages as well. My permalinks are set to "Post Name" so I know that's not an issue. What can I do to resolve this? How can I use canonical URLs to solve this problem. Any help will be greatly appreciated.
On-Page Optimization | | SpaMedica0 -
Add multiple H2 tags on a single page. Good or Bad?
Can we add Multipal H2 tags on a single page, Is good or Bad. Here is an example - http://packforcity.com/things-to-do-in-new-york-city/
On-Page Optimization | | ross254sidney0 -
Should I be afraid to launch new website?
I have been redesigning my website in the last 2 months. I'm almost ready to finally launch it. Now I wonder how it will effect my rankings. I have taken a few measures to avoid problems such as: I kept the page names as they are. I kept the structure of the website Optimized the structure of my pages which should benefit my SEO rather then harm it. Yet, if I would experience a drop in rankings, could I regain my rankings by switching to the previous website?
On-Page Optimization | | wellnesswooz0 -
Does a page's url have any weight in Google rankings?
I'm sure this question must have been asked before but I can't find it. I'm assuming that the title tag is far more important than the page's url. Is that correct? Does the url have any relevance to Google?
On-Page Optimization | | rdreich490 -
Too Many On-Page Links on a Directory type website?
Hi there, I run a website which is a directory therefore there are a lot of On-Page links. If you take a look at the site, www.south-african-hotels.com, you will see there are a number of links on all pages which are completely relevant. I'm not sure what to remove as everything is relevant. The top navigation is available throughout and that alone has 120 links in it to give users easy access to information. Do I ignore the Too many On-Page links suggestion or do I change something? Any suggestions welcome! Thank you in advance!
On-Page Optimization | | RyanMackie0 -
Numbers in URL's - Search friendly or not?
Hi Mozzers, I have a client who has just launched a new website and we are having difficulties in making the URL's search friendly. I wont get into the technical aspects, but I'll explain the potential solutions the developers have given me. current: www.site.com/en/product/browse-by-product/37/22 Where 'en' stands for the English version of the website, 37 is the product category for example 'hard drives', and 22 is the product name or example 'seagate' Option to fix; www.site.com/en/p/product/hard-drives-37/seagate-22 This optional fix reduces the word product down to p, reduces 'browse by product' to 'product' and inserts the category and product names. Note the category identifier '37' has to be included in the URL, and the product identifier '22' also has to be in the URL. Obviously this is not great, but it is required at the moment. Best case scenario would be to have the URL like this... www.site.com/en/hard-drives/seagate So my question is, how far off the best case scenario is the option to fix? Scale of 1 to 10 would be good?
On-Page Optimization | | JoeyDorrington0 -
Post Title - Use the blog's name or not?
In the tile of my post, shoudl I used my blog's name in it at the end or emit the blog name. EX: title of post with keywords | name of blog OR EX: title of post with keywords The site's name is 3 words long, so I'm worrying that those extra words are diluting the keywords in the post's name that I'm trying to target.
On-Page Optimization | | gregalam0