Single Page on my client's website is not crawling and indexing new changes. What could be the possible reason?
-
I made several changes on client's website on different pages, changed titles, add content on few pages, moved blog from subdomain to sub directory. Everything is crawled but there is one page on the website (not part of the blog) that isn't getting crawled in Google and picking up changes. The last crawl of the website is 2 days back whereas that page was last crawled on 30th sep.
I just wanted to know the possible reasons and has anyone encountered this before?
-
Hi Moosa, do you have an update on this issue?
-
Things I check:
- header check (I've had pages appear 200 OK in webconfs and then massive errors in Browseo so I often check both.)
- Screaming Frog check - does the direct URL start a proper crawl?
- Make sure it's not blocked in WMT under removed pages (some website owners and/or bad SEOs try to demote sitelinks by removing the URL.)
- Meta tags & robots.txt both of which I assume you already checked.
- Duplicate content being indexed. Take a random sentence & throw it in quotes on Google. If a 100% dupe version comes up on their facebook page, archive.is, or some directory it may just need a content refresh to push through.
If you check all 5 of those off, then I'd definitely like to see the URL.
-
If that doesn't work, please share the page URL.
-
Thanks Drik,
I have double check the accessibility of page to crawlers and bots and pages does have decent amount of internal and external links pointing to the page.
Thanks for the Google fetch idea, i am going to try it to see if it works and update you accordingly.
-
Hi
I guess you have already checked that the page is accessible for crawlers and has sufficient internal links to be discovered by the bots (if not - try crawling the site with Screaming Frog)
If it's only one page that isn't picked up you could try a fetch like google & submit to index to force the page being indexed.
It could be that Google considers this page as less important and crawls with lower frequency compared to the other pages (to deep in the site, to few links, not enough content,...)
Dirk
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate 'meta title' issue (AMP & NON-AMP Pages)
how to fix duplicate meta title issue in amp and non-amp pages? example.com
On-Page Optimization | | 21centuryweb
example.com/amp We have set the 'meta title' in desktop version & we don't want to change the title for AMP page as we have more than 10K pages on the website. ----As per SEMRUSH Tool---- ABOUT THIS ISSUE It is a bad idea to duplicate your title tag content in your first-level header. If your page’s <title>and <h1> tags match, the latter may appear over-optimized to search engines. Also, using the same content in titles and headers means a lost opportunity to incorporate other relevant keywords for your page.</p> <p><strong>HOW TO FIX IT</strong></p> <p>Try to create different content for your <title> and <h1> tags.<br /><br />this is what they are recommending, for the above issue we have asked our team to create unique meta and post title for desktop version but what about AMP page?<br /><br />Please help!</p></title>0 -
Pages indexed but not seen in wordpress
Hi there, the crawler of SEOMOZ has detected that some pages have no title or a short metadescription. The problem is that I can't see these pages in wordpress (in the backend). These pages are irrelevant and must be deleted but I can't find them. How could they be indexed by the Googlebot? Where can I find them? Any hint? Thanks all.
On-Page Optimization | | juanmiguelcr0 -
Home page or landing page?
Hello, I want to ask a question related to that - Should we put keywords in the home page title if we wish to position another landing page better for particular keywords? I have read in one website about SEO that it's good the main keywords of your website to be positioned in homepage title also. f.e. Let's say we have website about web-design and our company is named Company Ltd. The title of the home page is "Company Ltd. - Web design, SEO, etc" We have also another inner page named "Web design | Company Ltd.". So should we leave the first page name only "Company Ltd." and the landing page's name "Web design | Company Ltd." . I don't know if they both have the same keyword in their title they won't compete with each other.
On-Page Optimization | | HrishikeshKarov0 -
On page link question, creating an additional 'county' layer between states and zips/cities
Question We have a large site that has a page for all 50 states. Each of these pages has unique content, but following the content has a MASSIVE amount of links for each zip AND city in that state. I am also in the process of creating unique content for each of these cities and zips HOWEVER, I was wondering would it make sense to create an additional 'county' layer between the states and the zips/cities. Would the additional 'depth' of the links bring down the overall rank of the long tail city and zip pages, or would the fact that the counties would knock the on page link count down from a thousand or so, to a management 50-100 substantially improve the overall quality and ranking of the site? To illustrate, currently I have State -> city and zip pages (1200+ links on each state page) what i want to do is do state -> county (5-300 counties on each state page) -> city + zip (maybe 50-100 links on each county page). What do you guys think? Am I incurring some kind of automatic penalty for having 1000+ links on a page?
On-Page Optimization | | ilyaelbert0 -
Can u suggest me good one page optimization tool for wordpress based websites?
Can u suggest me good one page optimization tool for wordpress based websites?
On-Page Optimization | | dineshameh0 -
SEOMOZ suggested site optimzation change on 1 low level page
I asked this before, but did not really get an answer, so checking again. Really grateful for any help... My question is: Based on the PRO crawl Diagnostics – if we don’t make a recommended change on say 1 rather obscure page, does that just affect the SEO on that one page only, or does it potentially affect the SEO on all (more important) pages of the site? e.g. home page etc E.g. If we get a “Too many on page links” for a certain page that we don’t really want to rank for – does not fixing that particlaur page really affect the SEO for the site as a whole? Or just that 1 page (that I don't really care too much about) Hope someone is able to answer, thanks so much...
On-Page Optimization | | inhouseninja0 -
A good title for each page on my website.
Dear SEOs, I know these facts: a) not more than 70 chars b) relevant to the page subject - probably best keyword at the beginning My problem - should I rebuild the current structure of my titles which is: Main Page keywords (in my case 4) | domain name - Main Page Sub-page - one click from main page keywords (again same 4) | domain name - Sub Page Name (or as you like Category Name) Specific page with an article / content keywords (again same 4 as on any other) | domain name - category name - title of article same as used in tag To be more precise, should this title be changed for following pages: Sub Page - where really it's page that let's you chose particular subjects (there will be few article for each subjects) so should the keywords be changed to - "chose your category" Specific page with an article - should the category name - title of article be completely removed and first part of title which at the moment contains same 4 keywords used on main page be replaced with keywords specific for the content ? To be honest I find those titles at the moment bit confusing and sort of illogical. But since I can't really change anything in the code I would like to know what's the right way before I keep pressing on the programmer 🙂 Thanks.
On-Page Optimization | | lolskizz0 -
Site URL's
We are redeveloping our website, and have the option to amend URLs (with 301 redirects from old URL to new), so my question is: Would 'golfsite.com/golf-clubs' achieve superior rankings than 'golfsite.com/clubs' for the search term 'golf clubs' if all other factors were the same? Should the URL reflect the intended search term wherever possible?
On-Page Optimization | | swgolf1230