Site Not Being Indexed
-
Hey Everyone - I have a site that is being treated strangely by google (at least strange to me) The site has 24 pages in the sitemap - submitted to WMT'S over 30 days ago
I've manually triggered google to crawl the homepage and all connecting links as well and submitted a couple individually.
Google has been parked the indexing at 14 of the 24 pages. None of the unindexed URL's have Noindex or follow tags on them - they are clearly and easily linked to from other places on the site. The site is a brand new domain, has no manual penalty history and in my research has no reason to be considered spammy. 100% unique handwritten content
I cannot figure out why google isn't indexing these pages.
Has anyone encountered this before? Know any solutions? Thanks in advance.
-
Some of your pages lack enough content or unique content for Google to care:
This: http://carpetcleanertn.com/carpet-cleaning-specials/ isn't indexed. But then, why would it be?
http://carpetcleanertn.com/carpet-cleaning-spring-hill-tn/ this isn't indexed - but ... yeah.
No content except an image on this either: http://carpetcleanertn.com/gift-certificates/
None at all here: http://carpetcleanertn.com/great-nashville-area/
Your pricing & services page aren't being indexed but that's because they're near-copies of the actual chemdry page. See attachment.
I think if you wrote clean, new copy for the pricing & services page you'd see them get indexed but since they're super-close to the original, Google has chosen to only index one.
-
Thanks Matt - I've sent a Private Message.
-
Thanks Andrew -
http://screencast.com/t/j9ewBBXjvuy
I think we're clear there?
I checked some of the specific pages (that haven't been indexed) and googlebot is showing no errors there.
Thanks,
-
Gaston -
I did, and I should have mentioned that at the start -
It shows 18 indexed - a couple junk internal pages (that I need to pull!) and that weren't even in the sitemap that I submitted.
-
PM the URL or post it here so we can take a look. Generally this is a case of:
-
No indexed links yet
-
Duplicate content
-
Robots meta tag or robots.txt
-
Content not actually in the site (iframes, other coding issues)
-
Content in an image/flash/other unreadable or nearly unreadable format.
-
-
Great question.
As recommended by Andrew, I would definitely check your site's robots.txt file to ensure those pages or sections of the site aren't being blocked.
Secondly, I would check your sitemap and make sure there aren't any errors within it. Often times if your sitemap is inaccurate Google might decide to not index certain pages.
Doing a site:search for your website will help you understand what pages are showing up as well. Beyond this, you can do a site:search and enter a keyword for one of the landing pages that isn't being indexed by Google. If that page shows up, you know it's indexed.
Often times GSC doesn't give us 100% accurate data and therefore it's good to do these checks yourself. It's important to note that Google doesn't have to index certain pages if it doesn't find them useful for one reason or another. This is something we don't have much control of, however I doubt that is the case here.
Do the steps I mentioned above and let me know if you find anything interesting. Respond with your findings and we can try and get to the bottom of your specific issue. Hope that helps!
-
Hello,
You mentioned that none of the pages have noindex/nofollow tags, but have you also checked your robots.txt file to verify that they aren't blocked there?
-Andrew B.
-
Hi there,
Is well known that Search console usualy has those error, that displays information that is not accurate.
Have you tried to search that site? Using site:yoursite.com? There you will confirm how many pages are indexed.Hope it helps.
GR.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Removing a site from Google index with no index met tags
Hi there! I wanted to remove a duplicated site from the google index. I've read that you can do this by removing the URL from Google Search console and, although I can't find it in Google Search console, Google keeps on showing the site on SERPs. So I wanted to add a "no index" meta tag to the code of the site however I've only found out how to do this for individual pages, can you do the same for a entire site? How can I do it? Thank you for your help in advance! L
Technical SEO | | Chris_Wright1 -
Some of my website urls are not getting indexed while checking (site: domain) in google
Some of my website urls are not getting indexed while checking (site: domain) in google
Technical SEO | | nlogix0 -
Will sitemap generated in Yoast for a combined wordpress/magento site map entire site ?
Hi For an ecommerce site thats been developed via a combination of wordpress and magento and has yoast installed, will the sitemap (& other yoast features) map (& apply to) the entire site or just wordpress aspects ? In other words does one need to do anything else to have a full sitemap for a combined magento/wordpress site or will Yoast cover it all ? This link seems to suggest should be fine but seeing if anyone else encountered this and had problems or if straightforward ? http://fishpig.co.uk/wordpress-integration/docs/plugins.html cheers dan
Technical SEO | | Dan-Lawrence0 -
Site Categorization?
I know getting site categories to appear under the site are dependent on a lot of factors including site mapping. We have a site that does the categorization thing when you type in the sites url name however more people search for the name of the talent to find the site and the short url on the site is just his name, but shorter. However I was just wondering is their a way to optimize the site so that way we could get categorization to show up under the sites URL when they search for the talents full name I ask because the amount of people looking for the talents full name rather than the short name is a lot larger and I would like to see if we can take advantage of the real estate, but I honestly don't think there is a way, however I figured I would open it up to discussion to see if anyone has any ideas. Example: Site name is ABCD you type this into Google and you get ABCD.com about blog how to contact However the actual person whose site it is is ABCDEF and when you type that in you just get: ABCD.com without any of the categories appearing below the url. And that is what I'm asking about. Thanks as I can't seem to find a lot of information on this. However if there is another spot on the site talking about this please let me know I may just not be searching with the right terms.
Technical SEO | | KateGMaker0 -
Googlebot cannot access your site
"At the end of July I received a message in my Google webmaster tools saying "Googlebot can't access your site" We checked our robots.txt file and removed a line break in it, and then I had Google Fetch the file again. I have not received any more messages since then. When we created the website I wrote all of the content and optimized each page for about 1 local keyword. A few weeks after I checked my keywords and did have a few on the first page of google. Since then almost all of them have completely disappeared. Because we had not link building effort I would not expect to still be on the first page, but I should definitely be seeing them before the 5th or even 10th page of Google. The address is http://www.tile-pompanobeach.com I'm not sure if these horrible results have something to do with the message from Google or something else. The problem is this client now wants to sign a contract with us for SEO and I really have no Idea what happened and if I will be able to figure it out. The main keyword for my home page is tile pompano beach and I aslo was using Pompano Beach Tile store for the About page which was previously on the first page of Google. Does anyone have some input?
Technical SEO | | DTOSI0 -
On-site adjustment opinions
Hi folks, I've got a fairly interesting scenario. I'm trying to rank this page (http://www.staysa.co.za/sa/1-2-0-0-1/East-London/accommodation) better for the term, "accommodation east london". The client isn't keen on making many changes and it was built horribly with ASP, half CMS, half not. I have made the following changes today: I introduced two paragraphs of text below the H1 tag. I changed "East London Bed and Breakfast", "East London Conference Venues", "East London Cottage / Chalet" to just "Bed and Breakfast", "Conference Venues", "Cottage / Chalet" as the continual key phrase duplication in my experience is a bad move. I've made a change to the title tag (this is a huge mission as it's not CMS controlled, so I had to teach myself some basic ASP to do so). Meta data.. nightmare to change unfortunately, at least not without rewriting part of the CMS. I'm wondering, are there any other on-site factors that I'm missing? I'm not a fan of site-wide links, so I don't want to put an exact match anchor text link from the sidebar/footer to the page, not unless someone can motivate why I should. Keen to hear everyone's opinions 🙂
Technical SEO | | ChristopherM0 -
Google Has Indexed Most of My Site, why won't Bing?
We've got 600K+ pages indexed by Google and have submitted our same sitemap.xml's to Bing, but have only seen 100-200 pages get indexed by Bing. Is this fairly typical? Is there anything further we can do to increase indexation on Bing?
Technical SEO | | jamesti0 -
Site indexing and traffic increased so dramatically overnight
Number of indexed pages jumped from 39000 to 52000 and traffic increased around 50% in my site.Note: used "site" command to check the indexed pages. I understand this is approximate.In addition, number of crawled pages/day also increased dramatically.No change in the robots.txt, sitemap, crawl errors and duplicate issues. But server migrated to different IT infrastructure. Before any celebration, want to identify the helper. Thanks.
Technical SEO | | gmk15670