In Index but not in Serps
-
Hi,
I have a situation with a client site which is quite frustrating.
Basically, most "recent" (by that I mean for the last couple of months) blog posts are failing to reach the SERPS (actually, one has and a couple have from the early days but it's taken months for them to arrive).
Previously the blog posts were indexed very quickly - often instantly.
Now, I've checked WMT etc and I've submitted each post manually but still nothing. The Sitemap is valid etc.
However, pages (not blog posts) seem to be getting into the serps very quickly.
Another complication is that if I search:
site:www.domainname.com and set the date filter to a month I can see some of the earlier blog posts in that result set.
However, if I scrape a bit of unique content from one of those posts and search - nothing in the SERPS. And my Moz report tells me that the page is not to be found in the top 50 either (so I'm confident these pages are not in the SERPS).
Any ideas why this would happen to just blog posts? Is it something to do with the parent blog landing perhaps being too strong in the rankings?
Any ideas appreciated.
Thanks.
-
Thanks Matt - appreciate the reply.
Robots.txt are fine and I've check with other tools that the individual posts are not being blocked by robots.
WMT checks out fine too though the Crawl Rate is set to : Your site has been assigned special crawl rate settings. You will not be able to change the crawl rate.
Though the craw chart is indicating lots of crawling each day.
I do wonder about that crawl rate setting though. The site is using CloudFlare for speed optimisation and I believe that is a common occurrence when using CloudFlare.
I'll check out Screaming Frog though.....good idea.
Thanks again.
-
Really hard to say without knowing the site. However my first place to look would be at technical issues. Are they crawl-able and indexable?
- Check robots text, metatags etc - are you allowing googlebot to crawl?
- Log in to webmaster tools and see if any URLs are being blocked/unreachable
- Point a crawler, such as Xenu or screaming frog at the home page. WIth all settings set to mimic Google, does it find the posts?
If it passes all of those it should be technically indexable. If that doesn't turn up anything I would start looking at when Google is crawling the site (webmaster tools) and see if that is the problem.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Index Issue
2 months ago, I registered a domain named www.nextheadphone.com I had a plan to learn SEO and create a affiliate blog site. In my website I had 3 types of content. Informative Articles Headphone Review articles Product Comparision Review articles Problem is, Google does not index my informative articles. I dont know the reasons. https://www.nextheadphone.com/benefits-of-noise-cancelling-headphones/
Content Development | | NextHeadphone
https://www.nextheadphone.com/noise-cancelling-headphones-protect-hearing/ Is there anyone who can take a look and find the issues why google is not indexing my articles? I will be waiting for your reply0 -
Website is not getting indexed
Hi,
Content Development | | Aman0022
Hope you all are doing great!
I have created a dog blog a few weeks back which talks about all things about dogs (http://pawspulse.com/). I am publishing couple of articles everyday which are more than 5k words long with proper keyword research but still Google is not indexing my content. My content is systematically categorized in proper categories related to dog guides, nutrition, accessories, dog breeds etc.
Can anyone help me how to get the website index faster fully. Any help will be much appreciated. Thanks0 -
Can unreliable server hurt your serps?
Hi I have a small personal blog about food and wine that I recently moved from blogger to wordpress and it is currently being hosted by the company who moved the blog over from one system to the other. This week I've noticed an 80% drop in organic traffic thanks to losing pretty much every first page SERP, there's no messages in WMT, i dont pay for links, all that's on the site is original content about food and wine that I enjoy. I've never had a previous drop in ranking/traffic like it. The one thing I can say, is that the guy who took over the hosting is hosting it himself on his own server and the website has been down more times than I would consider reasonable, often for hours at a time (this is when I catch it and I don't check often). Would the site be penalised for this? If I move servers to a reliable co i normally use, how long will it take to recover?
Content Development | | xoffie0 -
I started a Wordpress blog, google indexed it...
How long before I can see those links show up in SEO Moz for my website? What elements is SEO Moz looking for before they add the wordpress site to my linking domains report? Regards, Jeff
Content Development | | biggieshaws0 -
How do I get the correct picture to show up in the SERPs?
When I search for "Popular Baby Names" using Google UK, I get the image below that is clearly displaying the wrong picture. I believe they are coming from a module on the page in the left rail. I know I can use Robots.txt to have Google not show the image at all, but I don't want to impact my click through. What is the best way to have the search engine either not display an image that is not part of the resulting article or better yet, pick the right image. | | Popular baby names in the UK14 Feb 2012 ... We list the most popular names for babies born in the UK in recent years, taken from official national statistics.www.babycentre.co.uk/pregnancy/naming/popularbabynames |
Content Development | | network_operations0 -
Should I Have No Index, No Follow On Blog Category & Tag Pages?
At some point in the past I read or was told that No Index, No Follow tags on category and tag pages were a good thing on a standard WordPress blog in order to prevent duplicate content issues. Is this still true or was it ever true?
Content Development | | eTundra0 -
Please help me stop google indexing https pages on my wordpress site
I added SSL to my wordpress blog because that was the only way to get a dedicated IP address for my site at my host. Now I am noticing Google has started indexing posts both as http and https. Can some one please help how to force google not to index https as I am sure its like having duplicate content. All help is appreciated. So far I have added this to top of htaccess file: RewriteEngine on Options +FollowSymlinks RewriteCond %{SERVER_PORT} ^443$ RewriteRule ^robots.txt$ robots_ssl.txt And added robots_ssl.txt with following: User-agent: Googlebot Disallow: / User-agent: * Disallow: / But https pages are still being indexed. Please help.
Content Development | | rookie1230 -
Index pdf files but redirecto to site
Hi, One of our clients has tons of PDFs (manuals, etc.) and frequently gets good rankings for the direct PDF link. While we're happy about the PDFs attracting users' attention, we'd like to redirect them to the site where the original PDF link is published and avoid that people open the pdf directly. In short, we'd like to index the PDFs, but show to users the pdf link within a site - how should we proceed to do that? Thanks, GM
Content Development | | gmellak0