In Index but not in Serps
-
Hi,
I have a situation with a client site which is quite frustrating.
Basically, most "recent" (by that I mean for the last couple of months) blog posts are failing to reach the SERPS (actually, one has and a couple have from the early days but it's taken months for them to arrive).
Previously the blog posts were indexed very quickly - often instantly.
Now, I've checked WMT etc and I've submitted each post manually but still nothing. The Sitemap is valid etc.
However, pages (not blog posts) seem to be getting into the serps very quickly.
Another complication is that if I search:
site:www.domainname.com and set the date filter to a month I can see some of the earlier blog posts in that result set.
However, if I scrape a bit of unique content from one of those posts and search - nothing in the SERPS. And my Moz report tells me that the page is not to be found in the top 50 either (so I'm confident these pages are not in the SERPS).
Any ideas why this would happen to just blog posts? Is it something to do with the parent blog landing perhaps being too strong in the rankings?
Any ideas appreciated.
Thanks.
-
Thanks Matt - appreciate the reply.
Robots.txt are fine and I've check with other tools that the individual posts are not being blocked by robots.
WMT checks out fine too though the Crawl Rate is set to : Your site has been assigned special crawl rate settings. You will not be able to change the crawl rate.
Though the craw chart is indicating lots of crawling each day.
I do wonder about that crawl rate setting though. The site is using CloudFlare for speed optimisation and I believe that is a common occurrence when using CloudFlare.
I'll check out Screaming Frog though.....good idea.
Thanks again.
-
Really hard to say without knowing the site. However my first place to look would be at technical issues. Are they crawl-able and indexable?
- Check robots text, metatags etc - are you allowing googlebot to crawl?
- Log in to webmaster tools and see if any URLs are being blocked/unreachable
- Point a crawler, such as Xenu or screaming frog at the home page. WIth all settings set to mimic Google, does it find the posts?
If it passes all of those it should be technically indexable. If that doesn't turn up anything I would start looking at when Google is crawling the site (webmaster tools) and see if that is the problem.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Index Issue
2 months ago, I registered a domain named www.nextheadphone.com I had a plan to learn SEO and create a affiliate blog site. In my website I had 3 types of content. Informative Articles Headphone Review articles Product Comparision Review articles Problem is, Google does not index my informative articles. I dont know the reasons. https://www.nextheadphone.com/benefits-of-noise-cancelling-headphones/
Content Development | | NextHeadphone
https://www.nextheadphone.com/noise-cancelling-headphones-protect-hearing/ Is there anyone who can take a look and find the issues why google is not indexing my articles? I will be waiting for your reply0 -
Google won't index my website because "certain conditions" weren't met
I found the answer on this -- interestingly, I had changed registrars and they didn't pull over the DNS information correctly. This caused the above issues. Once I identified this, I updated the DNS correctly -- at registrar and server -- and things worked fine.
Content Development | | newbyguy0 -
Sitemap - 200 out of 2100 pages indexed
I submitted the .xml sitemap in Google Webmaster Tools and only 200 out of 2100 pages were indexed.
Content Development | | Madlena
Why is that and what can I do ?0 -
Authorship showing in SERPs for non-blog pages
Hi, A few months ago we set up authorship for on our blog articles for multiple authors, which has helped driving extra traffic to our blog posts. Today, I did a search for one of most important search terms and one of our non-blog pages is showing in the first page of the results with one of our authors headshot next to it. Technically we have not not set it up to do this, the page is on a different CMS to our blog (which is wordpress). I'm not complaining because I think this is a positive outcome, but does anyone have an idea why it has done this? I was under the impression that only blog article pages could have authorship set up. Thanks, Stu
Content Development | | Stuart260 -
One story stands out for not getting indexed?
We have all our stories published today ( 20-Jun-2013 ) got indexed by google except this ( http://coed.com/2013/06/20/heres-a-video-of-kate-upton-topless-on-a-horse/ ). Do anyone out there have any clue about that? Thanks in advance
Content Development | | COEDMediaGroup0 -
How do I get the correct picture to show up in the SERPs?
When I search for "Popular Baby Names" using Google UK, I get the image below that is clearly displaying the wrong picture. I believe they are coming from a module on the page in the left rail. I know I can use Robots.txt to have Google not show the image at all, but I don't want to impact my click through. What is the best way to have the search engine either not display an image that is not part of the resulting article or better yet, pick the right image. | | Popular baby names in the UK14 Feb 2012 ... We list the most popular names for babies born in the UK in recent years, taken from official national statistics.www.babycentre.co.uk/pregnancy/naming/popularbabynames |
Content Development | | network_operations0 -
Indexing of PDF files
Hey all, I understand the functionality of PDF files being indexed and how to remove them if required so in this post I'm not requiring any advice on 'how to' as such, but i just wanted to get a general opinion/consensus of if you deliberately allow PDF files to be crawled/indexed.
Content Development | | Daylan
Whether or not you guys optimise the files for search.
If you do disallow them from being crawled and indexed, why?
Generally the pro's and con's you may have found about have searchable PDF files as part of your indexed content.1 -
Why is this store getting hurt in SERPs when they removed duplicate content?
I work with an e-commerce client who got hit hard by Panda. They are very cautious, and want small-scale tests to prove each hypothesis before committing to larger changes. Recently, we reworked content on 30 product detail pages. Before, these product pages featured some original content mixed with some manufacturer content. The change we made was to remove the manufacturer content completely from the product page, leaving about 300 words of high-quality, original content--all of which was written by subject matter experts. I assumed that Google viewed this manufacturer text as duplicate content. However, when these 30 modified pages were compared to the control, they performed significantly worse. Question 1: Does any have any idea why these pages would perform worse than the control?
Content Development | | merch_zzounds
Question 2: Do you have any tips for convincing this client to try another test or get the buy-in to make the larger changes that--in theory--need to happen? FWIW, this client has about 10,000 product detail pages--the vast majority of which contain just manufacturer content. I appreciate your thoughts.0