Description tag not showing in the SERPs because page is blocked by Robots, but the page isn't blocked. Any help?
-
While checking some SERP results for a few pages of a site this morning I noticed that some pages were returning this message instead of a description tag,
A description for this result is not avaliable because of this site's robot.s.txt
The odd thing is the page isn't blocked in the Robots.txt. The page is using Yoast SEO Plugin to populate meta data though.
Anyone else had this happen and have a fix?
-
I am having the same issue currently with one of my clients sites. No robots.txt is or was ever in place. I can not find any issues at all that would cause the problem. Was wondering if you every had any resolution to this? Client also uses Yoast.
-
Hi there! Has this issue been resolved? We'd love to have an update, thanks! (Christy)
-
Could the pages have been blocked in robotos.txt in the past? It can take an age for Google to re-index pages a proper after having been blocked previously.
-
Certainly doesn't appear to be any issues there. It's difficult to determine the issue without taking a look closer but its not the robots.txt file and if your site is fully indexed then I can't offer more without seeing the site.
Would you be willing to share the URL?
-
No, it's not on. The site is indexed, just certain description tags aren't.
-
It's pretty standard
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
-
I've seen people with similar issues before and it's been a small but fatal error in the robots.txt file itself. Can you please share it here and I'll advise further if needed.
-
Can you check something for me please?
Log in to wp-admin
Go to Setting then Privacy
Check if “Ask search engines not to index this site.” is set to ON
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Image alt tags shouldn't contain keywords?
Hi Everyone, I've been informed recently that keyword within your image alt tags can be a trigger for penguin if you have your keyword mentioned too often on the page (over-optimisation). I'm not sure I understand why though, the reason for this is, we have a page which features a picture and a description of a product. The page title, heading, a mention in content and image alt all contain a keyword which is the product name. I've been told to remove these alt tags but aren't alt tags important for screen readers and other W3C complacency issues, so removing the product names from the alt (which also happens to be the keyword for the product pages but is best describing what the image is) would make these image useless to users with certain disabilities, so if its true that doing this can be a negative signal isn't this breaking googles guidelines by not providing good content for those users? Would it be better to remove these alt tags or attempt to remove keyword elsewhere on the page? or can anyone suggest something else? Thanks in advance.
On-Page Optimization | | AMA-DataSet0 -
SEO Location Pages - ALT Image Tag Question
Hello Guru's, I have a Hire Website whereby you can rent products online. I have created different Location pages for these which are in essence the same pages page but with different location specific urls, title tags , on page content etc etc. This helps me to rank for local search. These location pages also display 20 products per page. My question is Should I make the ALT IMAGE TEXT location specific for each of the 20 products . Example - Steam Cleaner Rental in "location" or should I only amend a few of the Atl Image Texts to be location specific. I don't want to come accross as spammy in google eyes but I also don't want to be seen as having duplicate content , images etc etc What do you think ? thanks Sarah.
On-Page Optimization | | SarahCollins0 -
Rel canonical tag back to the same page the tag is on?
Very simple, Why would a website (and I have seen tons doing this) link the rel canonical tag back to the same page the tag is on? Example: somepage.htm has a canonical tag linking to somepage.htm I thought the idea of this tag was to tell google if 2 pages are similar, this page is the original, and it's this page which should be indexed and the page with the tag on should pass all PR to the original. Maybe im wrong and someone can help me out to understand this.
On-Page Optimization | | activitysuper0 -
What's the best way to tackle duplicate pages in a blog?
We installed a WP blog on a website and the below result is just an example. All of them lead to the same content. What's the best way to resolve it? http://www.calmu.edu/blog/
On-Page Optimization | | Sangeeta
http://www.calmu.edu/blog/calmu-business-spotlight-veev/
http://www.calmu.edu/blog/category/business-buzz/0 -
Right way to block google robots from ppc landing pages
What is the right way to completely block seo robots from my adword landing pages? Robots.txt does not work really good for that, as far I know. Adding metatags noindex nofollow on the other side will block adwords robot as well. right? Thank you very much, Serge
On-Page Optimization | | Kotkov0 -
Source page leading to a 404 pages in reports
Hi everybody, I wonder how to find and quickly correct 404 errors in my crawl reports : SeoMoz says me "http://domain.com/this-page-is-dead" is 404, but I can't figure out a source page where a link to that url appears. I tried a google link:http://domain.com/this-page-is-dead request, with no more luck. I imagine the trick is trivial, but I need it 🙂 Moreover, why do not show a list of pages referring to this 404 page on reports ? Thanks, Loïc
On-Page Optimization | | mandinga0 -
Almost all pages showing under Notices Rel Canonical - why???
Hi, I'm just going through my latest crawl since my new site launch and havce noticed almost all of my websites pages are listed under the notices rel canonical section, Why is this? All pages have the unique pages titles followed by the site name in the title, for example: Product | Site name All pages have unique meta descriptions and content (although we only offer lots of differt varients of the same product). Is this something I should be worried about?
On-Page Optimization | | EclipseLegal0 -
Home page ranking dropped below internal pages
The index page for a site I manage has dropped significantly - internal pages rank above it. It's a new site, 2 months old but was ranking at 1st. Any suggestions as to how I can debug this?
On-Page Optimization | | OptioPublishing0