Description tag not showing in the SERPs because page is blocked by Robots, but the page isn't blocked. Any help?
-
While checking some SERP results for a few pages of a site this morning I noticed that some pages were returning this message instead of a description tag,
A description for this result is not avaliable because of this site's robot.s.txt
The odd thing is the page isn't blocked in the Robots.txt. The page is using Yoast SEO Plugin to populate meta data though.
Anyone else had this happen and have a fix?
-
I am having the same issue currently with one of my clients sites. No robots.txt is or was ever in place. I can not find any issues at all that would cause the problem. Was wondering if you every had any resolution to this? Client also uses Yoast.
-
Hi there! Has this issue been resolved? We'd love to have an update, thanks! (Christy)
-
Could the pages have been blocked in robotos.txt in the past? It can take an age for Google to re-index pages a proper after having been blocked previously.
-
Certainly doesn't appear to be any issues there. It's difficult to determine the issue without taking a look closer but its not the robots.txt file and if your site is fully indexed then I can't offer more without seeing the site.
Would you be willing to share the URL?
-
No, it's not on. The site is indexed, just certain description tags aren't.
-
It's pretty standard
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
-
I've seen people with similar issues before and it's been a small but fatal error in the robots.txt file itself. Can you please share it here and I'll advise further if needed.
-
Can you check something for me please?
Log in to wp-admin
Go to Setting then Privacy
Check if “Ask search engines not to index this site.” is set to ON
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Page Title (Meta descriptions) length... how strict are you?
I have just had a conversation with a client... the gist was this... Is it more important to stay under the 55-60 characters OR go over a bit and have the page title make sense and include the clients company name. The same argument for meta description. I have a client insisting on 55-60 length but the keywords are long and if we use the primary keyword phrase the length is 44 if we use the keyword phrase and add the company name it becomes 64. This is with us trimming it a bit. Anyone else discussed this before?
On-Page Optimization | | JohnW-UK1 -
Joomla Home Page Title Tag Issue
I have got a site that requires to have a custom title tag for its home page (primarily). Its using Joomla 3.3.1. I am not using any SEO components as of now. I have checked the the global configuration, It has Polymer Resources as the site name. I am also attaching copy of the Menu Manager>Main menu> home I would like to see the Home Page browser Title to read: Custom Engineered Plastic Resin | Polymer Resources But my current settings does not let me change the home page title. Any help in this regard will be highly appreciated. Thank you in advance 7yfHVw0.png KzouLB7.png
On-Page Optimization | | ArthurRadtke0 -
Google is showing the "wrong" page in the serps for user queries
Our site, cpuboss.com has two main types of pages: comparisons of CPUs, and pages about individual CPUs. When I google search for "fx8350", a keyword for the cpu "AMD FX-8350", I hoped to see our CPU page ranking, instead I see a comparison of this CPU against another. http://i.imgur.com/QwNczDj.png?1 (Our page ranks #5) Any idea? Many of our comparisons rank for CPU keywords, when I think it'd be a better experience for the user if our cpu pages ranked instead. This particular CPU page is linked to on our homepage with appropriate anchor text, and linked to on that comparison also. I would have hoped the relevance of the cpu page to this keyword would be stronger than the comparison page, and google might use that relevance signal to show the user the right page. thoughts?
On-Page Optimization | | cdnventure0 -
Need help regarding On page issue for dating site?
I'm having problem with on page of dating website datetolove.com. If you go to the location link in the website you will see the profile of same persons are showcasing in Country,state & city which will lead to duplication.if i use canonical tag in the country page then I think google will crawl only country page & will leave state & city pages.But I need that google should crawl all the 3 pages without any duplication's.Please help me out with this problem please check the link below.There are many other problems also in this website. http://www.datetolove.com/en/locations
On-Page Optimization | | varun18000 -
How long does it take Google to index new title tags and meta descriptions?
Hi, I have launched a website ( www.bookkeepingking.com )and would like Google to reflect the latest title tag changes in its results. How long does it typically take to happen? I believe this might be one reason why the site may not be generating any search traffic yet, even though I haven't yet begun any link building yet. A couple of notes: When I enter site:bookkeepingking.com in the search box, the pages show up, but with the old/default title and meta descriptions. I am using the Yoast for SEO plugin I have resubmitted the XML map - Yoast created 2... /page-sitemap.xml and /post-sitemap.xml The changes were made about 1 week ago. WMT says that there are zero errors. Is there something I may have missed? Or do I just need to give it more time? Thanks in advance for your help. Erin
On-Page Optimization | | HiddenPeak0 -
What the - SERP?
I have my site I made 5 days ago with 5 pages of unique content at 500 words each, no backlinks, and non-optimized on page SEO. I just check my SERP ranking for a competition of 49-50% at I am sitting at the bottom of page 1? Will I keep this rank or what?
On-Page Optimization | | 6786486312640 -
301 redirects from several sub-pages to one sub-page
Hi! I have 14 sub-pages i deleted earlier today. But ofcourse Google can still find them, and gives everyone that gives them a go a 404 error. I have come to the understading that this wil hurt the rest of my site, at least as long as Google have them indexed. These sub-pages lies in 3 different folders, and i want to redirect them to a sub-page in a folder number 4. I have already an htaccess file, but i just simply cant get it to work! It is the same file as i use for redirecting trafic from mydomain.no to www.mydomain.no, and i have tried every kind of variation i can think of with the sub-pages. Has anyone perhaps had the same problem before, or for any other reason has the solution, and can help me with how to compose the htaccess file? 🙂 You have to excuse me if i'm using the wrong terms, missing something i should have seen under water while wearing a blindfold, or i am misspelling anything. I am neither very experienced with anything surrounding seo or anything else that has with internet to do, nor am i from an englishspeaking country. Hope someone here can light up my path 🙂 Thats at least something you can say in norwegian...
On-Page Optimization | | MarieA1