Description tag not showing in the SERPs because page is blocked by Robots, but the page isn't blocked. Any help?
-
While checking some SERP results for a few pages of a site this morning I noticed that some pages were returning this message instead of a description tag,
A description for this result is not avaliable because of this site's robot.s.txt
The odd thing is the page isn't blocked in the Robots.txt. The page is using Yoast SEO Plugin to populate meta data though.
Anyone else had this happen and have a fix?
-
I am having the same issue currently with one of my clients sites. No robots.txt is or was ever in place. I can not find any issues at all that would cause the problem. Was wondering if you every had any resolution to this? Client also uses Yoast.
-
Hi there! Has this issue been resolved? We'd love to have an update, thanks! (Christy)
-
Could the pages have been blocked in robotos.txt in the past? It can take an age for Google to re-index pages a proper after having been blocked previously.
-
Certainly doesn't appear to be any issues there. It's difficult to determine the issue without taking a look closer but its not the robots.txt file and if your site is fully indexed then I can't offer more without seeing the site.
Would you be willing to share the URL?
-
No, it's not on. The site is indexed, just certain description tags aren't.
-
It's pretty standard
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/ -
I've seen people with similar issues before and it's been a small but fatal error in the robots.txt file itself. Can you please share it here and I'll advise further if needed.
-
Can you check something for me please?
Log in to wp-admin
Go to Setting then Privacy
Check if “Ask search engines not to index this site.” is set to ON
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Need help on declining page rank
Hi Guys,
On-Page Optimization | | Slideuplift123
We had a consistent page ranking for a specific keyword between 5 and 8 positions on google. This week all of a sudden the page which was ranking for that keyword no longer ranks for it and another page has started ranking for that keyword that too at 20th position. I am so confused why has this happened? I didn't do any changes to that page or to the now ranking page. Can anyone help why could this be happening?0 -
Do non-canonical pages need to worry about things like Alt Text, H1 tags, etc?
Just wanted to confirm, if we have multiple similar pages, with all of their canonicals pointing towards the prime page, does it impact SEO rankings at all if the non-canonical pages were missing alt text from their images, or shared duplicate or multiple H1 tags? Basic SEO page construction stuff? I know some will hurt user CTR but wanted to make sure that SEO crawlers don't care about them even if indexed.
On-Page Optimization | | SimonZM2 -
'Results pages'
Hey there, I have a website that my client is update it every day with some 'results' for example - see attached image.
On-Page Optimization | | JohnPalmer
What is the best way to avoid 7 duplicate content pages every day? MgYlqFW.png0 -
Why doesn't MailChimp use an SSL certificate on their homepage?
MailChimp, one of the biggest brands in online marketing doesn't use an SSL certificate on their homepage...Is there a simple reason for this? Wouldn't they get an SEO boost from having one?
On-Page Optimization | | WickVideo1 -
Single Page on my client's website is not crawling and indexing new changes. What could be the possible reason?
I made several changes on client's website on different pages, changed titles, add content on few pages, moved blog from subdomain to sub directory. Everything is crawled but there is one page on the website (not part of the blog) that isn't getting crawled in Google and picking up changes. The last crawl of the website is 2 days back whereas that page was last crawled on 30th sep. I just wanted to know the possible reasons and has anyone encountered this before?
On-Page Optimization | | MoosaHemani0 -
Static or Dynamic Home Page? Please Help!
Hi again 🙂 I ask for ur input again my friends I finally decided to go for the shorter .COM domain, and I put my domain online. Since it will be an online games site, every post will be in fact a new game. And of course, every game, will be in fact a post. I put my home page as "latest posts" this way, all my posts are shown in home page, and posts being for me games, all my games appear on my home page. So my home page always has the latest games and is always fresh. The theme I use has the option to ad some "static content" at the end of the posts, on home page, for SEO. I my home page I have also about 300 words of "article" content, that never changes, and is for seo, since my post content, is in fact java script, and other html codes ( flash games). So my home pages is that article plus excerpts of latest post. But the problem is, that I cannot control the seo, on page this way, and I cannot control my keywords very well, or the density of them, since the home page isnt a page. Now the question is, to let my Home page as it is, or change it and set it up as a page. I can put games on pages to, that is not a big problem. What is best, for the future of the site, google ranking, and seo, in ur opinion. I ad that I recived "A" Grade on moz for Page Seo Grade! Thank You!
On-Page Optimization | | Catinas970 -
Contact pages coming up for keywords above landing pages
I have two examples of contact pages coming up over designated landing pages Keyword: Nickel Alloys for www.neonickel.com Keyword: Artificial Grass for www.artificialgrass4u.co.uk Is there anyway I can stop this happening?
On-Page Optimization | | icansee0 -
Wordpress categories tags and robots.txt
I am relatively new at this and see a variety of people that seem to disagree on if you should block google from indexing category and tag pages through robot.txt or no-follow because of google viewing it as duplicate content. I tryst this communities answers over the web at large obviosly, so what do you all think? Thanks, Steven
On-Page Optimization | | sfmatthews0