Description tag not showing in the SERPs because page is blocked by Robots, but the page isn't blocked. Any help?
-
While checking some SERP results for a few pages of a site this morning I noticed that some pages were returning this message instead of a description tag,
A description for this result is not avaliable because of this site's robot.s.txt
The odd thing is the page isn't blocked in the Robots.txt. The page is using Yoast SEO Plugin to populate meta data though.
Anyone else had this happen and have a fix?
-
I am having the same issue currently with one of my clients sites. No robots.txt is or was ever in place. I can not find any issues at all that would cause the problem. Was wondering if you every had any resolution to this? Client also uses Yoast.
-
Hi there! Has this issue been resolved? We'd love to have an update, thanks! (Christy)
-
Could the pages have been blocked in robotos.txt in the past? It can take an age for Google to re-index pages a proper after having been blocked previously.
-
Certainly doesn't appear to be any issues there. It's difficult to determine the issue without taking a look closer but its not the robots.txt file and if your site is fully indexed then I can't offer more without seeing the site.
Would you be willing to share the URL?
-
No, it's not on. The site is indexed, just certain description tags aren't.
-
It's pretty standard
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/ -
I've seen people with similar issues before and it's been a small but fatal error in the robots.txt file itself. Can you please share it here and I'll advise further if needed.
-
Can you check something for me please?
Log in to wp-admin
Go to Setting then Privacy
Check if “Ask search engines not to index this site.” is set to ON
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Do non-canonical pages need to worry about things like Alt Text, H1 tags, etc?
Just wanted to confirm, if we have multiple similar pages, with all of their canonicals pointing towards the prime page, does it impact SEO rankings at all if the non-canonical pages were missing alt text from their images, or shared duplicate or multiple H1 tags? Basic SEO page construction stuff? I know some will hurt user CTR but wanted to make sure that SEO crawlers don't care about them even if indexed.
On-Page Optimization | | SimonZM2 -
Wrong page ranking on SERP, above more relevant page
Often I will see the wrong page, something less relevant to a particular search, appear higher on the SERP than a more relevant page. Why does this happen and how can it be remedied? I found this Moz article, has anything been written on this topic more recently. Thanks! https://moz.com/blog/wrong-page-ranking-in-the-results-6-common-causes-5-solutions
On-Page Optimization | | NicheSocial0 -
Should Title Tags Differ From H1's?
I never thought this was an issue, but now, I'm not so sure. Is it a problem for your title tags to be identical to your H1's? From Moz' OnPage Grader section on "H1's and Title Tags," I thought they were supposed to both match your keyword. Any thoughts? Thanks, Ruben
On-Page Optimization | | KempRugeLawGroup0 -
Subdomain SERPS are different from the root domain SERPS
I am fairly new to SEO so bare with me. I created two campaigns within Moz, one tracking the sudomain www.mysite.com and another tracking just the root domain mysite.com. When I look at the keyword rankings I get different results from Google, Bing and Yahoo. For instance, the root domain shows rankings in Bing and Yahoo, but "Not in top 50" for Google. For my subdomain, it is reversed. I see rankings for Google, but "not in top 50' for Bing and Yahoo. What can I do to solve this issue? I am using canonical tags, but it is a domain redirect issue? Thanks in advance
On-Page Optimization | | BouldersInn0 -
Same Meta Description on all pages harmful?
As the question title suggests, is it harmful (on Google) for a site to use the same meta description sitewide? On every single page. If not, is there any particular benefit to crafting a unique meta description for every page besides CTR on google searches. What do you think? Thanks in advance!
On-Page Optimization | | danielpett0 -
Stumped on why Google is not showing main site pages anymore
Recently had sites homepage listing taken off first page for brand name search even though search term is not competitive. Does anyone have any ideas?
On-Page Optimization | | Luia0 -
What's the impact of # in the main domain page?
After a little research I did in the Source Code of the root domain page of seomoz.org and searchenginejournal.com , I found that the first one contains no at all and that the other contains like 10 . I though that the was something relatively important on a web page for on page optimisation. Did I missed something? What's you opinion on the subject? Thanks for your help!
On-Page Optimization | | Louis-Philippe_Dea0 -
Canonical tag for home page
This question was asked before but I didn't see a clear answer to it. If I've got a site that has as it's home page: http://www.mysite.com/, and there are many references within the site back to the home page that point to /index.php, should I include a canonical tag in the index.php page like this: to avoid a duplicate content issue, and to have all juice from both links combined into one?
On-Page Optimization | | wcksmith0
