Description tag not showing in the SERPs because page is blocked by Robots, but the page isn't blocked. Any help?
-
While checking some SERP results for a few pages of a site this morning I noticed that some pages were returning this message instead of a description tag,
A description for this result is not avaliable because of this site's robot.s.txt
The odd thing is the page isn't blocked in the Robots.txt. The page is using Yoast SEO Plugin to populate meta data though.
Anyone else had this happen and have a fix?
-
I am having the same issue currently with one of my clients sites. No robots.txt is or was ever in place. I can not find any issues at all that would cause the problem. Was wondering if you every had any resolution to this? Client also uses Yoast.
-
Hi there! Has this issue been resolved? We'd love to have an update, thanks! (Christy)
-
Could the pages have been blocked in robotos.txt in the past? It can take an age for Google to re-index pages a proper after having been blocked previously.
-
Certainly doesn't appear to be any issues there. It's difficult to determine the issue without taking a look closer but its not the robots.txt file and if your site is fully indexed then I can't offer more without seeing the site.
Would you be willing to share the URL?
-
No, it's not on. The site is indexed, just certain description tags aren't.
-
It's pretty standard
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/
-
I've seen people with similar issues before and it's been a small but fatal error in the robots.txt file itself. Can you please share it here and I'll advise further if needed.
-
Can you check something for me please?
Log in to wp-admin
Go to Setting then Privacy
Check if “Ask search engines not to index this site.” is set to ON
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
With the release of so many domains from .expert through to even .xyz why don't we see many around the top of SERPS?
And should I use one of these to create a nice looking site, invest time, energy, resource, money or will I simply regret it later and stick to the main TLDs? First question on Moz (yey)
On-Page Optimization | | LGG1230 -
Timeline on Moz's About Page
There has been a lot of talk about improving “About” pages on websites as of late. Moz actually has a really interesting About page, which includes a timeline. Are there any recommended WordPress plugins that can achieve a similar timeline effect?
On-Page Optimization | | VicMarcusNWI0 -
Listing all services on one page vs separate pages per service
My company offers several generalized categories with more specific services underneath each category. Currently the way it's structured is if you click "Voice" you get a full description of each voice service we offer. I have a feeling this is shooting us in the foot. Would it be better to have a general overview of the services we offer on the "Voice" page that then links to the specified service? The blurb about the service on the overview page would be unique, not taken from the actual specific service's page.
On-Page Optimization | | AMATechTel0 -
Can't figure why ranking dropped after SEO improved.
I took a website that never had any keyword research performed, meta data filled in or anything strategic regarding getting ranked on the search engines. We rebuilt the website from an old Dreamweaver install using Wordpress, did keyword research, optimized one page per keyword term, filled in all the appropriate meta data and alt tags. The site has dropped in rankings and I've been working for the past 3 months to attempt to raise it up. Can you see what I am doing wrong? (This is the client site: http://www.atozqualityfencing.com).
On-Page Optimization | | JanetJ0 -
The company brand name does not show in SERP
Our company is ranking no.1 for brand keyword, however, when you try to find it by two words(with space between) then all those shows up and the website is nowhere to find. Any suggestions on how to solve this without the need to be ranked for something related
On-Page Optimization | | GardenPet0 -
How do you optimize for keyword phrases that don't follow natural speech patters?
For instance, We have a phase "solar panels for home" that sends decent traffic to our site, but I'm sure we could be capturing more if any of our content was optimized better for it. But how do you optimize for a phrase that makes you sound like a robot if you use it verbatim?
On-Page Optimization | | wreevesc0 -
Should I noindex both category and tag archive pages if I have an excerpt format?
I am creating a blog and want to know if I should noindex archives for categories and tags. I changed the format of my blog to excerpts to prevent duplicate content, but I want to make sure I also need to noindex those pages. Please help!
On-Page Optimization | | lwilkins1 -
Page title in SERP question
Has anyone typed in a phrase in Google and seen their listing on the SERP, but the page title on the Google SERP is not what the CMS is set to ? Ie the page title in the SERP is not what is expected? Something related to the company, but not what is set on the CMS… Very odd – has anyone seen something like this before? What could be causing it? Is there a way to change it?
On-Page Optimization | | inhouseninja0