Description tag not showing in the SERPs because page is blocked by Robots, but the page isn't blocked. Any help?
-
While checking some SERP results for a few pages of a site this morning I noticed that some pages were returning this message instead of a description tag,
A description for this result is not avaliable because of this site's robot.s.txt
The odd thing is the page isn't blocked in the Robots.txt. The page is using Yoast SEO Plugin to populate meta data though.
Anyone else had this happen and have a fix?
-
I am having the same issue currently with one of my clients sites. No robots.txt is or was ever in place. I can not find any issues at all that would cause the problem. Was wondering if you every had any resolution to this? Client also uses Yoast.
-
Hi there! Has this issue been resolved? We'd love to have an update, thanks! (Christy)
-
Could the pages have been blocked in robotos.txt in the past? It can take an age for Google to re-index pages a proper after having been blocked previously.
-
Certainly doesn't appear to be any issues there. It's difficult to determine the issue without taking a look closer but its not the robots.txt file and if your site is fully indexed then I can't offer more without seeing the site.
Would you be willing to share the URL?
-
No, it's not on. The site is indexed, just certain description tags aren't.
-
It's pretty standard
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/ -
I've seen people with similar issues before and it's been a small but fatal error in the robots.txt file itself. Can you please share it here and I'll advise further if needed.
-
Can you check something for me please?
Log in to wp-admin
Go to Setting then Privacy
Check if “Ask search engines not to index this site.” is set to ON
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Need help with Meta tags generator
Hello, I am doing SEO for my business website. I am trying to generate Meta Tags here
On-Page Optimization | | webdropyyc
https://webdrop.ca/seo-tools/meta-tag-generator What should I enter for "Search engines should revisit this page after ". We are not going to change content on daily basis. 7 Days or 30 days are good enough?0 -
Is it better to try and boost an old page that ranks on page #5 or create a better new page
Hello Everyone, We have been looking into our placements recently and see that one of our blog posts shows on page #5 for a popular keyword phrase with a lot of search volume. Lets say the keyword is "couples fitness ideas" We show on page 5 for a post /couples-fitness-ideas-19-tips-and-expert-advice/ We want to try and get on the first page for that phrase and wanted to know if it is better if we did one of the following: 1. Create a new page with over 100 ideas with a few more thousands of words. with a new url (thinking /couples-fitness-ideas) 2. Create a new page with a new url (thinking /couples-fitness-ideas) with the same content as the currently ranking post. We would want to do this for more freedom with layout and design of the page rather than our current blog post template. Add more content, let's say 100 more ideas. Then forward the old URL to the new one with a 301 redirect. 3. Add more content to the existing post without changing the layout and change the URL. Look forward to your thoughts
On-Page Optimization | | MobileCause0 -
Each page with a different meta description?
each page on my website represents a different department, can I program the header to show a different meta description on each page or should there only be 1 meta description tag per domain?
On-Page Optimization | | RonnieT0 -
Keywords on Title Tag and Meta Description?
I have question regarding the use of keywords on title tag and meta description. I will take my website as example... Title Tag: Web Design Company & Digital Marketing Agency in Jakarta Meta Description: Coriate is a full-service website design & Internet marketing firm in Indonesia. We offer the best web solutions and SEO service in the industry. My questions: Is it good? Because I followed Blue Fountain Media. They don't use same keyword on title tag and meta description. You can see on title tag I use "web design" while on meta description I use "website design". Or should I use "web design" on meta description too? Blue Fountain Media doesn't use their company name on title tag. But when I search "Blue Fountain Media" on Google, it only showed their company name. How? Their title tag was "Website Design Company & Digital Marketing Agency in NYC | BFM". Is it necessary to use H1? Because as you can see on my company website Coriate there's no H1.
On-Page Optimization | | Japracool0 -
Duplicate Page Titles in Crawl Errors (although Google is rewriting in serps ??)
Hi Im working on a client/project and crawl report is showing thousands of dupe page titles In the case of the blog/news section its aprox 50 since aprox 50 posts and they all have the same meta-title: "Brand News | Brand" as opposed to: "Title Unique to Page/Topic/KW Relating to Content | Brand" Since these are the main content pages we want to rank (in addition to the main site category pages) then i have instructed dev must prioritise populating these pages meta-titles with the actual post/article titles, as per the latter version of the above example. (I should mention that i have requested they fix all dupe titles but main content pages are the priority). Whilst this will reduce the number of dupe titles in crawl error/warning report which is a good thing, is it actually likely to increase the ranking of these news/content pages given that Google does seem to be rewriting the titles correctly in the serps based on the page content ? Many Thanks in advance for your input
On-Page Optimization | | Dan-Lawrence0 -
I've just manually edited all the page titles and meta descriptions on a site, when will this show in Google results?
I've just manually edited all of the page titles, meta descriptions and optimised the copy on a client's site. I submitted this for a new crawl on Google via Webmaster Tools but when I do a Google search the old versions are still showing. Will it still take a few weeks for the new versions to show even though Google has crawled it via Webmaster?
On-Page Optimization | | aoifep0 -
Duplicate Page Content on Empty Manufacturer Pages
I work for an internet retailer that specializes in pet supplies and medications. I was going through the Crawl Diagnostics for our website, and I saw in the Duplicate Page Content section that some of our manufacturer pages were getting flagged. The way our site is set up is that when products are discontinued we mark them as discontinued and use 301 redirects to redirect their URLs to other relevant products, brands, or our homepage. We do the same thing with brand and manufacturer pages if all of their products are discontinued. 90% of the time, this is a manual process. However, the other 10% of the time certain products come and go automatically as part of our inventory system with one of our fulfillment partners. This can sometimes create empty manufacturer pages. I can't redirect these empty pages because there's a chance that products will be brought back in stock and the page will be populated again. What can we do so that these pages won't get marked as duplicates while they're empty? Write unique short descriptions about the companies? Would the placement of these short descriptions matter--top of the page under the category name vs bottom of the page underneath where the products would go? The links in the left sidebar, top, and in the footer our part of our site architecture, so those are always going to be the same. To contrast, here's what a manufacturer page with products looks like: Thanks! http://www.vetdepot.com/littermaid-manufacturer.html
On-Page Optimization | | ElDude0 -
Title tag for category page
I'd like to know your views on the best approach for title tags for category pages for ecommerce sites. 3 examples A) Category name | Free delivery on $50 purchase | Brand name B) Discover best "category name" on brand name C) Category Name | 1st Keyword, 2nd keyword | Brand name Thanks!
On-Page Optimization | | walidalsaqqaf0