Google not displaying meta description

[mayanksaxena]

Hi,

one of my clients is receiving the following error in SERP - "A description of the page is not available because of this site's robots.txt".

The site is built on WordPress and I realized that by default, the settings were checked to blocks bots from crawling the site. So, I turned it off, fixed robots.txt and submitted the sitemap again. Since, then it's been almost 10 days, the problem still exists.

Can anyone tell me what should be done to fix it or if there's a way to get Google to recrawl the pages again.

[donford]

Hi Mayank,

Use the fetch tool listed above to see what URL's are being blocked. If any, it maybe it is just taking Google some time to get things indexed for you.

[mayanksaxena]

I have fixed robots.txt, have submitted fresh sitemap to the webmaster. the problem still exists.

Also, when i look for webmaster >> Google Index >> Index Status >> Total indexed are 896 and Blocked by Robots are 626. The numbers have got better, but very slow. I don't think pages are blocked by Robots any more. Not sure what can be done about it.

[RyanPurkey]

Don is correct. In GWT you'll be able to fetch as Google and see the results of your changes. Another thing that can help crawl the page would be making sure the site has at least a few inbound links, but Don's answer should have you covered in the near term.

[donford]

Hi Mayank,

After you fixed the Robots.txt you can ask Google to recrawl it. I recommend you do a fetch first to make sure it is crawlable.

Depending on  the site, and frequency Google sets up its own recrawl rate but using the methods above you can be sure the problem is fixed.

Hope this helps,

Don