Google not displaying meta description
-
Hi,
one of my clients is receiving the following error in SERP - "A description of the page is not available because of this site's robots.txt".
The site is built on WordPress and I realized that by default, the settings were checked to blocks bots from crawling the site. So, I turned it off, fixed robots.txt and submitted the sitemap again. Since, then it's been almost 10 days, the problem still exists.
Can anyone tell me what should be done to fix it or if there's a way to get Google to recrawl the pages again.
-
Hi Mayank,
Use the fetch tool listed above to see what URL's are being blocked. If any, it maybe it is just taking Google some time to get things indexed for you.
-
I have fixed robots.txt, have submitted fresh sitemap to the webmaster. the problem still exists.
Also, when i look for webmaster >> Google Index >> Index Status >> Total indexed are 896 and Blocked by Robots are 626. The numbers have got better, but very slow. I don't think pages are blocked by Robots any more. Not sure what can be done about it.
-
Don is correct. In GWT you'll be able to fetch as Google and see the results of your changes. Another thing that can help crawl the page would be making sure the site has at least a few inbound links, but Don's answer should have you covered in the near term.
-
Hi Mayank,
After you fixed the Robots.txt you can ask Google to recrawl it. I recommend you do a fetch first to make sure it is crawlable.
Depending on the site, and frequency Google sets up its own recrawl rate but using the methods above you can be sure the problem is fixed.
Hope this helps,
Don
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why does Google display the home page rather than a page which is better optimised to answer the query?
I have a page which (I believe) is well optimised for a specific keyword (URL, title tag, meta description, H1, etc). yet Google chooses to display the home page instead of the page more suited to the search query. Why is Google doing this and what can I do to stop it?
Intermediate & Advanced SEO | | muzzmoz0 -
Google does not want to index my page
I have a site that is hundreds of page indexed on Google. But there is a page that I put in the footer section that Google seems does not like and are not indexing that page. I've tried submitting it to their index through google webmaster and it will appear on Google index but then after a few days it's gone again. Before that page had canonical meta to another page, but it is removed now.
Intermediate & Advanced SEO | | odihost0 -
Google ignoring Canonical and choosing its own
Hey Mozzers, We have several products that all have upto 6 different versions, they are the same product but in a different specification. As users search via these specifications (within our website) it is beneficial to keep all 6 products as different listings on the website. In google however it is not. So we kept all 6 listing but chose 1 to be the google landing page, the only different between them all is the technical specification + occasionally size. But 95% of the pages are the same. Let call the products A, B, C, D, E, F, we made all the canonicals point to C because this is out best selling version of the product. However, google has chosen E to rank instead. What is my best move here? Should i accept the page google has chosen and change the canonicals the point to that version or should I be stubborn and try to get google to change which version it ranks. As always many thanks.
Intermediate & Advanced SEO | | ATP0 -
Meta refresh bad for SEO
Hi there, Some external developers have created a wishlist for a website that allows visitors to add products to a wishlist and then send an enquiry. Very similar set-up to a shopping basket really (without the payment option). However, this wishlist lives in a separate iframe and refreshes every 30 seconds to reflect any items visitors add to their wishlist. This refreshing is done with a meta refresh. I'm aware of the obvious usability issue that the visitor's product only appears after 30 seconds in their wishlist. However, are there also any SEO issues due to the refreshing of the iframe every 30 seconds? Please let me know, whether small or large issues.
Intermediate & Advanced SEO | | Robbern0 -
Prevent Google from crawling Ajax
With Google figuring out how to make Ajax and JS more searchable/indexable, I am curious on thoughts or techniques to prevent this. Here's my Situation, we have a page that we do not ever want to be indexed/crawled or other. Currently we have the nofollow/noindex command, but due to technical changes for our site the method in which this information is being implemented if it is ever displayed it will not have the ability to block the content from search. It is also the decision of the business to not list the file in robots.txt due to the sensitivity of the content. Basically, this content doesn't exist unless something super important happens, and even if something super important happens, we do not want Google to know of its existence. Since the Dev team is planning on using Ajax/JS to pull in this content if the business turns it on, the concern is that it will be on the homepage and Google could index it. So the questions that I was asked; if Google can/does index, how long would that piece of content potentially appear in the SERPs? Can we block Google from caring about and indexing this section of content on the homepage? Sorry for the vagueness of this question, it's very sensitive in nature and I am trying to avoid too many specifics. I am able to discuss this in a more private way if necessary. Thanks!
Intermediate & Advanced SEO | | Shawn_Huber0 -
Weirdist Meta Description I've Seen in a SERP
For one e-commerce website, in place of the proper meta description, Google is showing a 318-character-long mix of snippets from the homepage content for the domain search (e.g. [example.com]). A brand search returns the correct meta description - as do the keywords the homepage ranks for. I know Google changes the meta description if it doesn't think it's relevant, but this one (there is only one) is and has (as far as we know) shown until now, and I've never seen such a mix of text in the SERP, and so many characters - it's picking up random text from bits of anchor text e.g. "privacy policy", title attributes from links, labels from radio buttons and more. The home page W3C validates apart from a couple of basic things like missing alt text. The only things that might be related that don't are some custom meta name tags added by the CMS - but I wouldn't think this would make any difference to whether a meta description is displayed properly or not? I've recommended we wait until tomorrow to see if Google fixes this on recrawl, but does anyone have any ideas if it doesn't? The homepage doesn't feature much standalone text, so I was thinking if we add a few extra words it might encourage Google to pick from that if it doesn't want to use the meta description. The text would have to be useful for users and fit in with the design of course, which could be awkward...
Intermediate & Advanced SEO | | Alex-Harford1 -
Google and JavaScript
Hey there! Recent announcements at Google to encourage webmasters to let Google crawl Java Script http://www.googlewebmastercentral.blogspot.com/2014/05/understanding-web-pages-better.html http://googlewebmastercentral.blogspot.com/2014/05/rendering-pages-with-fetch-as-google.html We have always put JS and CSS behind robots.txt, but now considering taking them out of robots. Any opinions on this?
Intermediate & Advanced SEO | | CleverPhD0 -
How to improve Google Places Account
Hello, A friend of mine has a google places account. Her website is http://debidonner.com/ You can see her places account listed under "life coach scottsdale arizona" I've attached a screenshot of her categories. I just added "NLP Coach" and "Personal Coach" today, so results are only for the other categories. We're looking for ways to improve it. We've had 43 clicks for driving directions. 4 map clicks, and 0 website clicks (how good is that, by the way) Thanks! screenshot-google-places.jpg screenshot-google-places2.jpg
Intermediate & Advanced SEO | | BobGW0