Does the SEOMoz weekly crawl that highlights no meta description tag, take into account if there is a meta robots noindex,follow tag on the pages it indicates the missing meta descriptions?
-
The weekly crawl website report is telling me that there are pages that have missing meta description tags, yet I've implemented meta robots tags to 'noindex, follow' those pages which are visible in those page source files. As far as Google Is concerned, surely this then won't be a problem since it is being instructed NOT to consider these specific pages for indexing. I am assuming that the weekly SEOmoz website crawl is simply throwing the missing meta description crawl findings into its report without itself observing that the particluar URL references contain the meta robots 'noindex,follow' tag ???? Appreciate if you can clairfy if this is the case.
It would help me understand that (at least in terms of my efforts towards Google) your own crawl doesn't observe the meta robots tag instruction, hence the resultant report's flagging the discrepancy.
-
Hey Cyrus!
Nice to bump into you in Q&A
I have to say I actually agree with Adam's view specifically in ensuring that pages have nice relevant page Titles that speak to the user. Even though I may not want a page indexed by a search engine, if users can see it then I should use everything at my disposal to offer good information & encourage conversion. Identifying pages with missing or duplicate information is part of this.
The "ignore" feature will just give me the best of both worlds!
Sha
-
Unfortunately this is one of those issues where there is no "one-sized-fits-all" solution. You are absolutely correct that the search engines most likely don't give a hoot about missing meta description on noindexed pages.
That said, there are a small number of SEOs like Adam Audette that go as far as recommending unique titles and meta data for certain no-indexed pages in order to add relevance. Go figure.
As Sha mentioned, SEOmoz is working on a feature that would allow you to ignore these specific notices. We realize they can be an inconvience in cases like these.
Regardless, thanks for the heads up. Best of luck with your SEO.
-
Hi callassist,
You are correct in assuming that the SEOmoz crawler does not distinguish pages that are noindexed.
There is a simple explanation of the reason for this in a response to this thread by Daniel Deceuster.
As you will see there, a feature request is already in play for a feature to allow users to "turn off" the pages they wish to ignore in their reports (and this would be an example of where that will be very useful). If you follow the link in the previous thread, you will be able to keep updated on progress with the feature request.
Hope that helps,
Sha
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Reddit website, what do link provide to users? I'm little confused about do-follow and no-follow.
I share an example with you. Please check and tell me. Why MOZ tool saying this link is do-follow link. But actually the link is no-follow. Here is the link- https://www.reddit.com/r/Bloggers/comments/8i46q4/top_service_industries_who_should_opt_for/ OlCxIyS
Moz Pro | | sourav60 -
Robots.txt
I have a page used for a reference that lists 150 links to blog articles. I use in in a training area of my website. I now get warnings from moz that it has too many links. I decided to disallow this page in robots.text. Below is the what appears in the file. Robots.txt file for http://www.boxtheorygold.com User-agent: * Disallow: /blog-links/ My understanding is that this simply has google bypass the page and not crawl it. However, in Webmaster Tools, I used the Fetch tool to check out a couple of my blog articles. One returned an expected result. The other returned a result of "access denied" due to robots.text. Both blog article links are listed on the /blog/links/ reference page. Question: Why does google refuse to crawl the one article (using the Fetch tool) when it is not referenced at all in the robots.text file. Why is access denied? Should I have used a noindex on this page instead of robots.txt? I am fearful that robots.text may be blocking many of my blog articles. Please advise. Thanks,
Moz Pro | | Rong
Ron0 -
My Campaign only crawled 3 pages on my site
On my first crawl of a new campaign, the software only crawled 3 pages. XXXaceXXXscholarships.org any ideas?
Moz Pro | | Santaur0 -
Why is SEOmoz link tagged with a (nofollow) for my site? I have tried to write a youmoz post a couple of times. But, I am just not an expert, that is why I am on SEOmoz.
Why is SEOmoz link tagged with a (nofollow) for my site? I have tried to write a youmoz post a couple of times. But, I am just not an expert, that is why I am on SEOmoz. Is there something I can do to get juice from my SEOmoz account? (nofollow) Scott McNelley, President: Admiral Movers, Admi... www.seomoz.org/users/profile/423056
Moz Pro | | Smcnelley0 -
SeoMoz and incorrect results?
Just recieved my weekly Rankings and On Page report. First thing i noticed is that an important keyword dropped big time. "Rejser til Cypern" dropped from #3 to #40 ... So i checked google.dk myself (using impersonal.me) and saw i was still #3 in SERP. I ran SeoMoz's own Keyword Difficulty Report-tool. It showed me i was #3 in SERP. Now im thinking: Did i just loose my trust in Seomoz, to whom i give access to all my GA-data? What to do? Have anyone else experienced this?
Moz Pro | | alsvik0 -
I have a Rel Canonical "notice" in my Crawl Diagnostics report. I'm presuming that means that the spider has detected a rel canonical tag and it is working as opposed to warning about an issue, is this correct?
I know this seems like a really dumb question but the site I'm working on is a BigCommerce one and I've been concerned about canonicalisation issues prior to receiving this report (I'm a SEOmoz pro newbie also!) and I just want to be clear I am reading this notice correctly. I presume this means that the site crawl has detected the rel canonical tag on these pages and it is working correctly. Is this correct?? Any input is much appreciated. Thanks
Moz Pro | | seanpearse0 -
Open Site Explorer Issue - Pullng up No-follow links when settings ask for Follow + 301 Redirect..
Anybody else having this issue? Here lately when I am doing competitive research on open site explorer I set it to only pull up followed + 301 redirects and it will still pull up no-follow competitors links. Can anybody help me out here?
Moz Pro | | axzm0 -
Do crawl reports see canonical tags?
Greetings, I just redesigned my site, www.funderstanding.com, and have the old site pointing to the new site via canonical URLs. I had a new crawl test run and it showed a large amount of duplicate content. Does the SEO Moz crawl tool validate canonical urls and adjusts the duplicate content count or is this note considered? FYI, I sent from no duplicate content to having 865 errors since the redesign went up so that seems suspicious. I would think though that assuming the canonical tag were used properly, and I hope it is?, that this would not be a problem?? All help with this is most appreciated. Eric
Moz Pro | | Ericc220