Meta Noindex report: exclude urls and delete all warnings in once
-
Dear community,
I have a question about "Site Crawl" > "Crawler Warnings" > "Meta Noindex" reports. I see 3.6K errors with all the same url base: /register?url={{xxxxxxxx}}
The page have the following robots meta tag: 1. Can i exclude some urls from crawling by moz-spider bot? If yes, how?
2. Can i use the 'mark as fixed' or 'ignore' functionality for all urls in once? Now, i have to execute the action 36 times to 'ignore' all 3600 errors.Hope, someone can help me
-
Hi,
1. You can exclude the Moz crawler (Rogerbot) from various pages: https://moz.com/help/moz-procedures/crawlers/rogerbot
You need to use your robots.txt file, rather than trying to do it on page2. Once you've done the above, you can request a recrawl and they should all disappear
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Localized pages with hreflang markup being reported by Moz as duplicate content
We have 5 websites, each targeted at a different geography. They are all in English, but targeted per country (e.g. US, Canada, UK, Australia). And we've properly implemented hreflang tags on each page, with the US site being the x-default, and with each country-specific page having a self-referencing hreflang tag as well as individual hreflang tags pointing to the other country-specific versions. All seems to be working properly with the search engines. But, each week in our Moz Pro campaigns, Moz reports the pages as "duplicate content". It seems that Moz does not regard the hreflang tags when deciding if content is duplicate or not. I'm not 100% sure that's what's causing Moz to report them as duplicate, but it's my best guess. To date, I've been marking these as "ignore". But, that creates two problems. First, we have new pages all the time, and so this gets to be laborious. Second, it makes it somewhat likely we might miss a real duplicate content issue. Can someone confirm whether Moz should be looking at hreflang tags before considering pages as dupliacte? And possibly offer any suggestions to us if Moz doesn't do that?
Feature Requests | | seoelevated0 -
Errors for URLS being too long and archive data is duplicate
I have hundreds of errors for the same three things. The URL is too long. Currently the categories are domain.com/product-category/name main product/accessory product/
Feature Requests | | PacificErgo
-Do I eliminate somehow the product category? Not sure how to fix this. 2) It has all of my category pages listed as archives showing duplicates. I don't know why, as they are not blog posts, they hold products on them. I don't have an archived version of this. How do I fix this? 3. It is saying my page speed is slow. I am very careful to optimize all my photos in PhotoShop. Plus I have a tool on the site to further compress. I just went with another host company that is supposed to be faster. Any ideas/ I would so appreciate your help and guidance. All my best to everyone, be safe and healthy.0 -
In custom reports, Can we get a module for finished tasks?
Hello, I like the automatic scheduled report feature. I was wondering if I could send clients a small list of tasks completed on the 'insights' page of campaigns? Every week I usually do tasks from the 'insights' section of the campaign, then I click finish when I've completed that tasks. I would like to be able to show that to clients monthly. Is this possible?
Feature Requests | | Extima-Christian1 -
Will the Pro tool be updated to reflect the new meta description length?
Hi, I'm wondering if and when the tool will be updated for the above purpose - I'm currently testing it out with a view to purchase a subscription and have onboarded a couple of clients, but the reports are coming back with meta description length errors, but as I'm sure you know the "legal" length of these was recently increased to I believe 320 characters. Any insight here would be awesome - thanks so much!
Feature Requests | | pubcrawler0132 -
Is there a way to take notes on a crawled URL?
I'm trying to figure out the best way to keep track of there different things I've done to work on a page (for example, adding a longer description, or changing h2 wording, or adding a canonical URL. Is there a way to take notes for crawled URLs? If not what do you use to accomplish this?
Feature Requests | | TouchdownTech0 -
Is there a way to turn off Meta Noindex warnings?
My site is Wordpress, and indexing tags, categories, dates, etc. just ends up causing potential duplicate page content, and so using the advised SEO Yoast plug in suggestion, we have set those type listings to noindex. However now MOZ flags me with 1.7k+ noindex warnings. I know it is not hurting anything, but is there anyway to disable that warning to clean up my crawl error report?
Feature Requests | | OBIAnalytics1 -
Is there a way to schedule automatic weekly .csv reports for the Tracked Keywords Overview?
Using The Custom Reports tool, I only managed to get PDF reports. It would be useful to automatically receive .csv reports by email. Any idea how?
Feature Requests | | Digital-Sun0 -
Page break in custom report
Hi community 🙂 I would like to add page break in custom report. This would allow me to segment section in the PDF document. Also, is there any ways to add some titles with notes ? Just as the same style as the description field ? Thanks for your answers, Cheers 🙂
Feature Requests | | apsylone1