Meta Noindex report: exclude urls and delete all warnings in once
-
Dear community,
I have a question about "Site Crawl" > "Crawler Warnings" > "Meta Noindex" reports. I see 3.6K errors with all the same url base: /register?url={{xxxxxxxx}}
The page have the following robots meta tag: 1. Can i exclude some urls from crawling by moz-spider bot? If yes, how?
2. Can i use the 'mark as fixed' or 'ignore' functionality for all urls in once? Now, i have to execute the action 36 times to 'ignore' all 3600 errors.Hope, someone can help me
-
Hi,
1. You can exclude the Moz crawler (Rogerbot) from various pages: https://moz.com/help/moz-procedures/crawlers/rogerbot
You need to use your robots.txt file, rather than trying to do it on page2. Once you've done the above, you can request a recrawl and they should all disappear
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Are Monthly-Run custom reports supposed to compare against the previous month?
When I run monthly reports, it looks like keywords are down, when they are actually up compared to the previous month. Is there a way to get the monthly reports to show how many positions up or down a keyword is compared to the prior run report?
Feature Requests | | bizmarquee0 -
CSV Report Export
Hello, Is there any way that I can generate & export a CSV report - 7/ & or days activity for tracked keywords compared to competitors? I can't do this through the Custom Reports dashboard, is there an alternative? API Maybe?
Feature Requests | | jasongmcmahon0 -
Will MOZ be updating there tools with regards to the new Meta Description length?
Now that Google has increased the number of characters allowed for meta descriptions/snippets when will MOZ be updating the tools to cater for the new lengths? I'm sure a lot of my Meta descriptions that are being flagged as too long with disappear once updated. Cheers Lee B
Feature Requests | | lbagley1 -
Will the Pro tool be updated to reflect the new meta description length?
Hi, I'm wondering if and when the tool will be updated for the above purpose - I'm currently testing it out with a view to purchase a subscription and have onboarded a couple of clients, but the reports are coming back with meta description length errors, but as I'm sure you know the "legal" length of these was recently increased to I believe 320 characters. Any insight here would be awesome - thanks so much!
Feature Requests | | pubcrawler0132 -
Is there a way to take notes on a crawled URL?
I'm trying to figure out the best way to keep track of there different things I've done to work on a page (for example, adding a longer description, or changing h2 wording, or adding a canonical URL. Is there a way to take notes for crawled URLs? If not what do you use to accomplish this?
Feature Requests | | TouchdownTech0 -
Is there a way to turn off Meta Noindex warnings?
My site is Wordpress, and indexing tags, categories, dates, etc. just ends up causing potential duplicate page content, and so using the advised SEO Yoast plug in suggestion, we have set those type listings to noindex. However now MOZ flags me with 1.7k+ noindex warnings. I know it is not hurting anything, but is there anyway to disable that warning to clean up my crawl error report?
Feature Requests | | OBIAnalytics1 -
Is there a way to add custom dashboards into Moz's "Custom Reporting"?
I have dashboards set up in Google Analytics that track conversions and year over year traffic data and just wanted to see if their was a way to add those extra metrics Moz's Custom Report? Any help or suggestions would be much appreciated!
Feature Requests | | Gruenagency0 -
Can Moz Reports Data be exported in Excel
Hi there, The moz reports are exported into PDF at the moment. Is there a way to export the data into excel? Thanks
Feature Requests | | Jacky.Bizcover0