Meta Noindex report: exclude urls and delete all warnings in once
-
Dear community,
I have a question about "Site Crawl" > "Crawler Warnings" > "Meta Noindex" reports. I see 3.6K errors with all the same url base: /register?url={{xxxxxxxx}}
The page have the following robots meta tag: 1. Can i exclude some urls from crawling by moz-spider bot? If yes, how?
2. Can i use the 'mark as fixed' or 'ignore' functionality for all urls in once? Now, i have to execute the action 36 times to 'ignore' all 3600 errors.Hope, someone can help me
-
Hi,
1. You can exclude the Moz crawler (Rogerbot) from various pages: https://moz.com/help/moz-procedures/crawlers/rogerbot
You need to use your robots.txt file, rather than trying to do it on page2. Once you've done the above, you can request a recrawl and they should all disappear
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Errors for URLS being too long and archive data is duplicate
I have hundreds of errors for the same three things. The URL is too long. Currently the categories are domain.com/product-category/name main product/accessory product/
Feature Requests | | PacificErgo
-Do I eliminate somehow the product category? Not sure how to fix this. 2) It has all of my category pages listed as archives showing duplicates. I don't know why, as they are not blog posts, they hold products on them. I don't have an archived version of this. How do I fix this? 3. It is saying my page speed is slow. I am very careful to optimize all my photos in PhotoShop. Plus I have a tool on the site to further compress. I just went with another host company that is supposed to be faster. Any ideas/ I would so appreciate your help and guidance. All my best to everyone, be safe and healthy.0 -
Are Monthly-Run custom reports supposed to compare against the previous month?
When I run monthly reports, it looks like keywords are down, when they are actually up compared to the previous month. Is there a way to get the monthly reports to show how many positions up or down a keyword is compared to the prior run report?
Feature Requests | | bizmarquee0 -
Will MOZ be updating there tools with regards to the new Meta Description length?
Now that Google has increased the number of characters allowed for meta descriptions/snippets when will MOZ be updating the tools to cater for the new lengths? I'm sure a lot of my Meta descriptions that are being flagged as too long with disappear once updated. Cheers Lee B
Feature Requests | | lbagley1 -
One of my Moz Campaigns was accidentally deleted. Any tips on getting it back?
I had a campaign setup with all of my keywords meticulously labeled and branded. Then by mistake, it was deleted. Is there any way I can restore/get the data back for an accidentally deleted campaign?
Feature Requests | | midcenturybliss0 -
Discrepancy in "np" within in my Moz Report?
| Keyword |
Feature Requests | | jessential
| np - /google-structured-data-update/ | In my "New Rankings & Insights | Hill Web Creations" report, while "Google structured data update" moved up significantly, at the same time, "np - /google-structured-data-update/" moved down significantly. Any insights that would offer a deeper understanding of the discrepancy and how to pull both up? If this corresponds with Google Analytics, the "np" Acquisitions > Campaigns > Organic Keywords > "Organic Search Traffic" Report, how is Moz rendering is New Rankings & Insights?0 -
Can You Add Avg. Monthly Searches to Custom Reports
Hi, I recently had a client ask me to add avg. monthly searches to the keyword tracking portion of their monthly report, so they can see the 'value' of the keyword terms we are tracking. Is there a way to add this column to the keyword tracking portion of the custom reports? I'm crossing my fingers that this is possible. Thanks for reading!
Feature Requests | | maxcarnage0 -
Is there a way to schedule automatic weekly .csv reports for the Tracked Keywords Overview?
Using The Custom Reports tool, I only managed to get PDF reports. It would be useful to automatically receive .csv reports by email. Any idea how?
Feature Requests | | Digital-Sun0 -
Page break in custom report
Hi community 🙂 I would like to add page break in custom report. This would allow me to segment section in the PDF document. Also, is there any ways to add some titles with notes ? Just as the same style as the description field ? Thanks for your answers, Cheers 🙂
Feature Requests | | apsylone1