Crawl Errors and Notices drop to zero
-
Hi all,
After setting up a campaign in Moz the crawl is successful and it showed the Errors and Warnings in crawl diagnostics (each one had about 40-50), but after a few days the number dropped to zero. Only the "notices" seems to stay normal, with a slight drop since the campaign set up, but not dropping to zero. I set this campaign up in a colleague's account and the same thing happened shortly after set up. I didn't find any Q&A already posted so any insight is appreciated!
-
Glad I could help!
-
Thank you for looking into this. Really appreciate it!
-
Hey Vanessa,
Every URL that is in the report you forwarded is on the blog, so it definitely looks like the noindex tag on the blog is the reason for the drop in crawl errors and warnings. If you prefer that we begin crawling the blog again, you can have that tag removed, but the tag also means that the search engines aren't indexing those pages or finding those errors any longer either.
Let me know if you have any other questions.
Chiaryn
-
Thanks for looking into this, Chiaryn. That is the correct campaign. I have a report from April 17 and I sent it to help@seomoz.org. If you can shed any light on this that would be a big help. I appreciate it!
-
Hey Vanessa,
Thanks for writing in.
I looked into your account and I think you are referring to the Sparky campaign. Unfortunately, I can only see the most recent crawl data, so I don't have a way to compare the crawls from prior to April 24th to see why the number of errors and warnings would have dropped off around that time.
I do see that we picked up a noindex, nofollow tag on the blog pages on April 16th, so it may be that we were crawling other pages on the blog that had errors and warnings before the tag was added. But once the noindex, nofollow tags were added, we weren't able to crawl those pages and report back on the errors.
If you can think of any other changes that may have taken place around April or if you have an old report that shows some of the URLs that were reported as having errors, I can look into this further for you. If you prefer not to include the error report on this public forum, you can always email it to help@seomoz.org and include my name in the subject line.
I hope this helps.
Chiaryn
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Rogerbot did not crawl my site ! What might be the problem?
When I saw the new crawl for my site I wondered why there are no errors, no warning and 0 notices anymore. Then I saw that only 1 page was crawled. There are no Error Messages or webmasters Tools also did not report anything about crawling problems. What might be the problem? thanks for any tips!
Moz Pro | | inlinear
Holger rogerbot-did-not-crawl.PNG0 -
Drop in domain authority for myself and all my competitors, was something changed?
On the 1/11 report all four websites dropped, and starting on 2/12 they all dropped a few more times. These are all large companies who are completely white hat. Was something changed? The reason I asked is all of our linking C-Blocks dropped as well. Mine dropped from 114 to 42 and I have no idea why. All of my competitors dropped as well, is this related?
Moz Pro | | EcommerceSite1 -
Crawl frequency
What is the frequency of crawl. My crawl diagnostics shows data from over a month ago
Moz Pro | | deBreezeInteractive0 -
SEomoz slow to crawl?
Hello - I am just trying out the trial and it said the next crawl was nov 1st but I see no change in any of the errors since the initial crawl... so just waiting to find out if what I changed was fixed or not. Is this normal ?
Moz Pro | | Bethany_BabyBrowns0 -
How long does a crawl take?
A crawl of my site started on the 8th July & is still going on - is there something wrong???
Moz Pro | | Brian_Worger1 -
Unsubscribe to weekly crawl notifications never works
Hello! All of my campaigns have the box 'Weekly crawl completed for campaign ...' unticked under Campaign Settings, yet for all of them I still receive an email regularly with the subject 'New crawl completed for ...'. How do I stop this? Is there a bug here? Adam Bishop
Moz Pro | | arbishop0 -
Crawl Diagnostics bringing 20k+ errors as duplicate content due to session ids
Signed up to the trial version of Seomoz today just to check it out as I have decided I'm going to do my own SEO rather than outsource it (been let down a few times!). So far I like the look of things and have a feeling I am going to learn a lot and get results. However I have just stumbled on something. After Seomoz dones it's crawl diagnostics run on the site (www.deviltronics.com) it is showing 20,000+ plus errors. From what I can see almost 99% of this is being picked up as erros for duplicate content due to session id's, so i am not sure what to do! I have done a "site:www.deviltronics.com" on google and this certainly doesn't pick up the session id's/duplicate content. So could this just be an issue with the Seomoz bot. If so how can I get Seomoz to ignore these on the crawl? Can I get my developer to add some code somewhere. Help will be much appreciated. Asif
Moz Pro | | blagger0