Crawl still in process for 3 days. Not sure why the site isn't being crawled
-
I added a new site to the crawl, but it seems to be stalled. It was supposed to crawl Feb 19, but it is still in process Feb 22. It tried to crawl the site and there was a robots.txt issue, but that issue was resolved way before the 19th. Not sure what is going on. this is for the clear lake campaign.
-
Thanks for the followup. We appreciate it.
-
Hey Eric! Dave from the Help Team here,
Sorry for the delay in getting you Site Crawl completed. We were experiencing a bit of a technical issue with some crawls so thanks for reaching out to us! We were able to get that campaign updated and you should see some fresh data! Let us know if you have any other questions!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Crawling error emails
Recently we start having random error messages about crawling issue:
Product Support | | DTashjian
2024-08-30 edweek:Ok
2024-08-29 marketbrief:Err. advertise: Err, edweek:Err, topschooljobs:Ok
2024-08-23 edweek:Ok
2024-08-22 marketbrief:Err. advertise: Err, edweek:Err
2024-08-21 topschooljobs:Ok, edweek:Ok
2024-08-15 marketbrief:Ok. advertise:OK
2024-08-13 edweek:Ok
2024-08-12 marketbrief:Ok
2024-08-08 marketbrief:Ok, advertise:Ok
2024-08-03 edweek:Ok, topschooljobs:Ok
All for 2024-07 - are Ok Yesterday I set 2 more crawls for the same sites (edweek and marketbrief) and I get a morning email about original edweek site is ok (still have some problem but crawl occurs and all is fine) but for test crawl for the same site "EW Test" I just got error email.
Also I suppressed ALL email communications and frankly surprised by this email. Can you please check what is wrong with a crawler or stat collection or I don't know who produced the issues.0 -
Keywords showed volume before but now they say 'no data available'
Keywords showed volume before but now they say 'no data available'. And this is happening with common words like "prints" - I'm dead certain this keyword should not have 'no data available'. What's going on? How do I reset or fix this? I only have 12 days left of my trial and I can't even use the feature I need.
Product Support | | Andresia1 -
Hi please help me process the refund. The money that was charge is for my mom's heart operation.
How do we process the refund for an account that has never been used. Please please help us.
Product Support | | Dugard-Property0 -
I have assigned a Moz Pro seat to someone but they can't access a campaign's rankings report?
Hi there, I'm the account admin on a Moz Pro account. I have assigned a seat to a freelancer who's doing some work for me and they say they can't access a campaign's rankings report? The manage user's section shows them as having a seat license? It's been issued and accepted by them? Any ideas here? Thanks
Product Support | | NineFiftyNine.net0 -
How to block Rogerbot From Crawling UTM URLs
I am trying to block roger from crawling some UTM urls we have created, but having no luck. My robots.txt file looks like: User-agent: rogerbot Disallow: /?utm_source* This does not seem to be working. Any ideas?
Product Support | | Firestarter-SEO0 -
Rogerbot not crawling our site
Has anyone else had issues with Roger crawling your site in the last few weeks? It shows only 2 pages crawled. I was able to crawl the site using Screaming Frog with no problem and we are not specifically blocking Roger via robots.txt or any other method. Has anyone encountered this issue? Any suggestions?
Product Support | | cckapow0 -
Link to Moz Pro home 404s, and then I stumbled upon Moz's staging site...
I'm wary of giving more information as it's probably best that little to no one be able to access Moz staging for one reason or another. I should also mention that this was done very unintentionally on my part. That said, from the 404 from Moz Pro home, I tried to access "My QA", and that's when I realized that everything I did thereafter was within staging.moz.com (and posted a question similar to this one). Does Moz permit access to their staging site, or did I stumble upon a mistake - or Moz-stake, if you will?
Product Support | | Lumina0 -
I'm not canceling my MOZ subscription, but just so I know: if I want to cancel my MOZ subscription, can I do this per month, or per year?
If I want to cancel after six months, do I have to pay for the rest of the year or can I cancel per month?
Product Support | | Sophie-Kool0