Crawl still in process for 3 days. Not sure why the site isn't being crawled
-
I added a new site to the crawl, but it seems to be stalled. It was supposed to crawl Feb 19, but it is still in process Feb 22. It tried to crawl the site and there was a robots.txt issue, but that issue was resolved way before the 19th. Not sure what is going on. this is for the clear lake campaign.
-
Thanks for the followup. We appreciate it.
-
Hey Eric! Dave from the Help Team here,
Sorry for the delay in getting you Site Crawl completed. We were experiencing a bit of a technical issue with some crawls so thanks for reaching out to us! We were able to get that campaign updated and you should see some fresh data! Let us know if you have any other questions!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Crawling issue
Hello,
Product Support | | Benjamien
I have added the campaign IJsfabriek Strombeek (ijsfabriekstrombeek.be) to my account. After the website had been crawled, it showed only 2 crawled pages, but this site has over 500 pages. It is divided into four versions: a Dutch, French, English and German version. I thought that could be the issue because I only filled in the root domain ijsfabriekstrombeek.be , so I created another campaign with the name ijsfabriekstrombeek with the url ijsfabriekstrombeek.be/nl . When MOZ crawled this one, I got the following remark:
**Moz was unable to crawl your site on Feb 21, 2018. **Your page redirects or links to a page that is outside of the scope of your campaign settings. Your campaign is limited to pages with ijsfabriekstrombeek.be/nl in the URL path, which prevents us from crawling through the redirect or the links on your page. To enable a full crawl of your site, you may need to create a new campaign with a broader scope, adjust your redirects, or add links to other pages that include ijsfabriekstrombeek.be/nl. Typically errors like this should be investigated and fixed by the site webmaster. I have checked the robots.txt and that is fine. There are also no robots meta tags in the code, so what can be the problem? I really need to see an overview of all the pages on the website, so I can use MOZ for the reason that I prescribed, being SEO improvement. Please come back to me soon. Is there a possibility that I can see someone sort out this issue through 'Join me'? Thanks0 -
My site crawl has been in progress since last week
Hi there, I've been waiting on my site crawl to complete since Friday (it's Tuesday now), but it still has the 'in progress' notification at the top. Is it normal for it to take over 3 days? Or is there something holding it up?
Product Support | | VAPartners0 -
I was charged $1 when I was on a 30 day free trial or right after. Why is this? I don't understand what I got charged for when I was under the impression that I was using a free trial.
I'm really concerned about this. I had canceled the free trial early. It didn't pass a month. I have no idea why I was charged.
Product Support | | rpgsummoner0 -
Moz has stopped crawling my site
Hello, We have been using Moz Pro for over a year on our site and in the last month noticed that our site is not being crawled anymore. I took a look in Google Search Console, and everything seems to be fine there, so I think it is just the Moz tool that is not working. Has anyone else experienced this? Are there any tips for troubleshooting it? Thank you, Adam
Product Support | | cwells0 -
Being forced to reconnect to GA every day
Every day I log into MOZ in the morning, and a message appears at the top (in red) saying that there's a problem with 1 or more of my campaigns regarding Google Analytics. Whichever campaign I open first has this same message, meaning that this is effecting that particular campaign. I click on the link provided in the message and am brought to a screen asking if MOZ can be connected to GA "offline", whatever that means. I click OK every time, and yet this problem persists. Moreover, it happens to whichever campaign I click first. I've done this to each campaign at least once, and to one 3 different days. Clearly the issue isn't connectivity to GA, but I'm worried I won't be getting data because of this error. If anyone knows how to resolve this or can provide some insight, please help. Thank you!
Product Support | | Lumina0 -
My data is stuck and hasn't updated from a few weeks back
My campaign settings are for 500 pages to be crawled which I understand means it will be done once per week. However my data is stuck from a few weeks back and still hasn't been updated. Can you help?
Product Support | | Vivid-North0