Unsolved Site Crawl Stalled and Can't Restart
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Site Crawler not working but on-demand crawler working
Hi, In Moz pro, when using Site crawler (or recrawl), we are seeing message site is banned. But when using on-demand crawler, it could generate report successfully. I just like to know if in both these cases, it is roberbot that is used! And kindly note, site crawler was perfectly working before. So the required setup is already in place from long time. Site crawler ban issue started appearing from nov/dec 2023. . Could you please us understand how could we possibly make site-crawler work?
Moz Pro | | gilesd
I am happy to provide more details if you need any. Thanks0 -
Unsolved Moz Crawl seems to be stuck?
Hi all, It seems like moz has been stuck on crawling our site for a while now - I had a message of 'you will get a notification for when your site crawl is complete' for about 2 weeks now, and it doesn't seem to finish it? Any ideas why this happens and how to fix it? Thank you in advance.
Moz Tools | | StevenWalley0 -
Subsite Navigation Changes Global Navigation
I have a client that is a national brand with 400+ local brick and mortar businesses. Like any site, you navigate to “find a location” and then click on the business location closest to you. I’m going to call these local businesses “subsites”. When you’re on the subsite, the global navigation goes away, and the new subsite navigation replaces it. The subsite navigation does not link back up to the main global navigation (except for the homepage when you click on logo).
Technical SEO | | RiseSEO
I’ll try to give you a simple visual: Structure of global navigation:
-Domain.com/service1 (high volume KW)
-Domain.com/service2(high volume KW)
-Domain.com/service3(high volume KW)
Once you go to the subsite of Dallas, TX, the navigation changes to:
-domain.com/location/tx/dallas/service1 (same service as above but localized)
-domain.com/location/tx/dallas/service2 (same service as above but localized)
-domain.com/location/tx/dallas/service3 (same service as above but localized) I told my client that because the subsite does not link back up to the national pages of the site, the page rank does not get to recirculate through the website. Once the page rank is passed down to the subsites, it just recirculates within the subsite like it is its own little website on a website.
I believe this is causing a lot of problems with the ranking of the national pages because there are 400+ subsites (with 15 service pages = ~6,000 pages) that don’t let the pagerank flow back up to the main global navigation, recirculating the PR throughout the website.
It is a big ask for the client to change their website navigation without proof that this is happening. So that is what I’m looking for. Has anyone had this problem before or can point me to something to show to my client that we need to keep that global navigation on the subsites?0 -
Unsolved How do I cancel this crawl?
The latest crawl on my site was the 4th Jan with a current crawl 'in progress'. How do i cancel this crawl and start a new one? I've been getting keyword ranking etc but no new issues are coming through. Screenshot 2022-05-31 083642.jpg
Moz Tools | | ClaireU0 -
Unsolved Bug in site crawl analysis - 308 redirect flagged as temporary
Hi, we have some 308 redirects on our website, which are permanent redirects, but the site crawler is flagging them as temporary currently. Screenshot 2022-02-10 14.24.26.png
Moz Pro | | pm-mbc0 -
Crawl Diagnostics: Next crawl date is in the past
Hi - I have quite a few crawl diagnostic errors and warnings. I have attempted to fix many of them but noticed this note at the bottom of the crawl diagnostics chart: "Last Crawl Completed: Mar. 22nd, 2013 Next Crawl Starts: Mar. 29th, 2013" It looks like SEOMoz thinks the next crawl date is Mar 29th, 2013, which is two weeks ago. Is there any way to "force" the crawl and get it back on regular schedule? This may have happened when my account was disabled because my credit card expired...Thoughts?
Moz Pro | | 6thirty0 -
Why does it keep displaying br tags and claiming 404 errors on like 4 of my URL's for all my Wordpress sites?
Is anyone else having the same issue? These errors don't actually exist and i think it has something to do with wordpress - how can i fix this?
Moz Pro | | MillerPR0 -
SEOmoz crawl error questions
I just got my first seomoz crawl report and was shocked at all the errors it generated. I looked into it and saw 7200 crawl errors. Most of them are duplicate page titles and duplicate page content. I clicked into the report and found that 97% of the errors were going off of one page It has ttp://legendzelda.net/forums/index.php/members/page__sort_key__joined__sort_order__asc__max_results__20 http://legendzelda.net/forums/index.php/members/page__sort_key__joined__sort_order__asc__max_results__20__quickjump__A__name_box__begins__name__A__quickjump__E etc Has 20 pages of slight variations of this link. It is all my members list or a search of my members list so it is not really duplicate content or anything. How can I get these errors to go away and make search my site is not taking a hit? The forum software I use is IPB.
Moz Pro | | NoahGlaser780