Crawl Test - Taking too long
-
The last crawl test I invoked seems to be in progress for over 24 hours. The one before that completed in a few hours. Wish there was a progress indicator or an option to cancel.
The crawl (from Tool > Crawl Test) should not take this long. Any ideas or suggestions?
Also, the keyword research tool (plus a few others) have been down ever since I signed up. Is this a normal?
-
Sorry for the long wait, I had to tell Roger that he was a bad boy/girl/thing? We have resolve the crawler issues and your reports should be updating and reporting as it should. I am very sorry that Roger caused some concerns, it said it won't do it next time.
Thank you very much for your patience
-
Thanks Peter for the response. Keyword tool start to work but Crawl Test is still pending, it has been over 3 days. I need it to be stopped/cancelled it so I can re-run it. Not being able to crawl and check the changes that were made on the site brings me to a stopping point.
Looking through some of the other Q/A, one of the suggestions was to stop the crawl was to stop it via robots.txt, which didn't worked. I don't think it is even doing anything but stuck in the "in progress" state.
-Mo
-
Hey MomoMasta,
Thanks for reaching out to us! I'm sorry for the inordinate amount of time that it took for the crawl to complete (which it should be at the moment). I will have made a note on the issue so our team can take a look at it. I like that feature request (to cancel), you should definitely suggest it in features request forum at :https://seomoz.zendesk.com/forums/293194-seomoz-pro-feature-requests.
I am very sorry for the keyword feature being down due to the recent Google search result change. Our company has learned a lot from this last outage and will have contingency plans in next time Google releases another update. I want to thank you for your patience and hope you will continue being our friend/customer http://screencast.com/t/XaxBDAakziS
~Peter
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Campaign Crawl
I have a site with 8036 pages in my sitemap index. But the MozBot only Crawled 2169 pages. It's been several months and each week it crawls roughly the same number of pages. Any idea why I'm not getting fully crawled?
Moz Pro | | JMFieldMarketing0 -
Crawl Diagnostics 403 on home page...
In the crawl diagnostics it says oursite.com/ has a 403. doesn't say what's causing it but mentions no robots.txt. There is a robots.txt and I see no problems. How can I find out more information about this error?
Moz Pro | | martJ0 -
Not all pages are being crawled
I am set up on the PRO plan, I was under the impression that it would crawl up to 10,000 pages. My site has just over 200 pages, but whenever I am crawled it only crawls 121 pages. Is this normal? It's hard to know how reliable my data is because a significant amount of pages are missing.
Moz Pro | | KristinHarding0 -
SEOMOZ Crawling Our Site
Hi there, We get a report from SEOMOZ every week which shows our performance within search. I noticed for our website www.unifor.com.au that it looks through over 10,000 pages, however our website sells less than 500 products so not sure why or how so many pages are trawled? If someone could let me know that would be great. It uses up a lot of bandwidth doing each of these searches so if the amount of pages being trawled reduced it would definitely assist. Thanks, Geoff
Moz Pro | | BeerCartel750 -
SEOmoz Dashboard Report: Crawl Diagnostic Summary
Hi there, I'm noticing that the total errors for our website has been going up and down drastically almost every other week. 4 weeks ago there were over 10,000 errors. 2 weeks ago there were barely 1,000 errors. Today I'm noticing it's back to over 12,000 errors. It says the majority of the errors are from duplicate page content & page title. We haven't made any changes to the titles or the content. Some insight and explanation for this would be much appreciated. Thanks, Gemma
Moz Pro | | RBA1 -
Crawl test tool from SEOmoz - which URLs does it actually crawl?
I am using for the first time the crawl test tool from SEOmoz and I do not really understand which URLs the tool is going to crawl. First, it says "enter any subdomain" --> why can´t I do the crawl for the root domain? Second it says "we'll crawl up to 3,000 linked-to pages" --> does that mean that the tool crawls all internal links that it can find on the given domain? Thanks for your help!
Moz Pro | | Elke.GetApp0 -
How long do old links stay in Open SIte Explorer stats?
Hi, In Open Site Explorer has around 2000 External followed links which would be great if it was true. I think the issue is that before my site wasn't appending slashes to the url so I think it was counting links from http://mydomain/page1 to http://mydomain/page2/ as an external link (could be wrong here). I corrected this a couple of months ago but I still seem to have over 2000 External links. When I look at the linking pages many of them are "sans slash" and have old anchor text in the link. How long does it take of OSE to update these stale links it there any way I can prompt it to take aciton?
Moz Pro | | moesian0 -
SEOmoz crawl error questions
I just got my first seomoz crawl report and was shocked at all the errors it generated. I looked into it and saw 7200 crawl errors. Most of them are duplicate page titles and duplicate page content. I clicked into the report and found that 97% of the errors were going off of one page It has ttp://legendzelda.net/forums/index.php/members/page__sort_key__joined__sort_order__asc__max_results__20 http://legendzelda.net/forums/index.php/members/page__sort_key__joined__sort_order__asc__max_results__20__quickjump__A__name_box__begins__name__A__quickjump__E etc Has 20 pages of slight variations of this link. It is all my members list or a search of my members list so it is not really duplicate content or anything. How can I get these errors to go away and make search my site is not taking a hit? The forum software I use is IPB.
Moz Pro | | NoahGlaser780