Crawl Test taking 10+ days and still "In Progress" - normal or glitch?
-
I started a crawl test for my large site - WallStreetOasis.com - on June 20 and still have not received my results. It still says "Crawl in Progress" 10 days later. Does this seem odd or problematic, or is this normal?
-
Your best bet is to email help@seomoz.org and they'll take a look and see what's up. So sorry about the troubles!
-
I had had this happen several times. It's not normal. Contact support - they are very helpful. For my situation, they had to have a developer/engineer step in to get things back on track.
-
Thanks for your prompt reply, Patrick. Very much appreciated.
I was logged into my Wall Street Oasis campaign, and went to Research Tools > SEO Web Crawler > entered www.wallstreetoasis.com and now I've go the "Crawl In Progress" icons above both the one I submitted on 7/20 and the one from 7/30.
-
Patrick-
Problematic and not normal. Is this set up as a campaign or did you use the research analysis crawl test? If you have done one and not the other, then do the other also and see if there is a change.
We have several sites in the 10,000+ page content and it doesnt take but a couple of days.
Good luck. Hope this helps.
Mark
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate title on Crawl
Ok, this should hopefully be a simple one. Not sure if this is a Moz crawl issue of redirect issue. Moz is reporting duplicate title for www.site.co.uk , site.co.uk and www.site.co.uk/home.aspx is this a canonical change or a moz setting I need to get this number lower.
Moz Pro | | smartcow0 -
1 week has passed: Crawled pages still N/A
Roughly one week ago I went pro, and then I created a campaing for the smallish webshop that I'm employed at, however it doesn't seem to crawl. I've check our visitors log and while we find other bots such as google, bing, yandex and so fourth, seomoz bot hasn't been visible. Perhaps I'm looking for a normal useragent, ohwell, onwards. While I thought it might take time, as a small test I added a domain that I've owned for sometime but don't really use, that target site is only 17 pages, now this site was crawled almost within the hour, and I realised that our ~5000pages on the main campaing would take some time, but wouldn't the initial 250 pages be crawled by now? I should add, that I didn't add http:// to the original Campaing, but the one that got crawled I did. I cannot seem to change this myself inorder to spot if that's the problem or not. Anyone has any ideas, should I just wait or is there something I can activly do to force it to start rolling?
Moz Pro | | Hultin0 -
I've tried everything, and my blog still falling
Hello everyone! 🙂 I'm almost desperate, and trying to find a solution to one of my blogs. Below is it URL: http://www.xboxplus.net/ It has more than 3 years, and even so I get just around 700-1000 visitors a day. I have already applied several SEO techniques, tried several SEO plugins, tried to work with keywords, etc, but nothing changes. I see several other sites and blogs of the same niche (games), with much less content (I have more than 3800 articles, in 3 years), practicing plagiarism, stealing content, etc, and with much more visitors and revenue. I have never done nothing wrong. Never stole content. I always worked honestly, and always tried to write articles with "something more". I really don't know what happens with XboxPlus.net . And, how can, for example, Seomoz helps me, here? I would be very grateful for any help. 😄
Moz Pro | | Andarilho0 -
Crawl reports urls with duplicate content but its not the case
Hi guys!
Moz Pro | | MakMour
Some hours ago I received my crawl report. I noticed several records with urls with duplicate content so I went to open those urls one by one.
Not one of those urls were really with duplicate content but I have a concern because website is about product showcase and many articles are just images with href behind them. Many of those articles are using the same images so maybe thats why the seomoz crawler duplicate content flag is raised. I wonder if Google has problem with that too. See for yourself how it looks like: http://by.vg/NJ97y
http://by.vg/BQypE Those two url's are flagged as duplicates...please mind the language(Greek) and try to focus on the urls and content. ps: my example is simplified just for the purpose of my question. <colgroup><col width="3436"></colgroup>
| URLs with Duplicate Page Content (up to 5) |0 -
Wild fluctuation in number of pages crawled
I am seeing huge fluctuations in the number of pages discovered the crawl each week. Some weeks the crawl discovers > 10,000 pages and other weeks I am seeing 4-500. So, this week for example I was hoping to see some changes reflected for warnings from last weeks report (which discovered > 10,000 pages). However, the entire crawl this week was 448 pages. The number of pages discovered each week seems to go back and forth between these two extremes. The more accurate count would be nearer the 10,000 mark than the 400 range. Thanks. Mark
Moz Pro | | MarkWill0 -
A suggestion to help with linkscape crawling and data processing
Since you guys are understandably struggling with crawling and processing the sheer number of URLs and links, I came up with this idea: In a similar way to how SETI@Home (is that still a thing? Google says yes: http://setiathome.ssl.berkeley.edu/) works, could SEOmoz use distributed computing amongst SEO moz users to help with the data processing? Would people be happy to offer up their idle processor time and (optionally) internet connections to get more accurate, broader data? Are there enough users of the data to make distributed computing worthwhile? Perhaps those who crunched the most data each month could receive moz points or a free month of Pro. I have submitted this as a suggestion here:
Moz Pro | | seanmccauley
http://seomoz.zendesk.com/entries/20458998-crowd-source-linkscape-data-processing-and-crawling-in-a-similar-way-to-seti-home1 -
"Special pricing" on SEO DVDs?
The section for buying your dvd training lists the price for everyone at $119 and the special price for pro members at - $119. Then the text says that the special price will be shown when the item is added to the cart where the special price is - $119. Am I missing something here?
Moz Pro | | IanTheScot1 -
4xx (not found) errors seem spurious, caused by a "\" added to the URL
Hi SEOmoz folks We're getting a lot of 404 (not found) errors in our weekly crawl. However the weird thing is that the URLs in question all have the same issue. They are all a valid URL with a backsalsh ("") added. In URL encoding, this is an extra %5C at the end of the URL. Even weirder, we do not have any such URLs in our (Wordpress-based) website. Any insight on how to get rid of this issue? Thanks
Moz Pro | | GPN0