Crawl Test taking 10+ days and still "In Progress" - normal or glitch?
-
I started a crawl test for my large site - WallStreetOasis.com - on June 20 and still have not received my results. It still says "Crawl in Progress" 10 days later. Does this seem odd or problematic, or is this normal?
-
Your best bet is to email help@seomoz.org and they'll take a look and see what's up. So sorry about the troubles!
-
I had had this happen several times. It's not normal. Contact support - they are very helpful. For my situation, they had to have a developer/engineer step in to get things back on track.
-
Thanks for your prompt reply, Patrick. Very much appreciated.
I was logged into my Wall Street Oasis campaign, and went to Research Tools > SEO Web Crawler > entered www.wallstreetoasis.com and now I've go the "Crawl In Progress" icons above both the one I submitted on 7/20 and the one from 7/30.
-
Patrick-
Problematic and not normal. Is this set up as a campaign or did you use the research analysis crawl test? If you have done one and not the other, then do the other also and see if there is a change.
We have several sites in the 10,000+ page content and it doesnt take but a couple of days.
Good luck. Hope this helps.
Mark
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
If I have set up my www as a cname, do I still need to add a redirect?
Hello, I am trying to minimize my redirect chains that have been popping up in my Moz crawl issues. So I'd like to get clear on some best practices. I have a few clients that are getting their first redesign in a while. We are moving into Wordpress from good ole .html files. So I've installed a redirection plug in to create 301 redirects for those .html versions of the pages. But apparently I am already redirecting from www to non-www. I have the www set up as a CNAME going to the IP address - is that counting as the redirection? Sometimes though, the www is set up by making it an A record. Is one way better than the other? Finally, I'm forcing https for all my new sites now. Is whatever the host does to "force" https also counting as a redirect and contributing to my chain? Any advice will be appreciated!
Moz Pro | | Dandelion0 -
Possible Crawling Problem with Screaming Frog and Moz Crawlers
So I'm not sure if what I'm seeing is a problem or not. As of about two weeks ago the Moz crawler has only been able to see www.mysite.com, and none of the links, content, title, ect associated with the page. Essentially the report has one line, what should be the homepage, but it's not able to pull any information from the page but does show a 200 http status code. The report shows nothing blocked by robots or any errors. When I use screaming frog to crawl the site about 75% of the time it just reports one line www.mysite.com with a 200 status code, but again the crawler is not able to actually see the html. The other 25% of the time it works perfectly fine, crawls all pages and sees all meta info and content. There are no errors in Google WMT and everything looks ok there. We have seen a traffic drop the last two weeks but I don't know if this is the reason for it. I can't publicly post the page but if someone has an idea of what might be going on I'd be happy to PM them. Thanks
Moz Pro | | CJ50 -
Duplicate content in crawl despite canonical
Hi! I've had a bunch of duplicate content issues come up in a crawl, but a lot of them seem to have canonical tags implemented correctly. For example: http://www.alwayshobbies.com/brands/aztec-imports/-catg=Fireplaces http://www.alwayshobbies.com/brands/aztec-imports/-catg=Nursery http://www.alwayshobbies.com/brands/aztec-imports/-catg=Turntables http://www.alwayshobbies.com/brands/aztec-imports/-catg=Turntables?page=0 Aztec http://www.alwayshobbies.com/brands/aztec-imports/-catg=Turntables?page=1 Any ideas on what's happening here?
Moz Pro | | neooptic0 -
Seomoz crawl: 4XX (Client Error) How to find were the error are?
I got eight 404 errors with the Seomoz crawl, but the report does not says where the 404 page is linked from (like it does for dup content), or I'm I missing something? Thanks
Moz Pro | | PaddyDisplays0 -
Seo moz has only crawled 2 pages of my site. Ive been notified of a 403 error and need an answer as to why my pages are not being crawled?
SEO Moz has only crawled 2 pages of my clients site. I have noticed the following. A 403 error message screaming frog also cannot crawl the site but IIS can. Due to the lack of crawling ability, im getting no feed back on my on page optimization rankings or crawl diagnostics summary, so my competitive analysis and optimization is suffering Anybody have any idea as to what needs to be done to rectify this issue as access to the coding or cms platform is out of my hands. Thank you
Moz Pro | | nitro-digital0 -
Question #3) My last question has to do with Some SEOmoz crawl diagnostics -
I recently fixed (or well, I am asking to make sure that this was the right thing to do in my first question posted a few minutes ago), a problem where all of my internal main sidebar category pages were linking using https://, which to my knowledge means SECURE pages. anyways, OSE, and google seem to be not recognizing the link juice. but my rank fell for one of my main keywords by 2 positions about a week after i made the fix to have the pages be indexable. Making my pages properly linked can't be a bad thing right? That's what I said. So I looked deeper, and my crawl diagnostics reports showed a MASSIVE reduction in warnings (about 3,000 301 redirects were removed by changing the https:// to http:// because all the secure pages were re-directing to http:// regular structure) and an INCREASE, in Duplicate Page Titles, and Temporary redirects... Could that have been the reason the rank dropped? I think I am going to fix all the Duplicate Page Title problems tonight, but still, I am a little confused as to why such a major fix didn't help and appeared to hurt me. I feel like it hurt the rank, not because of what I did, but because what I did caused a few extra re-directs, and opened the doors for the search engine to discover more pages that had problems (which could have triggered an algo that says hey, these people have to much duplicate problems) Any thoughts will be GREATLY appreciated thumbed, thanked, and marked as best answers! Thanks in advance for your time, Tyler A.
Moz Pro | | TylerAbernethy0 -
I've tried everything, and my blog still falling
Hello everyone! 🙂 I'm almost desperate, and trying to find a solution to one of my blogs. Below is it URL: http://www.xboxplus.net/ It has more than 3 years, and even so I get just around 700-1000 visitors a day. I have already applied several SEO techniques, tried several SEO plugins, tried to work with keywords, etc, but nothing changes. I see several other sites and blogs of the same niche (games), with much less content (I have more than 3800 articles, in 3 years), practicing plagiarism, stealing content, etc, and with much more visitors and revenue. I have never done nothing wrong. Never stole content. I always worked honestly, and always tried to write articles with "something more". I really don't know what happens with XboxPlus.net . And, how can, for example, Seomoz helps me, here? I would be very grateful for any help. 😄
Moz Pro | | Andarilho0 -
Seo moz crawl is not updating
When I check our seo campaign I can see that the report was not updated. It still show that the next crawl is Nov 1 but it is already Nov 3.
Moz Pro | | shebinhassan0