Question about when new crawls start
-
Hi everyone,
I'm currently using the trial of seomoz and I absolutely love what I'm seeing. However, I have 2 different websites (one has over 10,000 pages and one has about 40 pages). I've noticed that the smaller website is crawled every few days. However, the larger site hasn't been crawled in a few days. Although both campaigns state that the sites won't be crawled until next Monday, is there any way to get the crawl to start sooner on the large site?
The reason that I've asked is that I've implemented some changes that will likely decrease the amount of pages that are crawled simply based upon the recommendations on this site. So, I'm excited to see the potential changes.
Thanks,
Brian
-
Hi Brian,
Did your site get crawled again and is everything good now?
Keri [SEOmoz associate]
-
There is no way to force a crawl, that I am aware of. I actually have 4 SEOmoz accounts that I use for various clients for crawls and their websites. Never seen a way to force a crawl, simply because there are tons of sites in the queue and they can only crawl so many sites so fast.
I'd just try to be patient and see the results on Monday or Tuesday! Good luck.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
If links have been disavowed, do they still show in crawl reports?
I have a new client who says they have disavowed all their bad links, but I still see a bunch of spammy backlinks in my external links report. I understand that disavow does not mean links are actually removed so will they continue to show in Google Webmaster Tools and in my Moz reports? If so, how do I know which ones have been disavowed and which have not? Regards, Dino
Moz Pro | | Dino640 -
Stupid question: why SEOMOz has become MOZ?
According to their On-Page Report Card the URL should include the main keyword i.e. SEO in their case, so why do they get an F grade If I check their main page www.moz.com for the keyword SEO? Thanks for your comments!
Moz Pro | | mcany0 -
Crawl Diagnostics - unexpected results
I received my first Crawl Diagnostics report last night on my dynamic ecommerce site. It showed errors on generated URLs which simply are not produced anywhere when running on my live site. Only when running on my local development server. It appears that the Crawler doesn't think that it's running on the live site. For example http://www.nordichouse.co.uk/candlestick-centrepiece-p-1140.html will go to a Product Not Found page, and therefore Duplicate Content errors are produced. Running http://www.nhlocal.co.uk/candlestick-centrepiece-p-1140.html produces the correct product page and not a Product Not Found page Any thoughts?
Moz Pro | | nordichouse0 -
SEO-Experts help answer my newbie questions!
Hello! Thanks for coming to my rescue; I really appreciate it. I am a newbie at SEO and I still haven't got the full picture of everything in my mind that covers linkbuiling, on page optimization, domain names, website creating, etc. I've really pretty much all the available guides on WarriorForum and BHW without much help on the topics above since most of the information was either provided by some person who didn't know what they were talking about, the information was outdated, or I didn't know what they meant. I have so many questions that I hope some SEO-Expert could answer my newbie questions so that I won't get penalized for my two sites that I currently own. One of them was slapped by Yahoo!, Bing, AOL, and most other search engines with the exception of Google (It's only a matter of time of course). The other site I own is in the making currently without much on-page optimization. Before I start doing some on-page depletion t to my two sites so they both get de-indexed and such because of keyword stuffing, fail link building, and other factors, I wanted to cover the problems I currently have about SEO and this site. 1) Using the SEO-MOZ 'keyword analysis tool', what is the ideal percentage difficulty a newbie like me could take easily with just a few links here and there including 5 posts/pages of great content? (I usually only write 5 posts that cover 500+ words each). 2) Do I need hosting to become successful or to get more on-page optimization for my websites? I currently use Go-Daddy forwarding with masking so that when my site shows up in google the content comes from blogger. 3) What is "Self Cannibalization"? I ALWAYS get that error for both my sites when I use the 'on page optimzation tool' from SEO-MOZ. 4) Using Blogger, What exactly are labels and does using this add any SEO value to my website? 5) I've read so many damn articles about ALT text and Title text for blogger; nothing explained what I put in it though. What am I supposed to put in it that will help me with my on page optimization? (Stuff like do I use spaces or dashes, do I put my keyword in there, how many characters should I not exceed, do I put one word or two words?) 6) On my website, I 'accidentally' didn't know that copy and pasting images from paint straight to blogger would be a bad idea because in the html I saw it was f'ed up because there was literally random characters everywhere for the file name. Since my site is a tutorial site, I have over 50+ images in all my posts combined that I've copied and pasted from paint.exe to the Blogger post. Should I reupload all of them to blogger or keep it the way it is? Will I be penalized for this or nothing would happen? Is there a benefit to fixing it? 7) For a new website that is less than 1 week old, when can I start building backlinks? If I can start building backlinks now, what is the ideal number per day that I should create? 😎 Does post every single page or post of content I have on my website to other Web 2.0s like Squidoo, Wordpress, or Blog penalize my website for duplicate content or what? If I do this, does it give me any SEO benefit? 9) How much stronger is a .gov backlink than a .edu backlink? How much stronger are both of those compared to a regular extension backlink? 10) If I am building backlinks, should I link just my main home page URL or all internal URLs to? 11) I see several people that build backlinks to other websites by typing in a comment and throwing their link in there. Like question 10, should I post ALL the links to my website (Internal + Home) or just my main page link? 12) What is better; .com, .net, or .org? What about .info, .us, and .biz in terms of SEO benefit? 13) I have several pages on my site in which Google indexed them and I deleted the post. Now when I search my site on Google and I click on the link to the post, it is pretty much a 'dead link' because the post cannot be found. Does this harm my site in any way, and how can I take these dead pages off? 14) One of my sites is already indexed by Google but not Yahoo! What should I do to get my site indexed? It's already been about a week. Thanks for attempting to answers my questions. I don't have anything to give, but, I can choose 3 'good answers' for helping me!
Moz Pro | | 6786486312640 -
Campaign Crawl Report
Hello, Just a quicky, is there anyway I can do a crawl report for something in a campaign so I can compare the changes? I know you can do a separate crawl test, but it wont show the differences,and the next crawl date isnt untill the 28th.
Moz Pro | | Prestige-SEO0 -
SEOMoz Crawl Warnings, do they really hurt rankings?
SEOMoz reports 250 crawl warnings on my site. In most cases its too long title tags, with 4 of them its missing meta description. SEOMoz says it will hurt my rankings? However, I'm sure a recent whiteboard Friday contradicted this. So what is it?
Moz Pro | | sanchez19600 -
Dynamic URL pages in Crawl Diagnostics
The crawl diagnostic has found errors for pages that do not exist within the site. These pages do not appear in the SERPs and are seemingly dynamic URL pages. Most of the URLs that appear are formatted http://mysite.com/keyword,%20_keyword_,%20key_word_/ which appear as dynamic URLs for potential search phrases within the site. The other popular variety among these pages have a URL format of http://mysite.com/tag/keyword/filename.xml?sort=filter which are only generated by a filter utility on the site. These pages comprise about 90% of 401 errors, duplicate page content/title, overly-dynamic URL, missing meta decription tag, etc. Many of the same pages appear for multiple errors/warnings/notices categories. So, why are these pages being received into the crawl test? and how to I stop it to gauge for a better analysis of my site via SEOmoz?
Moz Pro | | Visually0 -
Is there any way to manually initiate a crawl through SEOMoz?
... or do you actually have to wait a week for the next scheduled crawl date on a particular campaign? We've just made a ton of changes to our site, and it would be helpful to know if they will generate any warnings or errors sooner rather than later. Thanks!
Moz Pro | | jadeinteractive1