After fixing Crawl Errors, how long does it take to for Moz or Google to re-crawl a website?
-
Last night I found out through Moz that my robots.txt file was blocking any crawling of my website. I fixed the issue. Now do I just sit and wait?
-
Moz will crawl the site every week so you'll need to wait a few days for that to happen.
In the meantime you could try using the Moz Crawl tool to do a manual crawl. Depending on the size of your site this can take a few days so you might find it's just worth waiting for the weekly crawl. You can find the crawl tool here:
https://moz.com/researchtools/crawl-test
If you site isn't included in Google's index because it was inaccessible due to the robots,txt, then you'll want to go into Google Webmaster Tools and use the Crawl -> Fetch as Googlebot to kickstart Google crawling/indexing your site.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
804 SSL error
Hi all, I'm having a problem with Moz crawling our site. We use Cloudflare and I'm getting the 804 SSL error. What should I do? If anyone can advise that would be great.
Getting Started | | Naomi_AE0 -
Can I use 2 Moz Campaigns to Track more than 3 Competitors?
I would like to track 6 competitors for a new client, maybe short term, maybe long term. Can I set up 2 Moz Campaigns for the same client using the same keywords only with different competitors?
Getting Started | | cindyt-170380 -
Multiple Google Analytics Accounts connected to the same MOZ subscription
Hi everyone, I have a quick question regarding setting up my MOZ account and it's
Getting Started | | Bernardo.Reguero
integration with a Google Analytics account: I'm not sure if I'm right but I think I can only set a single Google
Analytics account to do my analysis and then created several campaign. Or is there a possibility to set several Google Analytics accounts and creating several camapign to track diferente websites (connected to diferente Google Analytics accounts) ? Thanks! Cheers, Bernardo0 -
Moz Pro Trial...."Oops! Try refreshing the page"
I am in my MOZ PRO trial. I want to add a campaign to see how I like it, but something keeps coming up saying "Oops! Try refreshing the page, if that doesn't work click here to contact our help team" And I can't find an answer to that question here. Please help ASAP Ld3rHLi
Getting Started | | WFC-Sales0 -
Google + Business Page and Moz Pro
Is there a way to connect my Google + Business page with Moz? The only option I have available to connect when I press the button is my personal Google + Page. Thanks!
Getting Started | | BenhardtConstruction0 -
Why can't I add more than one campaign in my trial version of MOZ?
Hi, I'm on the 30 day trial and I can only run one campaign right now. I thought I could add in 5 campaigns. When I go into Manage Campaigns the 'add a campaign' button is light blue and I can't click it. Is this just because I'm on the trial? Or should I be able to add 4 more campaigns?
Getting Started | | Sophie-Kool0 -
Is there a way to force re-crawl?
1- Can we force the system to recrawl a website without having to wait for the scheduled date? 2- Please forgive me as I am new to this, but is "Moz Analytics" supposed to replace the "Pro"? Thank you!
Getting Started | | BlackTreeIT0 -
How does MOZ assign a keyword to a page in the On Page Grades by Keyword Ranking
I'm in the beta analytics tool. In the On Page Optimization > On Page Grades by Keyword section, there is a Keyword column with a keyword assigned to each URL on my site. http://analytics.moz.com/search/on-page/572409.326269 How is the keyword that is shown here decieed upon? Is it simply based on a guess of the "best keyword" for each page based on kwp density and other factors? Can I map a new keyword to each page? or at least to my top ten most important pages? I see I can check the grade for any keyword on any page here: http://analytics.moz.com/search/manage-page-grades/572409.326269. I want to map my top ten pages to ten keywords - can I save these changes in the system so I don't have to manually check a keyword/url match each time? Shaun
Getting Started | | nuash0