Settings to crawl entire site
-
Not sure what happened but I started a third campaign yesterday and only 1 pages was crawled,
The other two campaigns has 472 and 10K respectively.
What is the proper setting to choose in the beginning of campaign setup to have the entire site crawled. Not sure what I did different and I must be reading the instructions incorrectly.
Thanks,
Don
-
The most common reasons for this are discussed at https://seomoz.zendesk.com/entries/409821-why-isn-t-my-site-being-crawled-you-re-not-crawling-all-my-pages. If those don't solve your problem, email help@seomoz.org and we'll be able to sort it out at the help desk.
Thanks!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How Can I Solve a Spam Score Of 33% On A Site
Goof Day pls Am having S Spam Score Of 33% On my Blog Naijazeal.Com And I Check In my Google webmaster and i analyze all the link i see and i see little with high spam Score But Checking My Spam Score on Moz, It showi Extermal link below but most of the link showing below is not in my Seach console Pls help
Moz Pro | | DAMIDEZ0 -
Why my site so poorly ranks on Google
Hi 🙂 I hope you can help me for my site http://www.majordroid.com/ I really do not understand why my site so poorly ranks on Google. What can I do about that? Are there any errors or something? What can be done about that? Also when I go to the Moz Tools - Open Site Explorer to check how many backlinks I have... It says: 12 Total Links but according to the Google Webmaster tools I have in total 334 links and 138 links to the homepage. see attachment Why Open Site Explorer does not see all the links to my site, which is a possible reason? And last question, what I need to do to remove pages from Google search like this: <cite class="_Rm">/page/2</cite>. <cite class="_Rm">/page/3 and so on...</cite> Thank you 🙂 aK0x345.jpg
Moz Pro | | ivek19870 -
If links have been disavowed, do they still show in crawl reports?
I have a new client who says they have disavowed all their bad links, but I still see a bunch of spammy backlinks in my external links report. I understand that disavow does not mean links are actually removed so will they continue to show in Google Webmaster Tools and in my Moz reports? If so, how do I know which ones have been disavowed and which have not? Regards, Dino
Moz Pro | | Dino640 -
Rogerbot crawls my site and causes error as it uses urls that don't exist
Whenever the rogerbot comes back to my site for a crawl it seems to want to crawl urls that dont exist and thus causes errors to be reported... Example:- The correct url is as follows: /vw-baywindow/cab_door_slide_door_tailgate_engine_lid_parts/cab_door_seals/genuine_vw_brazil_cab_door_rubber_68-79_10330/ But it seems to want to crawl the following: /vw-baywindow/cab_door_slide_door_tailgate_engine_lid_parts/cab_door_seals/genuine_vw_brazil_cab_door_rubber_68-79_10330/?id=10330 This format doesn't exist anywhere and never has so I have no idea where its getting this url format from The user agent details I get are as follows: IP ADDRESS: 107.22.107.114
Moz Pro | | spiralsites
USER AGENT: rogerbot/1.0 (http://moz.com/help/pro/what-is-rogerbot-, rogerbot-crawler+pr1-crawler-17@moz.com)0 -
MozRank in Open Site Explorer?
Hi, I wondered why mozRank is not showing in OSE? As this is the "equivalent" of Google's page rank? Thanks
Moz Pro | | CallieGunstinson0 -
How do I retrieve crawl and ranking data about a site from the past?
Hey. One of my main clients has asked to see the crawl data and rankings data for the past eight months. He wants to have tangible evidence of the effects of Penguin. I would like that info too. Is it possible to retrieve that information on a weekly crawl and ranking basis through SEO Moz and if so, how do you do it? I simply want to show a graph, timeline and brief explanation across several main keywords... Help me as you guys always do - You rock Best Ben
Moz Pro | | creativeguy0 -
How do we change our domain settings for a changed domain?
We have changed the primary domain for an existing campaign we are tracking with SEOMOZ. How do we update the NEW domain name for our campaign so that we can maintain the existing set of data? We just want to change the URL that SEOMOZ is crawling. We have already updated the Google Analytics settings, so they should be consistent with SEOMOZ once we get the URL updated with you.
Moz Pro | | 403SEO0 -
How often is Open Site Explorer updated?
Or perhaps my question is actually how often does the seomoz bot crawl the web? I ran some benchmark link counts for a number of websites about this time last month and I noticed when I went to update them for this month the data is the same. Thanks.
Moz Pro | | WCR1