Its been over a month, rogerbot hasn't crawled the entire website yet. Any ideas?
-
Rogerbot has stopped crawling the website at 308 pages past week and has not crawled the website with over 1000+ pages. Any ideas on what I can do to get this fixed & crawling?
-
Hi TJ,
Did that answer your question? if so I am very happy. Please let me know if there's anything else I can do to assist you in fully answering this question. thank you for the kind words.
Happy holidays,
Thomas
-
@Thomas
Thanks for the headsup! Ever since asking this question Roger has crawled 2 more pages taking the total to - 310.
Yes, I've already selected Roger send details on the site on a weekly basis via the reporting section. Thanks for the quick reply and happy holidays!
Best,
TJ
-
If you have a stop at 308 that is normal Roger likes to take breaks or smaller amounts of websites in the beginning only indexes he will be back way to make sure is by following the directions below.
Have you requested that Roger check your site by going into campaigns then selecting reports then selecting weekly?
Make sure the above steps of been done. Roger is going to town on mine so I don't think you leave you out of the party.
Respectfully,
Thomas Zickell
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Ranking issues with my local business website.
Hi, I have local business website "asapgaragedoorrepair.com" which im seeing weird ranking issues during last few months . i would like to share it with you guys and get help from you. first days i have indexed the website ,it was ranking good with google and then after 2-3 weeks i have noticed that none of the pages ranking anymore. i have looked for any issues in the optimization and i fixed them and indexed again. right now i have weird issues. 1- the website was ranking for another page in my website other that the one that i wanted for keyword" Garage Door Repair Pasadena " .(it was ranking with garage door installation page). i changed the content ,optimization on the other page and indexed. still the same issue. then i had no ways other that 301 to the right page . 2- when i check the rankings with "ahrefs" website or "Moz" or other tools that i have, it shows that im ranking for 16th position for " Garage door repair Pasadena ". but when i search it by myself im getting no results. (this is bothering) maybe i dont know something . pls help me 3- in Moz or ahref website shows the ranking like the image i have attached. 2 different results for each keywords. why is that? and why i can not see them when i search them by my self? htPQR
Moz Pro | | Mishel2980 -
Links don't show in MOZ
Hi, Im have started some weeks ago with some standard linkbuilding from websites to my domain www.eppinga.nl . These links don't show in Moz. Does this take some time? How long does it take? Thanks in advance for all replies! Tymen
Moz Pro | | Tymen0 -
I'm searching for a Freelancer SEO Professional
Hi guys, I'm searching for a freelancer seo professional to fix my website errors on SEO Moz, I'm from Brazil, I got a supplement webstore and have no time to fix this errors here in SEO Moz Someone here for this job? Thanks
Moz Pro | | megaformasuplementos0 -
Is SeoMOZ Crawl Diagnostics wrong here?
We've been getting a ton of critical errors (about 80,000) in SeoMoz' Crawl Diagnostics saying we have duplicate content in our client's E-commerce site. Some of the errors are correct, but a lot of the pages are variations like: www.example.com/productlist?page=1 www.example.com/productlist?page=2 However, in our source code we have used rel="prev" and rel="next" so in my opinion we should be alright. Would love to hear from you if we have made a mistake or if it is an error in SeoMoz. Here's a full paste of the script:
Moz Pro | | Webdannmark0 -
SeoMoz: Competitive domain analysis report doesn't add up?
Hi, When I check OSE against the Competitive Domain Analysis report in my account the numbers are way off. If the CDA report was 100%, OSE is showing 30% of that. I'm looking at linking root domains with no filters applied. Is the data not pulled from the same db? Thanks.
Moz Pro | | Bondara0 -
My Website is not being crawled by Google last 15 days
Hello, Required emergency help, one of client website http://www.mediaxpress.net/ is not being crawled since last 15 days, What can be the reason. I have Checked Google Webmaster Tools, it not showing an Issue and even SEOmoz crawler is crawling it normally. I have updated some data on pages, and i want to get it crawled by Google. But Google is not crawling in anyway.
Moz Pro | | CommercePundit0 -
How does SEOMoz crawl sites? Does it follow the sitemap?
I only ask because in my report it returned a few "no follow" links. Was wondering how SEOMoz operates.
Moz Pro | | Pikimal0 -
404 errors in SEOMoz crawl tool
I currently have several 404 errors in the latest crawls from SEOMoz. Here is an example of the error. http://dealerplatform.com/blog/2011/10/23/videos-for-auto-dealers/www.dealerplatform.com/ In all cases the error is a result of www.dealerplatform.com being added to the real url. Anyone seen this before? The site is a wordpress mutlisite. I don't see where this incorrect link is showing up anywhere on the website. Any advice would be helpful. Thanks
Moz Pro | | Chris_Gregory0