Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Rogerbot not showing in logs

Moz Pro

861

CraigWiltshire last edited by

Hi All

Rogerbot has recently thrown up 403 errors for all our pages - no changes had been made to the site so I asked our ISP for assistance.

They wanted to have a look at what rogerbot was doing and so went to the logs but rogerbot was not listed anywhere in the logs by name - any ideas why?

Regards

Craig
1 Reply Last reply
Reply Quote 0
kenneth_martin last edited by

Hey Craig,

Sorry about the issues you are experiencing with the crawler. I just opened up a customer support ticket for you so we can investigate this on our end to see what's going wrong.

My apologies for the inconvenience!

Kenny
1 Reply Last reply
Reply Quote 0
Adam.Whittles last edited by

Have you performed a crawl test? That might give you a clearer idea of what's going on.
1 Reply Last reply
Reply Quote 1

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

Moz crawling doesn't show all of my Backlinks

Hello, I'm trying to make an SEO backlinks report on my website When using the Link Explorer, I see only a few backlinks while I have much more backlinks on this website. Anyone has an idea about how to fix this issue. How can I check and correct this? My website is www.signsny.com.
Moz Pro | | signsny

1
Why is OSE showing no data for this URL?

Hi all, Does anyone have any ideas as to why OSE might not have any data for this URL: http://www.ccisolutions.com/StoreFront/product/shure-slx24-sm58-wireless-microphone-system-j3 It is not a new page at all. It's been on the site for years. Is OSE being quirky? Or is there an underlying problem with this page? Thanks in advance for any light you can shed on this, Dana
Moz Pro | | danatanseo

0
Rogerbot does not catch all existing 4XX Errors

Hi I experienced that Rogerbot after a new Crawl presents me new 4XX Errors, so why doesn't he tell me all at once? I have a small static site and had 9 crawls ago 10 4XX Errors, so I tried to fix them all.
The next crawl Rogerbot fount still 5 Errors so I thought that I did not fix them all... but this happened now many times so that I checked before the latest crawl if I really fixed all the errors 101%. Today, although I really corrected 5 Errors, Rogerbot digs out 2 "new" Errors. So does Rogerbot not catch all the errors that have been on my site many weeks before? Pls see the screenshot how I was chasing the errors 😉 404.png
Moz Pro | | inlinear

0
Open Site Explorer - Link Export Not Showing Same Number of Links

Noob question. I'm using Open Site Explorer to hunt down some external links for a website. In the attached image (post-pressing the filter button), it says I have 889 external links, but after I've downloaded the CSV, I only get 695 links. Why the difference in number? And if I'm doing something wrong, how do I make sure I'm getting the full amount of external links to my client's website? Thanks! GG6wURf.jpg
Moz Pro | | EEE3

1
Joined yesterday, today crawl errors (incorrectly) shows as zero...

Hi. We set up our SEOMoz account yesterday, and the initial crawl showed up a number of errors and warnings which we were in the process of looking at and resolving. I log into SEOMoz today and it's showing 0 errors, Pages Crawled: 0 | Limit: 10,000 Last Crawl Completed: Nov. 27th, 2012 Next Crawl Starts: Dec. 4th, 2012errors, warnings and notices show as 0, and the issues found yesterday show only in the change indicators.There's no way of getting to the results seen yesterday other than waiting a week?We were hoping to continue working through the found issues!
Moz Pro | | WorldText

0
Seomoz shows issue with canconical

Hi When I use the on-page research tool seomoz tells me I have an issue with the rel canconical tag pointing to the wrong url, but I have it set so that on this particular page it points to itself (as per recommendation from seomoz) full url is http://www.growingyourownveg.com/how-to-grow/garlic.html in head section i have <base href="http://www.growingyourownveg.com/"> Have I got this wrong? Google and Bing appear to accept it OK Thanks
Moz Pro | | spes123

0
Is seomoz rogerbot only crawling the subdomains by links or as well by id?

I´m new at seomoz and just set up a first campaign. After the first crawling i got quite a few 404 errors due to deleted (spammy) forum threads. I was sure there are no links to these deleted threads so my question is weather the seomoz rogerbot is only crawling my subdomains by links or as well by ids (the forum thread ids are serially numbered from 1 to x). If the rogerbot crawls as well serially numbered ids do i have to be concerned by the 404 error on behalf of the googlebot as well?
Moz Pro | | sauspiel

0
Rank Tracker Logging Me #Out

Hi I was wondering if someone could help me with something? Whenever I try and use the rank tracker SEOmoz logs me out and won't let me log back in until I go to a different page. Is this because I am on a free trial (which I don't understand as I am able to use the other tools)
Moz Pro | | SEOclient12

0