Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Rogerbot not showing in logs

Moz Pro

853

CraigWiltshire last edited by

Hi All

Rogerbot has recently thrown up 403 errors for all our pages - no changes had been made to the site so I asked our ISP for assistance.

They wanted to have a look at what rogerbot was doing and so went to the logs but rogerbot was not listed anywhere in the logs by name - any ideas why?

Regards

Craig
1 Reply Last reply
Reply Quote 0
kenneth_martin last edited by

Hey Craig,

Sorry about the issues you are experiencing with the crawler. I just opened up a customer support ticket for you so we can investigate this on our end to see what's going wrong.

My apologies for the inconvenience!

Kenny
1 Reply Last reply
Reply Quote 0
Adam.Whittles last edited by

Have you performed a crawl test? That might give you a clearer idea of what's going on.
1 Reply Last reply
Reply Quote 1

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

Why does a word show as 'Google en-US Mobile Friendly' = FALSE when it also shows that it ranks 3 on mobile?

I pulled a recent report for all words I'm tracking locally and it states that a specific term ranks #4 on desktop and #3 on mobile. But in separate columns, specifically "Google en-US Mobile Friendly" that same terms shows as 'FALSE'. Any idea what this means? Thanks!
Moz Pro | | KristinaWitmer

0
Woocommerce filter urls showing in crawl results, but not indexed?

I'm getting 100's of Duplicate Content warnings for a Woocommerce store I have. The urls are
etc These don't seem to be indexed in google, and the canonical is for the shop base url. These seem to be simply urls generated by Woocommerce filters. Is this simply a false alarm from Moz crawl?
Moz Pro | | JustinMurray

0
Internal and external links showing in Webmaster Tools but not in MOZ

Hi there I set up a campaign 2 weeks ago but I am registering zero internal or external links for my website. It's a small site with only about 300 external links but they show in Webmaster tools but not in my link report or Open Site Explorer. Do I need to wait until the next OSE crawl or is something wrong with my set up? Thanks in advance! Laurie
Moz Pro | | turnbullholdingsltd

0
Why does Rel Canonical show up as a notice?

In the crawl diagnostics screen "Rel Canonical" shows up as a notice for every page that has a rel="canonical" meta tag in it. Why is this the case? Shouldn't every page have a canonical tag on it to show the absolute URL to the content? Wouldn't a better notice be to display pages that do not have a canonical tag instead? I could be wrong but that would make more sense to me. (In fact.. let's be honest here.. I probably am wrong.. but I'd like someone to explain it if they could.) Thanks
Moz Pro | | rrolfe

1
Link not showing up in OSE

I created a profile in April this year on CrunchBase for my company http://www.crunchbase.com/company/wallpapered but it is not appearing in the "inbound links" of Open Site Explorer. All the other companies I have checked in OSE have their CrunchBase profile in their inbound links (many share the same Page authority as mine). Any suggestions would be really helpful. Thanks
Moz Pro | | roberthseo

0
SEOmoz showing crawl errors but webmastertools says no errors, need help!

Hi this is my first question and i couldnt find a similar question on here. basically i have a clients website that is showing 150 duplicate page titles and content errors plus others. SEOmoz analysis is showing me for example is 3 duplicate hompage URLS: 1.www.domain.com 2.domain.com 3.www.domain.com/index.html all 3 are the same page. after explaining to the guy (who built the website) the errors, he ensured me that the main URL is URl 1. and the other 2 are 301 redirects. however SEOmoz analysis doesnt seem to change the results and webmastertools doesnt seem to show any errors at all. also if i try all 3 URL's there are no redirects to URL 1. any help or clarity would be awesome! Thanks e-bob
Moz Pro | | bobsnowzell

0
Were do I find the old Link Scape report that shows Domain Juice passed?

It looks like they are retiring the old Link scape. Where do we find the report that showed the Domain Juice passed by each link? Is it in the advanced reports and we need to request and wait?
Moz Pro | | MBayes

0
HUGE LINK!PR9 Not showing up

Hi ,My site is ranking very well.Although lacking large numbers of links ,Im only able to grasp the bottom page of First Page, Im in the position #6 through Position #10 with approximately 44 keywords. Its been about a year now so i think im doing well .. ** Here is my problem,** I recently was able to pick up a few very good High ranking backlinks ,They are in the Range of pr8 & 9 they have huge amounts of links pointing to them,One of them is a Dot Edu back link..Niether one of these are showing up..In fact , In the open site explorer i had a couple very high domain rank backlinks showing as my top link. This been there for 7 months They are gone...Now i have these 2 new backlinks both pr8 and pr9 not showing up in the top of the list..They are both cached .I can see them in the cached links .. ** But where the heck is my new links ??? been about 1-2 months ..shoudnt these show up in the top of open site exploreer?? Very aggrevating...Could this be open site explorer reading the site differently month after month??**
Moz Pro | | herrie

0