Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Rogerbot not showing in logs

Moz Pro

867

CraigWiltshire last edited by

Hi All

Rogerbot has recently thrown up 403 errors for all our pages - no changes had been made to the site so I asked our ISP for assistance.

They wanted to have a look at what rogerbot was doing and so went to the logs but rogerbot was not listed anywhere in the logs by name - any ideas why?

Regards

Craig
1 Reply Last reply
Reply Quote 0
kenneth_martin last edited by

Hey Craig,

Sorry about the issues you are experiencing with the crawler. I just opened up a customer support ticket for you so we can investigate this on our end to see what's going wrong.

My apologies for the inconvenience!

Kenny
1 Reply Last reply
Reply Quote 0
Adam.Whittles last edited by

Have you performed a crawl test? That might give you a clearer idea of what's going on.
1 Reply Last reply
Reply Quote 1

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

I have used my keyword only 12 times but on-page grader shows it 40 times?

Hey experts, I hope you are doing great, kindly have a look at this page, my keyword for this page is "Sports Streaming Sites". The text has a length of 5344 words and I'm using my keyword in this post as follow: 1. Text Body: 12 times(including headers)
2. Alt tags: 10 times (20+ Images)
3. Title: 1 Time
4. Description: 1 Time
5. Permalink: 1 Time This is a total of 25 times in 5344 words, but when I check this page with moz on-page grader, it shows that I'm using this keyword 40 times and its stuffed, can anybody please explain it to me, I'm so confused and it'll be so nice of you. Here is the on-page grader report page: https://analytics.moz.com/pro/research/page-grader?keyword=Sports%20Streaming%20Sites&url=https%3A%2F%2Firiveramerica.com%2Ffree-best-sports-streaming-sites%2F
Moz Pro | | louisaclark1

0
Links don't show in MOZ

Hi, Im have started some weeks ago with some standard linkbuilding from websites to my domain www.eppinga.nl . These links don't show in Moz. Does this take some time? How long does it take? Thanks in advance for all replies! Tymen
Moz Pro | | Tymen

0
Duplicate pages with canonical links still show as errors

On our CMS, there are duplicate pages such as /news, /news/, /news?page=1, /news/?page=1. From an SEO perspective, I'm not too worried, because I guess Google is pretty capable of sorting this out, but to be on the safe side, I've added canonical links. /news itself has no link, but all the other variants have links to "/news". (And if you go wild and add a bunch of random meaningless parameters, creating /news/?page=1&jim=jam&foo=bar&this=that, we will laugh at you and generate a canonical link back to "/news". We're clever like that.) So far so good. And everything appears to work fine. But SEOMoz is still flagging up errors about duplicate titles and duplicate content. If you click in, you'll see a "Note" on each error, showing that SEOMoz has found the canonical link. So SEOMoz knows the duplication isn't a problem, as we're using canonical links exactly the way they're supposed to be used, and yet is still flagging it as an error. Is this something I should be concerned about, or is it just a bug in SEOMoz?
Moz Pro | | LockyDotser

0
Why do pages with canonical urls show in my report as a "Duplicate Page Title"?

eg: Page One
<title>Page one</title>
No canonical url Page Two
<title>Page one</title> Page two is counted as being a page with a duplicate page title.
Shouldn't it be excluded?
Moz Pro | | DPSSeomonkey

0
Does anyone know of a crawler similar to SEOmoz's RogerBot?

As you probably know SEOmoz had some hosting and server issues recently, and this came at a terrible time for me... We are in the middle of battling some duplicate content and crawl errors and need to get a fresh crawl of some sites to test things out before we are hit with the big one? Before I get a million thumbs downs- I love and will continue to use SEOmoz, just need something to get me through this week ( or until Roger is back! )!
Moz Pro | | AaronSchinke

1
Www. part of url not showing on google search results.

When typing in fun translator into google UK, my website www.funtranslator.com is the 18th result on the 2nd page, however, there is an issue, it only shows funtranslator.com, without the www part, which is not what I want because the whole address to show up, because my campaign on seomoz pro and webmaster tools account is www.funtranslator.com not funtranslator.com. How can I resolve this. For not, I have a redirect that goes from funtranslator to www.funtranslator.com I want to know how to get the full www.url into the results instead of just url.com without the www part of the url. Also, will this affect my stats gathered in my campaign on my seomoz pro account?
Moz Pro | | RyanSMurphy

1
Is there a tool that will show me where links with a given anchor text are coming from?

In OSE I can see how many links there are with a given anchor text, but I can't see where those links come from.
Moz Pro | | seocraig-310177

0
What is the full User Agent of Rogerbot?

What's the exact string that Rogerbot send out as his UserAgent within the HTTP Request? Does it ever differ?
Moz Pro | | rightmove

0