Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Rogerbot not showing in logs

Moz Pro

856

CraigWiltshire last edited by

Hi All

Rogerbot has recently thrown up 403 errors for all our pages - no changes had been made to the site so I asked our ISP for assistance.

They wanted to have a look at what rogerbot was doing and so went to the logs but rogerbot was not listed anywhere in the logs by name - any ideas why?

Regards

Craig
1 Reply Last reply
Reply Quote 0
kenneth_martin last edited by

Hey Craig,

Sorry about the issues you are experiencing with the crawler. I just opened up a customer support ticket for you so we can investigate this on our end to see what's going wrong.

My apologies for the inconvenience!

Kenny
1 Reply Last reply
Reply Quote 0
Adam.Whittles last edited by

Have you performed a crawl test? That might give you a clearer idea of what's going on.
1 Reply Last reply
Reply Quote 1

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

Bing SEM Traffic showing up as Organic in Moz?

Hi there, Everyone! First time poster. 🙂 One of my clients has an ads string showing up in organic search? It is: s=bing_search&p=none . If I block it in the robots text, then I won't see any traffic results.
Moz Pro | | TopGrowthHacker.com

0
Canonical URLs all show trailing slash on main site pages - using Yoast SEO for Wordpress - how to correct

We are using Yoast for a number of our sites. We use naked domain as the canonical. I have noticed in the header tags that all our sites show the canonical URLs as having a trailing slash: Example: http;//foxspizzajc.com, when I look at the source code, it shows the canonical as http;//foxspizzajc.com/ Of course, it is much more likely that all sites that link to us will not use the trailing slash - so preferably we do not want that to be the canonical - among other reasons. Does this need to be fixed so the trailing slash is removed? I cannot see how to do this in Yoast SEO or in Permalinks structure for Wordpress. Sorry for my ignorance. Thanks for any help.
Moz Pro | | Adam_RushHour_Marketing

1
SERP Overlay Won't Show Up

I'm using the latest version of Chrome. I'm logged into Moz and the SERP Overlay is turned on. I turn it off and on again, and then it says "loading" beneath all the search results. Any answers would be appreciated, thanks!
Moz Pro | | franklinmozart

0
Report is showing 2 different domains?

Hello SEOMOZ Fam, I am trying to get a understanding on what is the best method for me to do moving forward. I am just noticing that my reports are showing data for both http://domain & http://www.domain which is what has been confusing me for this whole past month. I have just went into my control panel and redirected domains to be just http://domain....will me doing this redirect clean up my next crawl report next week or are there other steps I need to do with my domain or even my campaign? I think I chose root level for my campaign setting. Thanks so much n advance
Moz Pro | | 41global

0
Data Update for RogerBot

Hi, I noticed that rogerbot still give me 404 for http://www.salustore.com/capelli/nanogen-acquamatch.html refferal form http://www.salustore.com/protocollo-nanogen even I made changes since a couple of week. Same error with one "Title Element Too Short" on our site. Any suggestion on how to refresh it? Best Regards n.
Moz Pro | | nicolobottazzi

0
Why does my crawl diagnostics show duplicate content

My crawl diagnostics show duplicate content at mysite.com and mysite.com/index.html which are essentially the same file.
Moz Pro | | MSSBConsulting

0
SEOMoz says i have errors but goole webmaster doesnt show them - which one is right ?

I have about 350 websites all created in farcry 4.0 cms platform. When i do a site crawl using any seo tool ( seomoz, raven, screaming frog) it comes back telling me I have duplicate titles, description and content for a bunch of my pages. The pages are the same page its just that the crawl is showing the object Id and the friendly URL which is autocreated in the CMS as different pages. EXAMPLE these are the samge page but are recognised as different in SEOMOZ crawl test and therefore flagged as having duplicate title tags and content ... <colgroup span="1"><col style="width: 488pt; mso-width-source: userset; mso-width-alt: 23771;" span="1" width="650"></colgroup>
| www.westendautos.com.au/go/latest-news-and-specials <colgroup span="1"><col style="width: 488pt; mso-width-source: userset; mso-width-alt: 23771;" span="1" width="650"></colgroup>
| www.westendautos.com.au/index.cfm?objectid=9CF82BBD-9B98-B545-33BC644C0FA74C8E | | GOOGLE WEBMASTER however does not show me these errors ? It shows no errors at all. Now i believe i can fix this by chucking in a rel=canonical at the top of each page ? (a big job over 350 sites) But even so - my problem is that the website developers are telling me that SEOMOZ and all the other tools are wrong - that google will see these the way it should, that the object ID's would not get indexed ( although i have seen at least one object id show up in the serps.) Do i believe the developers and trust that google has it sorted or go through the process of hassling the developers to get a rel=canonical added to all the pages? (the issue sees my homepage as about 4 different pages www.domain.com/ www.domain.com/home /index AND object id.
Moz Pro | | cassi

0
Www. part of url not showing on google search results.

When typing in fun translator into google UK, my website www.funtranslator.com is the 18th result on the 2nd page, however, there is an issue, it only shows funtranslator.com, without the www part, which is not what I want because the whole address to show up, because my campaign on seomoz pro and webmaster tools account is www.funtranslator.com not funtranslator.com. How can I resolve this. For not, I have a redirect that goes from funtranslator to www.funtranslator.com I want to know how to get the full www.url into the results instead of just url.com without the www part of the url. Also, will this affect my stats gathered in my campaign on my seomoz pro account?
Moz Pro | | RyanSMurphy

1