Rogerbot not showing in logs
-
Hi All
Rogerbot has recently thrown up 403 errors for all our pages - no changes had been made to the site so I asked our ISP for assistance.
They wanted to have a look at what rogerbot was doing and so went to the logs but rogerbot was not listed anywhere in the logs by name - any ideas why?
Regards
Craig
-
Hey Craig,
Sorry about the issues you are experiencing with the crawler. I just opened up a customer support ticket for you so we can investigate this on our end to see what's going wrong.
My apologies for the inconvenience!
Kenny
-
Have you performed a crawl test? That might give you a clearer idea of what's going on.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Restrict rogerbot for few days
Hi Team, I have a subdomain that built in Zendesk's CRM system. Now, I want to restrict Moz crawler (rogerbot) for crawling this complete subdomain for a few days, but I am not able to edit the robots.txt file of the subdomain, because this is a shared file and Zendesk is not allowing to edit it. Could you please let me know the alternative way to restrict rogerbot to crawl this subdomain? I am eagerly awaiting your quick response. Thanks
Moz Pro | | Adeptia0 -
Links don't show in MOZ
Hi, Im have started some weeks ago with some standard linkbuilding from websites to my domain www.eppinga.nl . These links don't show in Moz. Does this take some time? How long does it take? Thanks in advance for all replies! Tymen
Moz Pro | | Tymen0 -
Internal and external links showing in Webmaster Tools but not in MOZ
Hi there I set up a campaign 2 weeks ago but I am registering zero internal or external links for my website. It's a small site with only about 300 external links but they show in Webmaster tools but not in my link report or Open Site Explorer. Do I need to wait until the next OSE crawl or is something wrong with my set up? Thanks in advance! Laurie
Moz Pro | | turnbullholdingsltd0 -
Is there a report that shows how many times your keywords are searched?
I see the keyword ranking report but I need a report that shows the number of searches on those keywords, Thanks!
Moz Pro | | AFSB0 -
What could be the reason that seomoz only shows crawl results for my homepage?
Hi there I am running three campaings for three different sites. The first site crawl is successful with a ful report. However the other two only shows results for the homepage, i.e. only a single page crawled by the mozbot. What could be the reason for this? Thanks, Gerrie
Moz Pro | | marketingmen0 -
Duplicate pages with canonical links still show as errors
On our CMS, there are duplicate pages such as /news, /news/, /news?page=1, /news/?page=1. From an SEO perspective, I'm not too worried, because I guess Google is pretty capable of sorting this out, but to be on the safe side, I've added canonical links. /news itself has no link, but all the other variants have links to "/news". (And if you go wild and add a bunch of random meaningless parameters, creating /news/?page=1&jim=jam&foo=bar&this=that, we will laugh at you and generate a canonical link back to "/news". We're clever like that.) So far so good. And everything appears to work fine. But SEOMoz is still flagging up errors about duplicate titles and duplicate content. If you click in, you'll see a "Note" on each error, showing that SEOMoz has found the canonical link. So SEOMoz knows the duplication isn't a problem, as we're using canonical links exactly the way they're supposed to be used, and yet is still flagging it as an error. Is this something I should be concerned about, or is it just a bug in SEOMoz?
Moz Pro | | LockyDotser0 -
Title Page Two Long Still shows
This should be an easy one. I signed up for this service in November. The first report showed many title pages too long etc. I fixed all known errors. On December 28 there was another crawl but the errors still show up on the report. Why? Is there anything I can do to update so I can get down to the few I missed
Moz Pro | | Wales1 -
Www. part of url not showing on google search results.
When typing in fun translator into google UK, my website www.funtranslator.com is the 18th result on the 2nd page, however, there is an issue, it only shows funtranslator.com, without the www part, which is not what I want because the whole address to show up, because my campaign on seomoz pro and webmaster tools account is www.funtranslator.com not funtranslator.com. How can I resolve this. For not, I have a redirect that goes from funtranslator to www.funtranslator.com I want to know how to get the full www.url into the results instead of just url.com without the www part of the url. Also, will this affect my stats gathered in my campaign on my seomoz pro account?
Moz Pro | | RyanSMurphy1