Rogerbot not showing in logs
-
Hi All
Rogerbot has recently thrown up 403 errors for all our pages - no changes had been made to the site so I asked our ISP for assistance.
They wanted to have a look at what rogerbot was doing and so went to the logs but rogerbot was not listed anywhere in the logs by name - any ideas why?
Regards
Craig
-
Hey Craig,
Sorry about the issues you are experiencing with the crawler. I just opened up a customer support ticket for you so we can investigate this on our end to see what's going wrong.
My apologies for the inconvenience!
Kenny
-
Have you performed a crawl test? That might give you a clearer idea of what's going on.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Problem to log into moz
Every time the moz logs me out from the account and then I can not log in. It shows on the left side my name like I am logged in and then when I want go to community suddenly I am not logged in. It offen shows 502 error. It was first doing on firefox, then I manage to log in chrome and now I had to log in private browsing.
Moz Pro | | Rebeca12 -
Why does mozbar show pagerank sometimes and not opensiteexplorer?
Hello Internet People! I have been using Opensiteexplorer and Mozbar side by side for 2 months now, running comparisons while link building. I have noticed a small problem, in that sometimes, Mozbar will display page rank information while Opensiteexplorer does not. Eventually Opensiteexplorer updated after several days or weeks, showing the same values as Mozbar. Can someone help me understand why this is happening and if it is a problem to trust the tool over the website? Thanks!
Moz Pro | | CGalownia0 -
Can someone explain to me why OSE shows two different numbers for Linking Root Domains in the header and in the results area?
See Photo Below. 271 in the header, 500 plus in the results section. I just want an accurate number to chart my progress from here on out. Majestic numbers seem inflated too much. Google Webmaster Tools too. g58HX.png
Moz Pro | | DRPower0 -
How long before new links show up in OSE?
Hi - How long should it be before a brand new external link to our site shows up in OSE?
Moz Pro | | tcolling0 -
Links from External Sites not Showing on OpenSite or Google Webmaster Tools
Hi, I asked this in another post, but didn't get a solid answer. For several websites I manage, I have access to their Google Webmaster Tools. When I put the site through there, or the link:// or SEOMoz's OpenSite link reporter, I get not even a fraction of the links that I know are pointing to the websites in question. Some of these links are from home pages or side columns, and some are from articles keep within a website, like at Inc.com. I wondered if the links in question were not themselves being indexed, but if I do a very specific search, I can pull them up in the search results. Is it just common knowledge that these link tools are not accurate? And to assume that somehow, search engines really do see all of the inbound links, even if our reporting tools don't. Thanks in advance!
Moz Pro | | lilactree0 -
RSS feed showing up as duplicate content
Hi, I've just run an SEOMOZ Pro scan for the first time and it is picking up duplicate content errors from the RSS feed. For some reason it seems to be picking up two feeds, for example: http://blog.clove.co.uk/2009/05/13/htc-touch-diamond2-review/feed/ http://blog.clove.co.uk/2009/05/19/htc-touch-diamond2-review-2/feed/ Does anyone know why this is happening and how I can resolve this? Thanks
Moz Pro | | pugh0 -
SEOMoz's Crawl Diagnostics showing an error where the Title is missing on our Sitemap.xml file?
Hi Everyone, I'm working on our website Sky Candle and I've been running it as a campaign in SEOmoz. I've corrected a few errors we had with the site previously, but today it's recrawled and found a new error which is a missing Title tag on the sitemap.xml file. Is this a little glitch in the SEOmoz system? Or do I need to add a page title and meta description to my XML file. http://www.skycandle.co.uk/sitemap.xml Any help would be greatly appreciated. I didn't think I'd need to add this. Kind Regards Lewis
Moz Pro | | LewisSellers0
