Rogerbot not showing in logs
-
Hi All
Rogerbot has recently thrown up 403 errors for all our pages - no changes had been made to the site so I asked our ISP for assistance.
They wanted to have a look at what rogerbot was doing and so went to the logs but rogerbot was not listed anywhere in the logs by name - any ideas why?
Regards
Craig
-
Hey Craig,
Sorry about the issues you are experiencing with the crawler. I just opened up a customer support ticket for you so we can investigate this on our end to see what's going wrong.
My apologies for the inconvenience!
Kenny
-
Have you performed a crawl test? That might give you a clearer idea of what's going on.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Why is my campaign showing old data?
My campaign is stuck in a time-warp. It seems to think it's still May. Why is this? Can anyone help please.
Moz Pro | | rhiannondavies0 -
Why are inbound links not showing?
I run the site http://www.eurocheapo.com and am finding that many inbound links are not showing up in OSE and on the toolbar. For example, check out this hotel review: http://www.eurocheapo.com/paris/hotel/hotel-esmeralda.html In OSE it shows only 2 links (from 1 domain), which is crazy. It has dozens of inbound links from many different domains (links:http://www.eurocheapo.com/paris/hotel/hotel-esmeralda.html). I notice this all over my site. Pages that we link between are also showing no internal links -- which is easy to disprove. Was there a problem with this crawl? Or is the problem in our code? Many thanks for your help, Tom
Moz Pro | | TomNYC0 -
Does Rogerbot recognize rel="alternate" hreflang="x"?
Rogerbot just completed its first crawl and is reporting all kinds of duplicate content - both page content and meta title/description. The pages it is calling duplicate are used with rel="alternate" hreflang="x", but are still being labeled as dupes. The title and descriptions are usually exactly the same, so I am working on getting at least those translated into different languages. I think its getting tripped up because the product page its crawling are only in English, but the chrome of the site is in the translated languages. The URLs look like so: Original: site.com/product Detected duplicates: site.com/fr/product, site.com/de/product, site.com/zh-hans/product
Moz Pro | | sedwards0 -
Why is the Rankings Report of SeoMoz always show inaccurate results?
I have been using SEOmoz PRO tool from last two months but I am not happy with the SEOmoz PRO Ranking Report.The results are very inaccurate and I am not able to understand why there is such a difference in the ranking results when SEOmoz tracks and when I track?Please reply at the earliest. Regards, Prashakth Kamath
Moz Pro | | 1prashakth0 -
Does anyone know of a crawler similar to SEOmoz's RogerBot?
As you probably know SEOmoz had some hosting and server issues recently, and this came at a terrible time for me... We are in the middle of battling some duplicate content and crawl errors and need to get a fresh crawl of some sites to test things out before we are hit with the big one? Before I get a million thumbs downs- I love and will continue to use SEOmoz, just need something to get me through this week ( or until Roger is back! )!
Moz Pro | | AaronSchinke1 -
Trying to boost Backlinks but OSE still shows same figures for past month
I often check Open site explorer to see if I increased in linking root domains to my site after getting some backlinks on it. I have a concern about the number it is displaying: How does this statistic get updated? If I spread backlinks on some sites do i have to do anything else like ping it so google can crawl it so OSE sees it and counts it towards my linking root domain statistic? Is this current figure OSE is reading from cache and giving me an outdated number? NNzAn.jpg
Moz Pro | | lafurniturestore0 -
Moz tool bar showing less links
Just checked our links for a couple of our sites and noticed that the number of inbound links has dropped from around 55,000 to 13,000 on one and from 6000 to 700 on the other. GWMT still showing the previous amounts. Anyone else experienced this over the last few days?
Moz Pro | | heatherrobinson0 -
Recent backlinks in Open Site Explorer as not showing
I saw the note today that the link index did it's monthly update, yet our site www.oznappies.com still only shows 1 linking root domain and I know there are many more links now. What do I need to do to get open Site Explorer to use the latest data? I enter our site, create the report and only see old information from 6 may 2011's link index. I have the same issue with competive link finder, links I know we have on the sites listed for our competitors are not showing for our site.
Moz Pro | | oznappies0