403 Error on WMT but not on MOZ?
-
Hello,
2 days ago I found there are about 1200 of 403 errors by Google WMT when I tried to fetch my domain - Please see attached
HTTP/1.1 403 Access Forbidden Cache-Control: private Content-Type: text/html ETag: "" Server: Set-Cookie: ASPSESSIONIDSSBARTSD=BEHMJHJBKJOEJEALECNNIPFH; path=/; HttpOnly X-Powered-By: Date: Tue, 18 Feb 2014 13:54:10 GMT Content-Length: 1233
<title>403 - Forbidden: Access is denied.</title>
Server Error
<fieldset>
403 - Forbidden: Access is denied.
You do not have permission to view this directory or page using the credentials that you supplied.
</fieldset>
I ran a complete report using MOZ but I was shocked not see any 4xx , 5xx errors. Google: 246 of 404 errors
No Google, Yahoo or Bing blocking
HTTP status code: ALL 200
301 redirect: none? I have done about 2500 over 4 years.
The website is losing indexed pages. I'm not sure what's going and which numbers to trust.
Please help. Thank you.
Adam
-
Hi Adam!
Thanks for writing in to Q&A! Let's dive right into this nitty gritty!
There are a lot of reasons you could be seeing these data discrepancies. If you're seeing more GWT errors, it could be because they have 'discovered links' through different means. Moz starts with your home page and uses recursive crawling to find pages on your site. We keep crawling until we stop finding unique links, or until we hit your page crawl limit. Bottom line, when we crawl your site your homepage is the only seed. We know that Google uses multiple seeds, so it could be possible Google is indexing more pages that way.
403 errors are agent specific. There's also a possibility that on a server level you're blocking WMT from crawling, but not rogerbot.
I looked into your account, and it looks like we're only crawling about 3,500 pages. Also, we generally limit our crawls to about 200 links per page. When I looked into your account, I saw that in most cases you had well beyond 200 internal links per page.
We have a few different options moving forward. To help you further I need examples of the following:
-specific URLs that show GWT errors, but don't show errors on Moz.
-a link hierarchy from that URL that goes back to your homepage.I want to respect your privacy, so if you'd like to take this conversation offline, please email us at help@moz.com!
I hope this helps! Let me know if you have any other questions!
Have a great rest of your Thursday!
Erin
-
It's difficult to say exactly what is wrong in this situation, but here are a couple of questions that might help narrow it down.
Have you tried manually going to the pages that appear to have these errors?
Did you recently change any URLs on your site?
Is the sitemap you submitted in WMT still valid?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz DA Factors
Hello Folks, I just wanna know that on which factors does Moz calculates DA ...? and also wanna know my site DA can anyone tell me Helmet Best
Moz Bar | | Alisa8844880 -
Moz Bar Truncated in Firefox
Hi, I'm using the Moz Bar add-on in Firefox.. but it's suddenly truncated meaning that I can only see half of the toolbar, and I'm unable to use it's features. Screenshot here; http://prntscr.com/bgm1z2 Does anyone know how to fix this? I've tried removing and re-adding Moz Bar, and installed a new version fo Firefox. Thanks in advance, Lee.
Moz Bar | | Webpresence1 -
Has anyone had to deal with Moz crawl issues on their Zendesk support site?
If so - how did you end up resolving them? For instance we have 85 "temporary redirect" errors from our Zendesk support site in our crawl error report and we don't have access to the robots.txt file through Zendesk.
Moz Bar | | zspace0 -
Ask moz staff
Was trying to crawl a page and the moz on page grader tells that URL is not accessible. The URL is accessible thorugh my mobile and desktop. Any idea what is the issue ? The URL is https://www.practo.com/singapore/dentist IGrzzVe
Moz Bar | | ozil0 -
Ww.domain.com coming up with error
our domain is showing in moz with the following error in crawl reports Crawl Error We were unable to access your homepage, which prevented us from crawling the rest of your site. It is likely that other browsers as well as search engines may encounter this problem and abort their sessions. This could be a temporary outage, but we recommend making sure your network and server are working correctly. note that the url being displayed is ww.domain.com and not www.domain.com . we do not have a 301 in place, we have switched off wildcard forwarding from the server.. its acting as the url is a subdomain that is not working.. should i just ignore it?
Moz Bar | | Direct_Ram0 -
Perplexed by last MOZ crawling duplicate content errors
In the last crawler issues report from MOZ I can see many many pages listed as duplicate content with 0 duplicate urls. Like this: http://imgur.com/fbikRVq I am puzzled, what does it mean?
Moz Bar | | max.favilli0 -
We Launched a new site and Rogerbot is still reporting on links/errors from the old site, is there a way to clear those out?
We are mostly a Branding agency, and have not put a lot of effort into SEO for ourselves... SEO tends to take a backseat to design most of the time, making it a little difficult for me at times when it comes to SEO. We recently launched a new site, http://Roninadv.com/ and the developer and I have done quite a bit of work to make it work well for Google. I was really looking forward to a new crawl report from Roger, but alas, It's like Roger crawled the old site? The new site has been up since last Monday. Is there a way to clear out the old errors? Do I just need to give roger more time?
Moz Bar | | PaulRonin0 -
Moz is reporting a broken link error but GWT is not
My latest Moz report is showing a 404 for: http://www.fateyes.com/how-will-googles-hummingbird-affect-your-search-ranking/”ht
Moz Bar | | gfiedel
(and showing the link this way with the characters after the last / which are not part of the page URL) Google Webmaster Tools says we have no errors. I'm wondering why there is this descrepancy and I'm wondering how I can track down where this link is originating from on our site. I've tried downloading screamingfrog and deeptrawl to no avail (java issues). I've also tried a couple of services online and installed Broken Link Checker plugin with no luck finding it. Any suggestions? Thanks in advance!0