403 Error on WMT but not on MOZ?
-
Hello,
2 days ago I found there are about 1200 of 403 errors by Google WMT when I tried to fetch my domain - Please see attached
HTTP/1.1 403 Access Forbidden Cache-Control: private Content-Type: text/html ETag: "" Server: Set-Cookie: ASPSESSIONIDSSBARTSD=BEHMJHJBKJOEJEALECNNIPFH; path=/; HttpOnly X-Powered-By: Date: Tue, 18 Feb 2014 13:54:10 GMT Content-Length: 1233
<title>403 - Forbidden: Access is denied.</title>
Server Error
<fieldset>
403 - Forbidden: Access is denied.
You do not have permission to view this directory or page using the credentials that you supplied.
</fieldset>
I ran a complete report using MOZ but I was shocked not see any 4xx , 5xx errors. Google: 246 of 404 errors
No Google, Yahoo or Bing blocking
HTTP status code: ALL 200
301 redirect: none? I have done about 2500 over 4 years.
The website is losing indexed pages. I'm not sure what's going and which numbers to trust.
Please help. Thank you.
Adam
-
Hi Adam!
Thanks for writing in to Q&A! Let's dive right into this nitty gritty!
There are a lot of reasons you could be seeing these data discrepancies. If you're seeing more GWT errors, it could be because they have 'discovered links' through different means. Moz starts with your home page and uses recursive crawling to find pages on your site. We keep crawling until we stop finding unique links, or until we hit your page crawl limit. Bottom line, when we crawl your site your homepage is the only seed. We know that Google uses multiple seeds, so it could be possible Google is indexing more pages that way.
403 errors are agent specific. There's also a possibility that on a server level you're blocking WMT from crawling, but not rogerbot.
I looked into your account, and it looks like we're only crawling about 3,500 pages. Also, we generally limit our crawls to about 200 links per page. When I looked into your account, I saw that in most cases you had well beyond 200 internal links per page.
We have a few different options moving forward. To help you further I need examples of the following:
-specific URLs that show GWT errors, but don't show errors on Moz.
-a link hierarchy from that URL that goes back to your homepage.I want to respect your privacy, so if you'd like to take this conversation offline, please email us at help@moz.com!
I hope this helps! Let me know if you have any other questions!
Have a great rest of your Thursday!
Erin
-
It's difficult to say exactly what is wrong in this situation, but here are a couple of questions that might help narrow it down.
Have you tried manually going to the pages that appear to have these errors?
Did you recently change any URLs on your site?
Is the sitemap you submitted in WMT still valid?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz is finding phantom pages
I suddenly have 4xx errors in my crawl diagnostics because pages with “/%3C/div” added to the end of the URL that are linked from the normal page can't be found. I didn't create the pages, and they don't exist, but Moz thinks that they do. I went back through to see if any changes in WordPress, theme or plugins versions might be the cause, but this is the only site that I have this issue, so I don't think that is it. Does anyone have an idea what causes this?
Moz Bar | | samuelldrew0 -
Moz Tool Bar Annoyance - How do I make the green keyword difficulty box go away?
A highly annoying light green keyword difficulty box just started showing up to the right of the search box. How do I make this go away? ulBzP9W
Moz Bar | | JenKeller0 -
Chrome moz toolbar page analysis not loading
Often the chrome moz toolbar page analysis doesn't load just says Please wait until the page finishes loading.
Moz Bar | | genkee0 -
Error for a page that doesn't exist.
Hi, I'm just trailing this service, and I have a couple of questions that I hope someone can help with. 1. I am getting a high priority error regarding a page not being able to be crawled - a 4XX error. Problem is, there is no such page in existence. The URL is my site/comments/feed It's driving me crazy. 2. I'm also getting errors based on missing meta tags in blog posts. I am adding tags at the time of posting, so I am unsure why these errors are showing up. Actually, I didn't add tags to all posts - but there are errors on ALL posts, even those I added tags to. Any help would be wonderful. Thanks!!! Hugh
Moz Bar | | hughanderson0 -
New moz analytics...will it have reporting?
Loving the new Moz Analytics...very shiny. Just wondering if it will have reporting tied to it at some point? Thanks..Jeannie x.
Moz Bar | | Jeannie.0 -
New website launched 3 weeks ago but not sure what Moz Analysis is telling me?
Hi 3 weeks ago I re-branded and completely changed the proposition on www.over50choices.co.uk as the URL is appropriate to the proposition. And whilst it looks good I am unsure what the Moz Tools are telling me, other than it doesnt look good? There should be about 163 pages, but Moz reports over 500 due to i think so many 301's? Plus most pages under the HTTP Status reports No Data! Most of the the 404's are from the old site. Webmaster Tools say 163 pages submitted but only 2 indexed, but on site:search it says about 117 but 40+ of these are the old site. It looks a mess...! Sleepless nights have started - any thoughts!? Thanks Ash
Moz Bar | | AshShep10 -
Moz Rank Tracker doesn't work with "PHRASE" Keywords!?
Hello, If at http://ranktracker.moz.com trying to track phrase KW - the system wont accept it. But adding [EXACT] match with [] - works well. Have I missed something? Cheers.
Moz Bar | | SEOisSEO0