Why that many Crawl Diagnostics errors, false?
-
Hi,
my fist question, trying to understand how seomoz pro works.
I have about 680 crawl erros, but when I check the details, I found this:
1. many 403 errors ( I think from all links).
> I have tested my web site (telcelsolcom.com) in other tools and all says OK 200 response.
2. many title and content duplicates, but the system is showing as duplicated pages with and without the www.
> I have a 301 redirect from non www to with www and it is working ok.
Do I have false errors? What am I doing wrong?
thanks.
-
Thanks for your time Brent.
As far as I know I dont have any configuration that could block spiders. I have more sites in same sever without any issues, nothing special in .htaccess and some blocked directories in robots, thats it.
Actually google is indexing the web site very well (about 50% of urls submited two days ago).
I am sorry if next question sounds like blasphemy here in the comunity:
do these tools really works?
I dont want to expend time solving false errors. Also my free month is about to expire and would like to know it worth to pay next month.
-
Not really sure, but as I was trying to diagnose it, the site broke on me. Only after I sent my crawl tool to it.
So I am wondering if your server sees incoming spiders crawling, then blocks them. That would explain why both SEOmoz and my crawl tool came back with funny errors.
At first glance, I didn't see any issues. Not really sure.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Too many on-page links
Hi, I've apparently got too many on-page links on 79 of my webpages. The majority of these pages are category pages, like this: https://www.turnkeymortgages.co.uk/mortgage-advice/mortgages/... so, what's a person to do? Obviously the page would be useless without the links. Should I just ignore these 'errors'? Or is there something else I should do? I don't want to appear manipulative by labelling them nofollow... Thanks, Amelia
On-Page Optimization | | CommT0 -
What Next after Weekly Crawl Errors Fixed?
Hi MoZ Community! Moz weekly crawl used to report following errors : I have fixed them all over the time. Can somebody give an idea what to do next with the help of Moz or away from Moz to improve my optimization practices. I believe this is just start of the SEO. Or how is it if I focus link building efforts and start fighting for keywords. Also any suggestions about the web? Tanveer | Duplicate Page Content 4XX (Client Error) Title Missing or Empty 5XX (Server Error) Missing Meta Description Tag Duplicate Page Title Title Element Too Long (> 70 Characters) Title Element Too Short Meta Refresh Temporary Redirect |
On-Page Optimization | | Sequelmed0 -
Blocking Subdomain from Google Crawl and Index
Hey everybody, how is it going? I have a simple question, that i need answered. I have a main domain, lets call it domain.com. Recently our company will launch a series of promotions for which we will use cname subdomains, i.e try.domain.com, or buy.domain.com. They will serve a commercial objective, nothing more. What is the best way to block such domains from being indexed in Google, also from counting as a subdomain from the domain.com. Robots.txt, No-follow, etc? Hope to hear from you, Best Regards,
On-Page Optimization | | JesusD3 -
Full Crawl, now what?
Hi, Ok, I logged in this morning to see my full crawl of over 250 pages. I must admit I was expecting an email to inform me and to perhaps outline what my next steps should be. During the last 7 days I have fixed most of the pages that had errors and also added more keywords, just like what was suggested when I first signed up. So, is there a suggested plan of action I should now take to help increase the rankings, perhaps I'm missing this from the email or something? Thanks!
On-Page Optimization | | Pulsar0 -
Html and css errors - what do SE spiders do if they come across coding errors? Do they stop crawling the rest of the code below the error
I have a client who uses a template to build their websites (no problem with that) when I ran the site through w3c validator it threw up a number of errors, most of which where minor eg missing close tags and I suggested they fix them before I start their off site SEO campaigns. When I spoke to their web designer about the issues I was told that some of the errors where "just how its done" So if that's the case, but the validator still registers the error, do the SE spiders ignore them and move on, or does it penalize the site in some way?
On-Page Optimization | | pab10 -
The crawl diagnosis indicated that my domain www.mydomain.com is duplicate with www.mydomain.com/index.php. How can I correct this issue?
How can I fix this issue when crawl diagnosis indicated that my www.mydomain.com is duplicate with www.mydomain.com/index.php? That suppose to be the same page and not duplicate, right?
On-Page Optimization | | jsevilla0 -
On page report card 410 error
I have been trying to test my site through the on page report card using our primary keyword phrase, however, I keep getting the following error message: We were unable to grade that page. The page did not load. Got a 410 response code from server If I try the same search and keyword phrase on other sites, it does work. Am I doing something wrong?
On-Page Optimization | | duesoon0 -
Not making a change of the 100's in crawl Diagnostic
Based on the PRO crawl Diagnostics – if we don’t make a change on 1 page, does that just affect the SEO on that one page, or does it affect the SEO on all pages of the site? E.g. If we get a “Too many on page links” for a certain page that we don’t really want to rank for – does not fixing that particlaur page affect the site as a whole? Hope I explained this ok..
On-Page Optimization | | inhouseninja0