403, 301, 302, 404 errors & possible google penalty
-
William Rock ran a Xenu site scan on
nlpca(dot)com
and mentioned the following:
...ran a test with Xenu site scan and it found a lot of broken links with 403, 301, 302, 404 Errors.
Other items found:
Broken page-local links (also named 'anchors', 'fragmentidentifiers'): http://www.nlpca.com/DCweb/Interesting_NLP_Sites.html#null anchor occurs multiple timeshttp://www.nlpca.com/DCweb/Interesting_NLP_Sites.html#US not found
Could somone give us an output of that list, and which ones of these errors do we need to clean up for SEO purposes?
Thank you.
-
Awesome, thanks Istvan and Andrea!
-
I agree - try Screaming Frog. I use it - and prefer it to Xenu - and it's free for up to 500 URLs or $99 for a license for unlimited. Even with a slower computer it can run in the background (leave it on overnight).
-
Hi Bob,
There is another tool which is developed for Mac too. It is called Screaming frog.
With that you can also check the website health just as with Xenu.
I hope it will be helpful.
Istvan
-
Hi Andrea,
I'm on a mac with a slow Windows Emulator. I was hoping someone could show me the URLs that need fixing seen by running the Xenu link test of
nlpca(dot)com
-
I can't quite follow - output from what?
Are you asking someone else to run a Xenu/Screaming frog of this URL (http://www.nlpca.com/DCweb/Interesting_NLP_Sites.html#null anchor occurs multiple timeshttp://www.nlpca.com/DCweb/Interesting_NLP_Sites.html#U) and give you feedback on what to fix (beyond the obvious that any 400 and 500 level errors should be tackled first)?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Soft 404s for unpublished & 301'd content
Hi, One site I work with unpublished a lot of thin content. Great idea, right? These unpublished pages were then 301'd up to the main category page that they previously existed in. Now Google Webmaster Tools calls them out as soft 404 errors. This seems unexpected since the pages were 301'd. Here is my question; Is this a serious problem that may affect the site's overall organic results and if so what should I do about it? Thanks... Darcy
Intermediate & Advanced SEO | | 945010 -
Dropped from Google?
My website www.weddingphotojournalist.co.uk appears to have been penalised by Google. I ranked fairly well for a number of venue related searches from my blog posts. Generally I'd find myself somewhere on page one or towards the top of page two. However recently I found I am nowhere to be seen for these venue searches. I still appear if I search for my name, business name and keywords in my domain name. A quick check of Yahoo and I found I am ranking very well, it is only Google who seem to have dropped me. I looked at Google webmaster tools and there are no messages or clues as to what has happened. However it does show my traffic dropping off a cliff edge on the 19th July from 850 impressions to around 60 to 70 per day. I haven't made any changes to my website recently and hadn't added any new content in July. I haven't added any new inbound links either, a search for inbound links does not show anything suspicious. Can anyone shed any light on why this might happen?
Intermediate & Advanced SEO | | weddingphotojournalist0 -
Does Google make continued attempts to crawl an old page one it has followed a 301 to the new page?
I am curious about this for a couple of reasons. We have all dealt with a site who switched platforms and didn't plan properly and now have 1,000's of crawl errors. Many of the developers I have talked to have stated very clearly that the HTacccess file should not be used for 1,000's of singe redirects. I figured If I only needed them in their temporarily it wouldn't be an issue. I am curious if once Google follows a 301 from an old page to a new page, will they stop crawling the old page?
Intermediate & Advanced SEO | | RossFruin0 -
Google Plus Authorship
Situation Description: I have a website called Website A. I wish to migrate alot of the content from Website A to Website B. Website B will be on a completely different domain name and environment. Authors of Website A will act as contributing authors for Website B. It is also possible that other contributing authors of other websites C and D commit to writing content on Website B. Questions (1) Does it make sense to create a google plus profile under UserA@websiteA.com and link from content on websiteB to their google plus profile under UserA@websiteA.com? (2) Does AuthorRank affect PageRank? If yes, if I take the above approach would websiteA be effected or websiteB since the content writers of websiteA are contributing to websiteB? (3) Is it ok for userA to have a corporate google plus profile assuming he might also have another google plus profile under a different address? I always think it make sense that there exists a google plus profile at an employee level and another google plus profile at a personal level. (4) If an employee leaves the company, do I leave his/hers Google Plus profile alive? The fact that no more content would be published under that particular profile, would that negatively effect author rank over time? (5) Another interesting observation is that UsaToday, CNN etc do not use authorship? No authors link to their twitter profile or google plus profile. Shouln't they be doing this in terms of author rank or is author rank not that important? Thank you
Intermediate & Advanced SEO | | seo12120 -
Robots.txt error message in Google Webmaster from a later date than the page was cached, how is that?
I have error messages in Google Webmaster that state that Googlebot encountered errors while attempting to access the robots.txt. The last date that this was reported was on December 25, 2012 (Merry Christmas), but the last cache date was November 16, 2012 (http://webcache.googleusercontent.com/search?q=cache%3Awww.etundra.com/robots.txt&ie=utf-8&oe=utf-8&aq=t&rls=org.mozilla:en-US:official&client=firefox-a). How could I get this error if the page hasn't been cached since November 16, 2012?
Intermediate & Advanced SEO | | eTundra0 -
301 Re-direct Implementation & Its Possible Aftermaths
Hi all, I'm currently working on a domain that seems to be 'unofficially' blacklisted by Google. The reason behind my belief are, Ranking process of KW became stagnant. Current crawling and indexing rate has been decreased. Site performance deteriorate after every Search engine update or major data refreshes. And few major indications pointing out that search engines might started doubting its authority. The site is live n running for about 10+ yr and consists of 6000+ pages out of which 5000+ pages are indexed. The site also have some serious issues like, The site has been 2 times penalized by Google. The link ratio & inbound link quality of the site is quite unnatural (mostly directory links, links form spammy sites, bad-neighborhood links etc. ) The site is in flat file and not CMS, thus making it extremely difficult to maintain and update it. Due to the above reasons I was thinking of implementing 301 re-direction. I would like to redirect this poor performing existing domain to a new fresh one keeping the URL structure and files same and maintaining 1:1 redirection rules. I've read an awesome article by Danny Dover on 301 Re direction of a site here in SEOMOZ. It seems that if any one follow the steps mentioned there can actually get benefited by the overall re direction process. Now I'd like know your suggestion about following points: 1. Considering the factors that I've stated, do you think that it would be good to go with this re direction idea? 2. If 301 is implemented then what can be its immediate effects on current rankings and site performance? 3. Assuming that the ranks drowned or gets completely vanished from SERP, after what approx time period can be regain back? 4. Any other suggestion that might help me out to better understand the situation.
Intermediate & Advanced SEO | | ITRIX0 -
Google Experiment
Hi there, are there any implications for organic seo for implementing google experiment. Where you send users to a new page?
Intermediate & Advanced SEO | | pauledwards0 -
Recovering from Programmers Error
Hey Everybody! Last year one of my bigger sites hit a snaffu. I was getting about 300k + hits a day from google, and then, when a developper released an update with a robots.txt file that basically blocked google from the entire site. We didn't notice the bug until a few days later, but by then, it was already too late. My google traffic dropped to 30k a day and I've been having the hardest time coming back ever since. As a matter of fact, hundreds of sites that were aggregating my content started outranking me for my own terms. For over a year, I've been working on building what I lost back and everything seemed to be coming together. I was back at 100k+ hits a day Until today... My developpers repeated the exact same error as last year. They blocked google from crawling my site for over 5 days and now I'm down to 10k se hits a day. My question : Has anyone encountered this problem before and what did you do to come back?
Intermediate & Advanced SEO | | CrakJason0