403, 301, 302, 404 errors & possible google penalty
-
William Rock ran a Xenu site scan on
nlpca(dot)com
and mentioned the following:
...ran a test with Xenu site scan and it found a lot of broken links with 403, 301, 302, 404 Errors.
Other items found:
Broken page-local links (also named 'anchors', 'fragmentidentifiers'): http://www.nlpca.com/DCweb/Interesting_NLP_Sites.html#null anchor occurs multiple timeshttp://www.nlpca.com/DCweb/Interesting_NLP_Sites.html#US not found
Could somone give us an output of that list, and which ones of these errors do we need to clean up for SEO purposes?
Thank you.
-
Awesome, thanks Istvan and Andrea!
-
I agree - try Screaming Frog. I use it - and prefer it to Xenu - and it's free for up to 500 URLs or $99 for a license for unlimited. Even with a slower computer it can run in the background (leave it on overnight).
-
Hi Bob,
There is another tool which is developed for Mac too. It is called Screaming frog.
With that you can also check the website health just as with Xenu.
I hope it will be helpful.
Istvan
-
Hi Andrea,
I'm on a mac with a slow Windows Emulator. I was hoping someone could show me the URLs that need fixing seen by running the Xenu link test of
nlpca(dot)com
-
I can't quite follow - output from what?
Are you asking someone else to run a Xenu/Screaming frog of this URL (http://www.nlpca.com/DCweb/Interesting_NLP_Sites.html#null anchor occurs multiple timeshttp://www.nlpca.com/DCweb/Interesting_NLP_Sites.html#U) and give you feedback on what to fix (beyond the obvious that any 400 and 500 level errors should be tackled first)?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
AMP for WordPress: To Do Or Not To Do
Hello SEO's, Recently some of my VIPs (Very Important Pages) have slipped, and all the pages above them are AMP. I've been waiting to switch to AMP for as long as possible bc I've heard it's a very mixed bag. As of Oct 2018, what do people think? Is it worth doing? Is there a preferred plugin for wordpress? Are things more likely to go right than wrong? The page that has gotten hit the hardest is https://humanfoodbar.com/plant-paradox-diet/plant-paradox-diet-full-shopping-list-for-lectin-free-diet/. It used to bring in ~70% of organic traffic. It was #1 and is now often near the bottom of the page. 😞 Thanks all! Remy
Intermediate & Advanced SEO | | remytennant1 -
Google Seeing 301 as 404
Hi all, We recently migrated a few small sites into one larger site and generally we had no problems. We read a lot of blogs before hand, 301'd the old links etc and we've been keeping an eye on any 404s. What we have found is that Webmaster is picking up quite a few 404s, yet when we investigate these 404s they are 301'd and work fine. This isn't for every url, but Google is finding more and I just want to catch any problems before they get out of hand. Is there any reason why Google would count a 301 as a 404? Thanks!
Intermediate & Advanced SEO | | HB170 -
Category 404 Error in Wordpress | Help!!!
Hello Gurus hope everyone is having a fantastic day. Right so I've been pulling my hair with this 404 error on links as such: htttp://manvanlondon.co.uk/category/clients/removals/man-and-van-wandsworth This link appears in the category page clients and the /removals/man-and-van-wandsworth part is the link that should take the user on the Man and Van Wandsworth page in the/ from the footer. However this link and all other links in the footer on these category pages/posts appear to be broken ONLY on this category pages, thus creating 404 errors. And those pages(i.e man and van Wandsworth) are not even categorized. The website is www.manvanlondon.co.uk . We tried various things on Wordpress and nothing is working including non-indexing. Has anyone met this problem before? Is there a way to fix it? Thank you for your time, and hope my explanations make sens. Monica
Intermediate & Advanced SEO | | monicapopa0 -
Algorithm Penalty?
I've read the FAQs and searched the help center. The URL in question is: http://goo.gl/9lGqxDSince this website was relaunched around the same time as the Panda algorithm update, it's dropped from the 1st page of results down to page 6 or lower. Essentially, this website no longer ranks well in the Google UK for relevant keywords to the business when combined with the place names in it's geographical operation areas.It's worth noting that the website ranks very well in other search search engines such as Bing! The website had a lot of spammy links which we've requested to be removed from the respective site owners. Most of which are either non-responsive or want extortionate amounts of money to remove the links so we have used Google disavow links tool. We suspect the site is being penalised as a result of the spammy inbound links something which is supported by the fact that only the new pages or pages with fresh content are ranking (http://goo.gl/D1NpxH). However, Google Webmaster tools reports no messages or critical issues.On the whole the website is updated occasionally. The writing is very easy to understand, it's quick to load, URLs are clear and the titles and descriptions are partly optimised.We're believe that our only option is to abandon the current domain and completely rewrite the content for a new domain. Does anyone else have any ideas how we can fix this before we go ahead?Many thanks, Ben
Intermediate & Advanced SEO | | chichesterdesign0 -
301 page into a 404
Hi I have a job board site and the way the site is built means that I cant 404 job pages once they have expired. To combat this Im looking to 301 the pages into a 404 page.Do any of you have any experience with this? Are there any potential pitfalls to doing a 404 this way? Thanks
Intermediate & Advanced SEO | | AndrewAkesson0 -
We are ignored by Google - what should we do?
Hi, We believe that our website - https://en.greatfire.org - is being all but ignored by Google Search. The following two examples illustrate our case. 1. Searching for “China listening in on Skype - Microsoft assumes you approve”. This is the title of a blog post that we wrote which received some 50,000 visits. On Yahoo and Bing search, we rank first for this search. On Google, however, we rank 7th. Each of the six pages ranking higher than us are quoting and linking to our story. 2. Searching for “Online Censorship In China”. This is the title of our front page. Yahoo and Bing both rank us third for this search. On Google, however, we are not even among the first 300 results. Two of the pages among the first 10 results link to us. Our website has an average of around 1000 visits per day. We are quoted in and linked from virtually all Western mainstream media (see https://en.greatfire.org/press). Yet to this day we are receiving almost no traffic from Google Search. Our mission is to bring transparency to online censorship in China. If people could find us in Google, it would greatly help to spread awareness of the extent of Internet restrictions here. If you could indicate to us what the cause of our poor rankings could be, we would be very grateful. Thank you for your time and consideration.
Intermediate & Advanced SEO | | GreatFire.org0 -
301 to 404
Hello Everybody, I've got a technical question about server responses. Imagine this scenario: www.domain.com/not-existing-page/ --> 404 & domain.com/not-existing-page/ --> www.domain.com/not-existing-page/ --> 404 I use Wordpress for my websites and I can't seem to be able to configure it (or the server where I have total control) to stop it doing this. Ideally, a non-existent url should return 404 instantly, not first redirect to the "corect" url and then return 404. Anyone experiencing this and can help? Here's a neat tool that allows you to quickly check server response codes - for those of you who are new to this: http://responsetester.appspot.com/ Much appreciated! Alex
Intermediate & Advanced SEO | | pwpaneuro1 -
New web site - 404 and 301
Hello, I have spent a lot of times on the forum trying to make sure how to deal with my client situation. I will tell you my understanding of the strategy to apply and I would appreciate if you could tell me if the strategy will be okay. CONTEXT I am working on a project where our client wants to replace its current web site with a new one. The current web site has at least 100 000 pages. The new web site will replace all the existing pages of the current site. What I have heard for the strategy the client wants to adopt is to 404 each pages and to 301 redirect each page. Every page would be redirect to a page that make sense in the new web site. But after reading other answers and reading the following comment, I am starting to be concerned: '(4) Be careful with a massive number of 301s. I would not 301 100s of pages at once. There's some evidence Google may view this as aggressive PR sculpting and devalue those 301s. In that case, I'd 301 selectively (based on page authority and back-links) and 404 the rest.' I have also read about performance issue ... QUESTION So, if we suppose that we can manage to map each of the old site pages to a page in the new web site, is a problem to do it? Do you see a performance issue or devaluation potential issue? If it is a problem, please comment the strategy I might considere to suggest: Identify the pages for which I gain links From that group, identify the pages, that gives me most of my juice 301 redirect them and for the other, create a real great 404 ... Thanks ! Nancy
Intermediate & Advanced SEO | | EnigmaSolution0