Error reports showing pages that don't exist on website
-
I have a website that is showing lots of errors (pages that cannot be found) in google webmaster tools. I went through the errors and re-directed the pages I could. There are a bunch of remaining pages that are not really pages this is why they are showing errors. What's strange is some of the URL's are showing feeds which these were never created. I went into Google webmaster tools and looked at the remove URL tool. I am using this but I am confused if I need to be selecting "remove page from search results and cache" option or should I be selecting this other option "remove directory" I am confused on the directory. I don't want to accidentally delete core pages of the site from the search engines.
Can anybody shed some light on this or recommend which I should be selecting?
Thank you
Wendy
-
I would avoid using the "remove URL" option in GWT. The 301s are more ideal in my opinion because let's say I have that old URL posted on my website somewhere, and now it's going to a 404 page. When you redirect it, people will be taken to a different page, and you don't have to worry about having me update the old URL on my website. The link will work, it will take you to an active page and can get you some traffic. However, the "remove URL" option won't give you this same benefit.
Here's a helpful link straight from the source on when NOT to use the Remove URL option: https://support.google.com/webmasters/answer/1269119?hl=en
-
Ok this sounds good because it's not exactly duplicate content so it would be better I agree to do the redirect. I downloaded a redirect plugin yesterday that worked pretty good. I noticed that some pages have already redirected people (the tool has an area to see this)
Final question for you, what are your thoughts on that "remove URL" option in Google Webmaster tools? Wasn't sure if that would be better than a 301 redirect for these remaining senseless errors.
Just curious on your thoughts.
Thank you
-
Rel=canonical is used more when you have duplicate content. If you have the same post or page in two areas, you can use the rel=canonical tag to tell Google where the original of the duplicate is. It sounds like you don't need rel=canonical in this situation.
It sounds like you have 80-something 404 Page Not Found errors. I would use the "Redirection" plugin with Wordpress. Take each URL that is giving you the 404 error in your report, and redirect each one to the most relevant page associated with what was supposed to be on the page that is giving the 404 error. If there really is no relevant page at all, I would just redirect it to the homepage. In my opinion, it's better to have it redirect to the homepage than to have the user land on a 404 page. I would do that for every 404 error you are getting. Doing this, I don't think you'll need rel=canonical at all.
-
Thank you for your reply. You are correct the site is in wordpress. The long story of this whole situation is this....I had initially built the client a wordpress site, things were fine with, traffic and business was good for him. Then one day one of his employees suggested that her father build him a new site that was more graphically pleasing (rather than saying can you please update the graphics on the current site) so the father built an entirely new site on Joomla (I didn't find this out until he was launching this new Joomla site) The guy also went and changed the domain to a www. the original site I had built had no www on it. Fast Forward.....I have re-built the site in wordpress, went back to the non www version. The errors I am getting I have 301 re-directed where I could. I have also in webmaster tools changed the site settings to the preferred domain.(the new site) I fetched all the new pages in Google. I have submitted new site maps. I'm down to 82 errors. The errors are showing pages that do not exist and to re-direct those pages I don't have pages that would really make sense to re-direct them to. I'm wondering now if I'm to a point where I need to "remove the URL's" as offered in Google webmaster tools...??? What do you think on this?
As for the rel-canonical....I understand why I would use these. I see in the Yoast plug in where I can insert the rel-canonical. My question is this:Do I insert the rel-canonical on the page that is correct? So I go to my correct website (the non www one) and go to that page that is correct and I prefer the engines index that page and insert the rel-canonical on that page that is the preferred one? Or am I to go to the non preferred page and insert the rel-canonical on that page so when search engines see that wrong page they see the rel-canonical tag showing them the correct page to index? I looked at a video by Matt Cutts and I wasn't clear on which page I put the rel-canonical on (old site or new one?) I don't have access to the old site so this is why I was thinking maybe just "remove the URL's" as offered up in webmaster tools.
Your input? I really appreciate your help. Thank you
-
For me personally, on Wordpress I use the Yoast SEO tool and I went through the tutorial on the Yoast website. He shows you how to eliminate a lot of the duplicate content that automatically gets created with all Wordpress websites. Once you noindex and get rid of all the unnecessary archives and all that, at that point I would recommend going back to the error report and see the difference and see if those pages keep coming up. If they do, just simply 301 redirect them to another page on your website. Then check again after you redirect them and see what you're left with. Sometimes it takes a couple weeks to reflect from what I've seen. Not sure if this is the exact issue you're having, or if you're even using Wordpress at all, but it sounds like if you are this might help you as it helped me get my errors down to zero.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why some websites can rank the keywords they don't have in the page?
Hello guys, Yesterday, I used SEMrush to search for the keyword "branding agency" to see the SERP. The Liquidagency ranks 5th on the first page. So I went to their homepage but saw no exact keywords "branding agency", even in the page source. Also, I didn't see "branding agency" as a top anchor text in the external links to the page (from the report of SEMrush). I am an SEO newbie, can someone explain this to me, please? Thank you.
Intermediate & Advanced SEO | | Raymondlee0 -
Can't diagnose this 404 error
Hi Moz community I have started receiving a load of 404 errors that look like this: This page: http://paulminors.com/blog/page/5/ is linking to: http://paulminors.com/category/podcast/paulminors.com which is a broken link. This is happening with a load of other pages as well. It seems that "paulminors.com" is being added to the end of the linking pages URL.I'm using Wordpress and the SEO by Yoast plugin. I have searched for this link in the source of the linking page but can't find it, so I'm struggling to diagnose the problem. Does anyone have any ideas on what could be causing this? Thanks in advance Paul
Intermediate & Advanced SEO | | kevinliao0 -
When I type link:mydomainname.com in Google I don't see any result, why?
My other website is 4 years old and Page Rank 3. We are into business of design and development for 5 years and still we don't have any result from Google Searches. When I type link:mydomainname.com I don't get any result. What's the reason?
Intermediate & Advanced SEO | | vikaspooja1 -
Google isn't seeing the content but it is still indexing the webpage
When I fetch my website page using GWT this is what I receive. HTTP/1.1 301 Moved Permanently
Intermediate & Advanced SEO | | jacobfy
X-Pantheon-Styx-Hostname: styx1560bba9.chios.panth.io
server: nginx
content-type: text/html
location: https://www.inscopix.com/
x-pantheon-endpoint: 4ac0249e-9a7a-4fd6-81fc-a7170812c4d6
Cache-Control: public, max-age=86400
Content-Length: 0
Accept-Ranges: bytes
Date: Fri, 14 Mar 2014 16:29:38 GMT
X-Varnish: 2640682369 2640432361
Age: 326
Via: 1.1 varnish
Connection: keep-alive What I used to get is this: HTTP/1.1 200 OK
Date: Thu, 11 Apr 2013 16:00:24 GMT
Server: Apache/2.2.23 (Amazon)
X-Powered-By: PHP/5.3.18
Expires: Sun, 19 Nov 1978 05:00:00 GMT
Last-Modified: Thu, 11 Apr 2013 16:00:24 +0000
Cache-Control: no-cache, must-revalidate, post-check=0, pre-check=0
ETag: "1365696024"
Content-Language: en
Link: ; rel="canonical",; rel="shortlink"
X-Generator: Drupal 7 (http://drupal.org)
Connection: close
Transfer-Encoding: chunked
Content-Type: text/html; charset=utf-8 xmlns:content="http://purl.org/rss/1.0/modules/content/"
xmlns:dc="http://purl.org/dc/terms/"
xmlns:foaf="http://xmlns.com/foaf/0.1/"
xmlns:og="http://ogp.me/ns#"
xmlns:rdfs="http://www.w3.org/2000/01/rdf-schema#"
xmlns:sioc="http://rdfs.org/sioc/ns#"
xmlns:sioct="http://rdfs.org/sioc/types#"
xmlns:skos="http://www.w3.org/2004/02/skos/core#"
xmlns:xsd="http://www.w3.org/2001/XMLSchema#"> <title>Inscopix | In vivo rodent brain imaging</title>0 -
Most recent blog post isn't being indexed?
http://www.howlatthemoon.com/dueling_piano_bar/kids-activities-denver/ Even if I put the URL into Google it doesn't show up....
Intermediate & Advanced SEO | | howlusa0 -
MOZ crawl report says category pages blocked by meta robots but theyr'e not?
I've just run a SEOMOZ crawl report and it tells me that the category pages on my site such as http://www.top-10-dating-reviews.com/category/online-dating/ are blocked by meta robots and have the meta robots tag noindex,follow. This was the case a couple of days ago as I run wordpress and am using the SEO Category updater plugin. By default it appears it makes categories noindex, follow. Therefore I edited the plugin so that the default was index, follow as I want google to index the category pages so that I can build links to them. When I open the page in a browser and view source the tags show as index, follow which adds up. Why then is the SEOMOZ report telling me they are still noindex,follow? Presumably the crawl is in real time and should pick up the new follow tag or is it perhaps because its using data from an old crawl? As yet these pages aren't indexed by google. Any help is much appreciated! Thanks Sam.
Intermediate & Advanced SEO | | SamCUK0 -
Meeting Google's needs 100% with dynamic pages
We have bought into a really powerful search, very exciting We can define really detailed product based 'landing pages' by creating a search that pulles on required attributeseghttp://www.OURDOMAIN.com//search/index.php?sortprice=asc&followSearch=9673&q=red+coats+short-length Pop that in a link Short Red Coats on a previous page and wonderful, that gives a page of short red coats in price ascending order, one happy consumer, straight to a page that meets their needs Question 1 however unhappy Google right? Question 2 can we meet Google's needs 100% with a redirect permanent in an .htaccess file E.G redirect permanent /short-red-coats/ http://www.OURDOMAIN.com//search/index.php?sortprice=asc&followSearch=9673&q=red+coats+short-length
Intermediate & Advanced SEO | | GeezerG
Many thanks
CB0 -
Can't find my site on Bing, since ages
Hi Guys, Well, the problem seems normal but I guess it's not. I have tried many things, and nothing changed it, now I give it last try... ask so maybe you will help me. The problem is.. I can't find my site nowhere in Bing, I mean nowhere by not in first 20 pages for my keywords "beauty tips" and the site is: http://www.beauty-tips.net/. In my opinion it should be pretty high... maybe it's too high so I can't see it ;). I never had special problems with Bing, was easier to be there "somewhere" than in google, but with this one is totally opposite. Any ideas? Thanks for your time!
Intermediate & Advanced SEO | | Luke220