Cleaning WP theme 404s in GSC
-
I'm trying to clean all of the Crawl Errors for my sites, and I've reached the point where I've become slightly confused. A lot of these pages that come up in Crawl Errors aren't being linked to anywhere. The ones I'm referring to are mostly pages that came with a theme that I'm using - part of the demo content - which I've since set to Unpublished Drafts. I'm not linking to these pages anywhere on any of my Published pages, yet Google is still looking for them, still showing them in Crawl Errors as Not Found.
I'm assuming that Google found these pages at some point and can't find them now. I'm not sure if I'm supposed to keep setting up 301 redirects for these, or should I use the Disavow tool for these pages? I want to tell Google to forget these pages completely because I never intended for these pages to be indexed.
This happens for just about all of my Wordpress websites in Google Search Console. Can someone please shed some light on this? If there are any articles on this problem, please share! Thanks!
-
Hey Trenton
Do the pages in fact return a 404 code now? You can check with http://urivalet.com/ set to Googlebot. Are they indexed in Google? search for the URL and put 'site:' before it. If they 404 and are indexed, it will just take time for them to drop out. Google continues to crawl pages they had once discovered, but are not linked to anymore, and these will definitely show up in your crawl errors. Pages with crawl errors are actually a good thing if that's what you expect and intended which in this case, it was I know it stinks to have errors showing up in the report, when in fact they are not really errors you have to "fix", but just think of it more like a report, and some pages it's perfectly OK to have 404'ing.
-
Couple of thing as one who deals with 1,000+ 404s in Google Search Console at any one time and also dealt with leaky CMS systems.
A) Dealing with 404s in Google search console
-
Small thing, if these pages are gone and 404 and will not come back, consider showing a 410 (permanent gone) vs a 404, but either will work.
-
Make sure you have a useful 404 page when people land there so that they can go somewhere else if they need.
-
VERY IMPORTANT - DO NOT mark a 404 as "fixed" in Google Search Console, if the page is supposed to 404.
Why? Because if the 404 is fixed, then Google will expect to see a 200/ok response! It will then say, "Oh, the webmaster said this was fixed, but I still see the 404 so I will put it back in the 404 report to help this webmaster." You will then see the 404 show back up in your console after you removed it and then you start that weird eye twitch that you get when you start to stress. In fact, I have found if I ever marked a page that is supposed to 404 as "fixed" it takes it that much longer to get out of the 404 report.
What search console needs is a way to mark a 404 in the crawl report and say, "Yep, I see it and it is supposed to 404" in addition to the "Fixed" option.
Rule of thumb, if the page is supposed to 404 let it 404 and just ignore it in the crawl errors of Google webmaster tools / search console. You do not need to "fix" anything. The 404s will drop out after about 3 months. I just check the 404s and then sort by date to see the newest. If they are supposed to 404 (see point below) I leave them alone and don't stress.
All the other stuff about removing URLs is usually a waste of time. Just let Google do its work.
If you don't believe me, just ask Google
http://googlewebmastercentral.blogspot.com/2011/05/do-404s-hurt-my-site.html "If some URLs on your site 404, this fact alone does not hurt you or count against you in Google’s search results."
https://www.seroundtable.com/google-panda-404-20738.html "Google's Gary Illyes responded in short to a Google Panda question, asking if having 404ed pages have an impact on the overall Google Panda algorithm. Gary said on Twitter, "nope," it does not.
https://support.google.com/webmasters/answer/2409439?hl=en Google's webmaster docs _"_Generally, 404 errors don’t impact your site’s ranking in Google, and you can safely ignore them."
All of the above assumes that these are pages that are supposed to 404. In other words, they are pages that you did not try to use for ranking, etc. If these were important pages, like home pages or landing pages, then sure a 404 is bad it would negatively impact ranking of those pages. Good pages you want to fix, yes. Bad pages, just let them die and remove links to them as well for a good user experience.
B) Dealing with leaky CMS systems
I know this may not be your case right now, but it seems to have been before and so wanted to toss this out there as well. Somewhere, there is (or was) a link to these drafts you mention that are out in the public. You need to search Google, look through Moz or Majestic or use Screaming Frog to find how these drafts got linked to. If you look in search console, you should be able to click the 404 errors and see where they are linked from as a clue.
Until you fix the leak, you will end up with wet shoes every time. Here is an example of where a person was using custom code to display posts, and the code was showing draft posts by accident: https://wordpress.org/support/topic/draft-posts-showing-up-in-recent-posts-feed
Hope this helps!
-
-
Here is the article I was referring to: https://support.google.com/webmasters/answer/1269119?hl=en
-
I should've said the "Remove URLs" tool instead of the Disavow Tool. Yes, Disavow Tool is to disavow incoming links that you don't want. The Remove URL tool is to remove content from Google, but I went through their little page about how to use the Remove URL tool and it says don't use it to get rid of content that doesn't exist anymore, and that Google will naturally find it. Well, how long does that take? Months? And what happens if I do use it? Ugh, this is very annoying as it is affecting a lot of my websites, and I don't know how much of an impact these Crawl Errors actually have on my site. Again, I understand the value of links that people are actually linking to, but this is more like hidden content that Google found, which I've gotten rid of, but they're still looking for it. Any help is appreciated.
-
The pages exist, but they are unpublished drafts, not accessible to the public. I have marked them as fixed and they keep popping up.
I've checked the site and I'm not linking to them on any of the pages that are live. It just seems like before I marked them as drafts, Google spotted them and is still looking for them. They were never in any sitemap I've submitted before, so I'm confused by this. I've also opened up a thread in the past regarding why some 404 crawl errors come up for desktop, and why different ones come up under Smartphone.
-
Also to mention this but you can't disavow your own pages, as it's a feature that is mostly used to 'remove' backlinks for outside root domains.
-
Hi!
As long as they arent live anymore on your site, just mark them as fixed in search console.
Just double check/crawl your site to make sure non of them really exist anywhere
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does a similar CMS fabric/theme used by 2 colleagues, cause SEO issues?
Does using the same CMS fabric/theme with substantially different content for each website but the same business address (on google places and the websites) cause SEO issues? For example: 2 colleagues with somewhat similar services located at the same business addresses desire to use the same CMS fabric /theme but will have different content on the sites. Will this hurt their SEO / should they use a different website skin/theme?
Web Design | | toti5880 -
Best Practices-Optimize Theme Before Coding or After Coding?
We purchased a Wordpress Real estate theme called wpcasa. My developer started coding it. We hired a new SEO. The SEO looked at a simple page (About Us) and saw about 70 Java scripts and 11 templates and was very dissatisfied with the coding and heavy source code contained in the theme. My SEO claims the optimizing this theme (removing the unnecessary Java Scripts and combining the templates is way too much work and that it would be better to start from scratch and purchase a theme like https://my.studiopress.com/themes/agentpress/ with more compact, efficient and streamlined code. Problem is we need to throw out 2 months and thousands of dollars worth of code. My SEO says that in the day of Google's "mobile first" streamlined code is particularly important. My developer has taken the position that the code can be cleaned up after the design. Where it seems my SEO wants clean code to stat with. I don't know who to is right. Any ideas? Am I better of starting from scratch with a new more efficient theme, or cleaning up the code on the wpcasa theme? The code for the test page is below. Thanks! | |
Web Design | | Kingalan1
| | lang="en-US" prefix="og: http://ogp.me/ns#"> |
| | |
| | charset="UTF-8"> |
| | http-equiv="X-UA-Compatible" content="IE=edge"> |
| | name="viewport" content="width=device-width, initial-scale=1"> |
| | rel="profile" href="http://gmpg.org/xfn/11"> |
| | rel="pingback" href="http://dev.metro-manhattan.com/xmlrpc.php"> |
| | |
| | <title></span>About Metro Manhattan - Metro Manhattan Office Space<span class="html-tag"></title> |
| | |
| | |
| | |
| | name="description" content="New York City real estate brokerage service helps business tenants acquire office, commercial loft, retail or showroom space anywhere in Manhattan."/> |
| | name="robots" content="noindex,follow"/> |
| | property="og:locale" content="en_US" /> |
| | property="og:type" content="article" /> |
| | property="og:title" content="About Metro Manhattan - Metro Manhattan Office Space" /> |
| | property="og:description" content="New York City real estate brokerage service helps business tenants acquire office, commercial loft, retail or showroom space anywhere in Manhattan." /> |
| | property="og:url" content="http://dev.metro-manhattan.com/about-us/" /> |
| | property="og:site_name" content="Metro Manhattan Office Space" /> |
| | name="twitter:card" content="summary_large_image" /> |
| | name="twitter:description" content="New York City real estate brokerage service helps business tenants acquire office, commercial loft, retail or showroom space anywhere in Manhattan." /> |
| | name="twitter:title" content="About Metro Manhattan - Metro Manhattan Office Space" /> |
| | name="twitter:image" content="http://dev.metro-manhattan.com/wp-content/uploads/2018/07/process-01.png" /> |
| | |
| | |
| | rel='dns-prefetch' href='//maps.googleapis.com' /> |
| | rel='dns-prefetch' href='//maxcdn.bootstrapcdn.com' /> |
| | rel='dns-prefetch' href='//fonts.googleapis.com' /> |
| | rel='dns-prefetch' href='//s.w.org' /> |
| | rel="alternate" type="application/rss+xml" title="Metro Manhattan Office Space » Feed" href="http://dev.metro-manhattan.com/feed/" /> |
| | rel="alternate" type="application/rss+xml" title="Metro Manhattan Office Space » Comments Feed" href="http://dev.metro-manhattan.com/comments/feed/" /> |
| | rel="alternate" type="application/rss+xml" title="Metro Manhattan Office Space » About Metro Manhattan Comments Feed" href="http://dev.metro-manhattan.com/about-us/feed/" /> |
| | |
| | |
| | rel='stylesheet' id='font-awesome-css' href='http://dev.metro-manhattan.com/wp-content/plugins/menu-icons/vendor/kucrut/icon-picker/css/types/font-awesome.min.css?ver=4.7.0' type='text/css' media='all' /> |
| | rel='stylesheet' id='menu-icons-extra-css' href='http://dev.metro-manhattan.com/wp-content/plugins/menu-icons/css/extra.min.css?ver=0.11.2' type='text/css' media='all' /> |
| | rel='stylesheet' id='contact-form-7-bootstrap-style-css' href='http://dev.metro-manhattan.com/wp-content/plugins/bootstrap-for-contact-form-7/assets/dist/css/style.min.css?ver=4.9.5' type='text/css' media='all' /> |
| | rel='stylesheet' id='wpsight-favorites-css' href='http://dev.metro-manhattan.com/wp-content/plugins/wpcasa-favorites/assets/css/wpsight-favorites.min.css?ver=4.9.5' type='text/css' media='all' /> |
| | rel='stylesheet' id='wpsight-listing-labels-css' href='http://dev.metro-manhattan.com/wp-content/plugins/wpcasa-listing-labels/assets/css/wpsight-listing-labels.min.css?ver=4.9.5' type='text/css' media='all' /> |
| | rel='stylesheet' id='wpsight-listings-map-css' href='http://dev.metro-manhattan.com/wp-content/plugins/wpcasa-listings-map/assets/css/wpsight-listings-map.min.css?ver=4.9.5' type='text/css' media='all' /> |
| | rel='stylesheet' id='wpfront-notification-bar-css' href='http://dev.metro-manhattan.com/wp-content/plugins/wpfront-notification-bar/css/wpfront-notification-bar.css?ver=1.7' type='text/css' media='all' /> |
| | rel='stylesheet' id='wpfront-scroll-top-css' href='http://dev.metro-manhattan.com/wp-content/plugins/wpfront-scroll-top/css/wpfront-scroll-top.min.css?ver=2.0.1' type='text/css' media='all' /> |
| | rel='stylesheet' id='chld_thm_cfg_parent-css' href='http://dev.metro-manhattan.com/wp-content/themes/wpcasa-london/style.css?ver=4.9.5' type='text/css' media='all' /> |
| | rel='stylesheet' id='fontawesome.min.css-css' href='http://dev.metro-manhattan.com/wp-content/themes/wpcasa-london-child/assets/css/fontawesome.min.css?ver=4.9.5' type='text/css' media='all' /> |
| | rel='stylesheet' id='load-fa-css' href='https://maxcdn.bootstrapcdn.com/font-awesome/4.1.0/css/font-awesome.min.css?ver=4.9.5' type='text/css' media='all' /> |
| | rel='stylesheet' id='wpcasa-london-css' href='http://dev.metro-manhattan.com/wp-content/themes/wpcasa-london-child/style.css?ver=4.9.5' type='text/css' media='all' /> |
| | rel='stylesheet' id='bootstrap-css' href='http://dev.metro-manhattan.com/wp-content/themes/wpcasa-london/vendor/twbs/bootstrap/css/bootstrap.css?ver=3.3.6' type='text/css' media='all' /> |
| | rel='stylesheet' id='bootstrap-dropdownhover-css' href='http://dev.metro-manhattan.com/wp-content/themes/wpcasa-london/vendor/kybarg/bootstrap-dropdown-hover/css/bootstrap-dropdownhover.min.css?ver=1.0.0' type='text/css' media='all' /> |
| | rel='stylesheet' id='bootstrap-select-css' href='http://dev.metro-manhattan.com/wp-content/themes/wpcasa-london/vendor/silviomoreto/bootstrap-select/css/bootstrap-select.min.css?ver=1.10.0' type='text/css' media='all' /> |
| | rel='stylesheet' id='awesome-bootstrap-checkbox-css' href='http://dev.metro-manhattan.com/wp-content/themes/wpcasa-london/vendor/flatlogic/awesome-bootstrap-checkbox/awesome-bootstrap-checkbox.min.css?ver=0.3.7' type='text/css' media='all' /> |
| | rel='stylesheet' id='pushy-css' href='http://dev.metro-manhattan.com/wp-content/themes/wpcasa-london/assets/css/pushy.css?ver=1.2.1' type='text/css' media='all' /> |
| | rel='stylesheet' id='lightslider-css' href='http://dev.metro-manhattan.com/wp-content/themes/wpcasa-london/vendor/sachinchoolur/lightslider/css/lightslider.min.css?ver=1.1.5' type='text/css' media='all' /> |
| | rel='stylesheet' id='lightgallery-css' href='http://dev.metro-manhattan.com/wp-content/themes/wpcasa-london/vendor/sachinchoolur/lightgallery/css/lightgallery.min.css?ver=1.2.15' type='text/css' media='all' /> |
| | rel='stylesheet' id='animate-css' href='http://dev.metro-manhattan.com/wp-content/themes/wpcasa-london/assets/css/animate.min.css?ver=1.2.1' type='text/css' media='all' /> |
| | rel='stylesheet' id='dashicons-css' href='http://dev.metro-manhattan.com/wp-includes/css/dashicons.min.css?ver=4.9.5' type='text/css' media='all' /> |
| | rel='stylesheet' id='google-fonts-css' href='//fonts.googleapis.com/css?family=Lato:700,400|Raleway:400,300&subset=latin' type='text/css' media='all' /> |
| | rel='stylesheet' id='wpmtst-custom-style-css' href='http://dev.metro-manhattan.com/wp-content/plugins/strong-testimonials/public/css/custom.css?ver=4.9.5' type='text/css' media='all' /> |
| | rel='stylesheet' id='zcffront-jquery-ui-css' href='http://dev.metro-manhattan.com/wp-content/plugins/zoho-crm-forms/assets/css/jquery-ui.css?ver=4.9.5' type='text/css' media='all' /> |
| | rel='stylesheet' id='zcffront-end-styles-css' href='http://dev.metro-manhattan.com/wp-content/plugins/zoho-crm-forms/assets/css/frontendstyles.css?ver=4.9.5' type='text/css' media='all' /> |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | rel='https://api.w.org/' href='http://dev.metro-manhattan.com/wp-json/' /> |
| | rel="EditURI" type="application/rsd+xml" title="RSD" href="http://dev.metro-manhattan.com/xmlrpc.php?rsd" /> |
| | rel="wlwmanifest" type="application/wlwmanifest+xml" href="http://dev.metro-manhattan.com/wp-includes/wlwmanifest.xml" /> |
| | name="generator" content="WordPress 4.9.5" /> |
| | rel='shortlink' href='http://dev.metro-manhattan.com/?p=3800' /> |
| | rel="alternate" type="application/json+oembed" href="http://dev.metro-manhattan.com/wp-json/oembed/1.0/embed?url=http%3A%2F%2Fdev.metro-manhattan.com%2Fabout-us%2F" /> |
| | rel="alternate" type="text/xml+oembed" href="http://dev.metro-manhattan.com/wp-json/oembed/1.0/embed?url=http%3A%2F%2Fdev.metro-manhattan.com%2Fabout-us%2F&format=xml" /> |
| | |
| | |
| | |
| | |
| | |
| | |
| | |
| | rel="icon" href="http://dev.metro-manhattan.com/wp-content/uploads/2018/06/metromanhattan_icon-75x75.png" sizes="32x32" /> |
| | rel="icon" href="http://dev.metro-manhattan.com/wp-content/uploads/2018/06/metromanhattan_icon.png" sizes="192x192" /> |
| | rel="apple-touch-icon-precomposed" href="http://dev.metro-manhattan.com/wp-content/uploads/2018/06/metromanhattan_icon.png" /> |
| | name="msapplication-TileImage" content="http://dev.metro-manhattan.com/wp-content/uploads/2018/06/metromanhattan_icon.png" /> |
| | |
| | |
| | |
| | |
| | |
| | class="page-template page-template-page-tpl-about page-template-page-tpl-about-php page page-id-3800 page-parent custom-background wpsight-london" itemscope itemtype="http://schema.org/WebPage"> |
| | |
| | |
| | id="top" class="site-wrapper"> |
| | |
| | |
| | class="header-widgets"> |
| | |
| | class="header-full-width"> |
| | id="section-wpsight_london_listings_search-2" class="widget-section section-widget_listings_search">id="wpsight_london_listings_search-2" class="widget widget_listings_search"> <form <span="" class="html-attribute-name">method="get" action="http://dev.metro-manhattan.com/search/" class="wpsight-listings-search horizontal"></form> |
| | |
| | class="listings-search-default"> |
| | class="row gutter-30"> |
| | class="listings-search-field listings-search-field-text listings-search-field-keyword col-xs-12 col-sm-9"> |
| | class="listing-search-keyword text form-control" title="Keyword or Listing ID…" name=" |0 -
On-page SEO opinion on this Wordpress theme
Hi everyone. As an SEO agency we've been moving more toward genesis themes, however we have a client who really wants to redesign his website using the following theme: http://themeforest.net/item/this-way-wp-full-videoimage-background-with-audio/943634 - the theme would be images with no audio on the homepage. He is a remodeling contractor and likes the design and functionality of the theme. I'd like to get others feedback and opinions on what you think about the on-page SEO of this theme? Thanks.
Web Design | | WillWatrous0 -
Are jobsite themes harder to optimize than say a traditional website?
Until recently I have enjoyed a great deal of success with SEO on my websites and clients websites. SEO is more of a hobby than a profession for me however I am really struggling with my latest website www.securityjobsuk.co.uk - The keywords are easy, 1. security jobs and 2. security vacancies. The site has vanished off radar completely since I used the jobify theme. Has anyone had similar experience with job boards? Do they require more TLC / expert attention?
Web Design | | SJUK0 -
Online Catalog (E-commerce like) Wordpress Themes?
I'm currently looking for a Wordpress theme similar to e-commerce/shopping websites like ebay. I'm planning to put up a buy and sell site for shoes where people can upload shoe listings on their own.. The site we're planning doesn't have a buy/checkout button and paypal integration so it will look like more of an online catalog and not a shopping cart. We will just add a contact number/email in the product listing so a buyer can contact and personally meet the seller. Let me know if this can be done in Wordpress + e-commerce plugins. I would also like to know if there's a WP plugin that will allow users to use Facebook or Twitter to login/sign up in our website/platform. Let me know if this is possible in Wordpress by installing a plugin. Thanks in advance!
Web Design | | esiow20130 -
Best Wordpress Themes or Theme Creators for Best SEO Results
Hi, I just recently joined SEOMOZ and am excited to be apart of the community. I am launching a blog to educate mu readers on a variety of topics. Is there any specific themes or theme creators that do a great job at structuring their themes from a technical perspective for the best SEO results? Thanks!
Web Design | | ROYINOW0 -
Do I need to redirect soft 404s that I got from Google Webmaster Tools?
Hi guys, I got almost 1000+ soft 404s from GWT. All of the soft 404s produce 200 HTTP status code but the URLs are something like the following: http://www.example.com/search/house-for-rent (query used: house for rent) http://www.example.com/search/-----------rent (query used:-------rent) There are no listings that match these queries and there is an advanced search that is visible in these pages. Here are my questions: 1. Do I need to redirect each page to its appropriate landing page? 2. Do I need to add user sitemap or a list of URLs where they can search for other properties? Any suggestions would help. 🙂
Web Design | | esiow20130 -
Anyone Know Of A WP Plugin for Before and After Pictures
Hey Mozzers- Does anyone know of a good WordPress Plugin for displaying before and after images. This could be for a docs office, etc. Any feedback would be great! Thanks!
Web Design | | kpeacy0