Please Help! Crawl & Site Errors - Will This Impact My SEO?
-
Hello Moz,
I need urgent help. I remove a tonne of product pages and put everything into one product page to deal with duplicate content. I thought this was a good thing to do until I got an email from Google saying:
"Googlebot identified a significant increase in the number of URLs on ****.com that return a 404 (not found) error. "
I checked it out and found the problem:
4 Soft 404's
41 Not Found'sWhat do I need to do to fix this? Is it a problem or should I just ignore? I removed all the pages on WordPress but I need to do it somehow manually through Google?
I have worked so hard on my SERP's that this will destroy me if I'm penalised. Please can someone advise?
-
First of all - don't stress out! You won't be penalized for broken links. Google penalizes for shady behavior, not honest mistakes.
Like Andrew said, make sure that you aren't linking to any of the pages you removed from your site, and that you've removed them from your XML sitemap.
Then you should be good!
Good luck,
Kristina
-
Don't stress everything is OK.
When google indexes your site it makes its own URL list. 404s in search console are just google saying 'hey I checked for this page from my list and it's gone'
Well that's fine. You deleted it so you already know it's gone. Google will keep checling for this page a few more times then it will deindex it. It just doesn't want to deindex without fair warning.
If these pages are still getting traffic however I would 301 them to a relevant page to maintain user experience.
Finally, if these pages targeted keywords you want to rank for. You will loose these rankings if you don't target them elsewhere.
-
I do yes but I must know how to deal with Google now as I am so stressed!
I thought deleting the pages would be fine? I don't understand what further I must do? Once you delete a page must you tell Google you have done so?
I only got the email yesterday so I assume I have sometime left to fix?
-
Do you have a decent 404 page? Does this facilitate further browsing.
Internal links that 404 will leak page rank. So you need to fix any internal 404s. Google says 404s in search console are not damaging but many people including myself see traffic bumps from resolving these with a 301.
Have you seen any drop in traffic or rankings.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Will adding /blog/ to my urls affect SEO rankings?
Following advice from an external SEO agency I removed /blog/ from our permalinks late last year. The logic was that it a) doesn't help SEO and b) reduces the character count for the slug. Both points make sense. However, it makes segmenting blog posts from other content in Google Analytics impossible. If I were to add /blog/ back into my URLs, and redirected the permalinks, would it harm my rankings? Thanks!
Technical SEO | | GerardAdlum0 -
Help! added WWW to wordpress site and now lost SEO ranking
Hi there Everyone! I have recently added a www to my wordpress website by going to settings>general and adding "www" to the wordpress address and the site address. After i did that i lost my SEO ranking, and also that MOZ is detecting that im getting site crawl issues stating that i have duplicate pages. an example is below: http://www.mefco.co.nz/news http://mefco.co.nz/news any ideas on how to fix this?
Technical SEO | | jfactor0 -
Site Category structure detrimental to SEO?
Hi Guys, I am hoping that you may be able to help with an internal debate on whether our currently category structuring could be damaging from an SEO point of view. Our site sells t shirts primarily and as such we have a large product base of around 7000+ products. Our category structure currently works like so: Mens/T-Shirts/Movie&TV/TV/ Which I think is fairly typical, though this where it gets interesting, within this end category of "/TV/" there are around 120 categories that are used from a filtration point of view to contain items for each specific show etc, IE Mens/T-Shirts/Movie&TV/TV/Breaking_Bad, Mens/T-Shirts/Movie&TV/TV/Game_of_Thrones. The vast majority of these categories have between 1 and 3 products within them and the rest higher. Multiply this by the large amount of categories that we have on site and these end level "Band Title" categories amount to around 13,000+ categories in the directory. If at this point we put the filtration element aside, what is the communities opinion of the benefits or drawbacks of having the category structure like this? Thanks in advance for any feedback.
Technical SEO | | timsilver0 -
Help Crawl friendliness for large site
After watching Rand's video I am trying to think of the best way to make my large site more crawl friendly. Background I have a large site with over 100k product skus and so when you get to a particular page of products there are tons of different refinements and options that help you sort the products. Most of these are noindex followed, but I was wondering if I should be nofollowing the internal links as well in order to keep bots out of those pages and going to the pages that I want them to go too. Is this a good way to handle it? Also, does anyone have good recommendations of links to posts that deal with helping the crawl friendliness of a large site? Thanks!
Technical SEO | | Gordian0 -
What is the best way to refresh a webpage of a news site, SEO wise?
Hello all, we have a client which is a sports website. In fact it is a veyr big website and has a huge number of news per day. This is mostly the reason why it refreshes some of its pages with news list every 420 seconds. We currently use meta refresh. I have read here and elsewhere that meta refreshes should be avoided. But we don't do it to send to another page and pass any kind of page authority / juice. Is in this case javascript refresh better? Is there any other better way. What do you think & suggest? Thank you!
Technical SEO | | pkontopoulos0 -
Help us define a category/product structure please
Hi, Apologies in advance for the long winded question... we need some guidance with our category/product/options structure in our shop. We primarily sell car parts and lots of our parts have multiple fitments for what is basically the same part. Some ranges can have 1,000s of products. We can't work out what is an appropriate level of information and granularity for our product structure.We recognise the importance of having fitments and specific terms in the product title and URL, but we also know that having loads of almost identical product pages is a definite negative and fragments our SEO potential. But where's the happy medium? For example, let's say we have a specific brand of brake pad (we'll call it Brako) with 4 different product-models (Super1, Super2, Super3, Super4), each fits 100 different cars, which are made by 10 different manufacturers. We have a few different ways of presenting/splitting up these 400 simple products: (ignore the URLs here, this is just to illustrate the browsing structure & likely product page titles) 1 category for the Brake Brand with 400 product pages inside, 1 product page for each specific combination of brake product-model and car-fitment. /Brako/Brako-Super1-brakes_BMW-M3.html 1 category, 400 product pages, 0 choices on each product page. 1 category for the Brake Brand with 40 products inside, 1 product for each specific combination of brake product-model and car-manufacturer. Each product page would then let you choose from a dropdown which of the 10 specific cars you had. /Brako/Brako-Super1-brakes_BMW.html 1 category, 40 product pages, 10 choices on each product page. 1 category for the Brake Brand with 4 sub-categories inside for the brake product-models with 100 products inside each, 1 product for each specific combination of car-fitment. /Brako/Brako-Super1-brakes/Brako-Super1-brakes_BMW-M3.html 1 category, 4 sub-categories, 40 product pages, 10 choices on the product page. 1 category for the Brake Brand with 4 sub-categories inside for the brake product-models, with 10 products inside each.1 product for each specific combination of brake product-model and car-manufacturer. Each product page would then let you choose from a dropdown which of the 10 specific cars you had. /Brako/Brako-Super1-brakes/brakebrand-Super1-brakes_BMW.html 1 category, 4 sub-categories, 40 product pages, 10 choices on each product page. 1 category for the Brake Brand with 4 products inside, 1 product for each brake product-model. Each product page would then let you choose from 2 dropdowns, each with 10 options: one for car manufacturer, the next for car model. /Brako/Brako-Super1-brakes.html 1 category, 4 product pages, 100 (10x10) choices on each product page. 1 product page containing options to choose all 400 Brako products using 3 drop down boxes: Car Manufacturer, Car Model and Product-Model /Brako/Brako-brakes.html 1 category, 1 product page, 100 (10x10) choices on each product page. Or we could mix it up and split the sub-categories by manufacturer: 1 category for the Brake Brand with 10 sub-categories (1 sub-category for each of the car manufacturers with 40 products inside each), 1 product page for each specific variation of car-fitment and product-model. /Brako/Brako-brakes-BMW/Brako-Super1-brakes_BMW-M3.html 1 category, 10 sub-categories, 40 product pages, 0 choices on the product page. 1 category for the Brake Brand with 10 sub-categories (1 sub-category for each of the car manufacturers with 10 products inside each), 1 product page for each specific variation of car-fitment. Drop dowjn box on the product page lets you choose product-model (Super1-4) /Brako/Brako-brakes-BMW/Brako-brakes_BMW-M3.html 1 category, 10 sub-categories, 10 product pages, 4 choices on the product page. 1 category for the Brake Brand with 10 sub-categories (1 sub-category for each of the car manufacturers with products inside each), 1 product page for each specific variation of product-model. /Brako/Brako-brakes-BMW/Brako-Super1-brakes_BMW.html 1 category, 10 sub-categories, 4 product pages, 10 choices on the product page. Obviously, option 1) is going to be the best search match for someone searching for 'BMW M3 Brako Super1 brakes' but that page will have almost identical content to 100 other pages and very similar content to a further 300 pages, which takes it's quality ranking down a lot. At the other end of the scale of complexity is option 5) which concentrates all search potential for the Brako Super1 down to a single page, which can be well written and have great content, but wouldn't have a match in the title, url or product name for anyone searching for 'BMW M3 Brako Super1 brakes'. 'BMW M3' would be mentioned in the page, but only once in a drop-down along with 100 other cars and possibly once in the content if there's something noteworthy about that application. So which option would you go for and why?
Technical SEO | | DWJames0 -
How to handle Not found Crawl errors?
I'm using Google webmaster tools and able to see Not found Crawl errors. I have set up custom 404 page for all broken links. You can see my custom 404 page as follow. http://www.vistastores.com/404 But, I have question about it. Will it require to set 301 redirect for broken links which found in Google webmaster tools?
Technical SEO | | CommercePundit0 -
If googlebot fetch doesnt find our site will it be indexed?
We have a problem with one of our sites (wordpress) not getting fetched by googlebot. Some folders on the url get found others not. So we have isolated it as a wordpress issue. Will this affect our page in google serps anytime soon? Does any whizz kid out there know how to begin fixing this as we have spent two days solid on this. url is www.holden-jones.co.uk Thanks in advance guys Rob
Technical SEO | | wonderwall0