Please Help! Crawl & Site Errors - Will This Impact My SEO?
-
Hello Moz,
I need urgent help. I remove a tonne of product pages and put everything into one product page to deal with duplicate content. I thought this was a good thing to do until I got an email from Google saying:
"Googlebot identified a significant increase in the number of URLs on ****.com that return a 404 (not found) error. "
I checked it out and found the problem:
4 Soft 404's
41 Not Found'sWhat do I need to do to fix this? Is it a problem or should I just ignore? I removed all the pages on WordPress but I need to do it somehow manually through Google?
I have worked so hard on my SERP's that this will destroy me if I'm penalised. Please can someone advise?
-
First of all - don't stress out! You won't be penalized for broken links. Google penalizes for shady behavior, not honest mistakes.
Like Andrew said, make sure that you aren't linking to any of the pages you removed from your site, and that you've removed them from your XML sitemap.
Then you should be good!
Good luck,
Kristina
-
Don't stress everything is OK.
When google indexes your site it makes its own URL list. 404s in search console are just google saying 'hey I checked for this page from my list and it's gone'
Well that's fine. You deleted it so you already know it's gone. Google will keep checling for this page a few more times then it will deindex it. It just doesn't want to deindex without fair warning.
If these pages are still getting traffic however I would 301 them to a relevant page to maintain user experience.
Finally, if these pages targeted keywords you want to rank for. You will loose these rankings if you don't target them elsewhere.
-
I do yes but I must know how to deal with Google now as I am so stressed!
I thought deleting the pages would be fine? I don't understand what further I must do? Once you delete a page must you tell Google you have done so?
I only got the email yesterday so I assume I have sometime left to fix?
-
Do you have a decent 404 page? Does this facilitate further browsing.
Internal links that 404 will leak page rank. So you need to fix any internal 404s. Google says 404s in search console are not damaging but many people including myself see traffic bumps from resolving these with a 301.
Have you seen any drop in traffic or rankings.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Googlebot crawl error Javascript method is not defined
Hi All, I have this problem, that has been a pain in the ****. I get tons of crawl errors from "Googlebot" saying a specific Javascript method does not exist in my logs. I then go to the affected page and test in a web browser and the page works without any Javascript errors. Can some help with resolving this issue? Thanks in advance.
Technical SEO | | FreddyKgapza0 -
"Moz encountered an error on one or more pages on your site" Error
I have been receiving this error for a while: "Moz encountered an error on one or more pages on your site" It's a Multi-Lingual Wordpress website, the robots.txt is set to allow crawlers on all links and I have followed the same process for other website I've done yet I'm receiving this error for this site.
Technical SEO | | JustinZimri0 -
Site Category structure detrimental to SEO?
Hi Guys, I am hoping that you may be able to help with an internal debate on whether our currently category structuring could be damaging from an SEO point of view. Our site sells t shirts primarily and as such we have a large product base of around 7000+ products. Our category structure currently works like so: Mens/T-Shirts/Movie&TV/TV/ Which I think is fairly typical, though this where it gets interesting, within this end category of "/TV/" there are around 120 categories that are used from a filtration point of view to contain items for each specific show etc, IE Mens/T-Shirts/Movie&TV/TV/Breaking_Bad, Mens/T-Shirts/Movie&TV/TV/Game_of_Thrones. The vast majority of these categories have between 1 and 3 products within them and the rest higher. Multiply this by the large amount of categories that we have on site and these end level "Band Title" categories amount to around 13,000+ categories in the directory. If at this point we put the filtration element aside, what is the communities opinion of the benefits or drawbacks of having the category structure like this? Thanks in advance for any feedback.
Technical SEO | | timsilver0 -
Off-site company blog linking to company site or blog incorporated into the company site?
Kind of a SEO newbie, so be gentle. I'm a beginner content strategist at a small design firm. Currently, I'm working with a client on a website redesign. Their current website is a single page dud with a page authority of 5. The client has a word press blog with a solid URL name, a domain authority of 100 and page authority of 30. My question is this: would it be better for my client from an SEO perspective to: Re-skin their existing blog and link to the new company website with it, hopefully passing on some of its "Google Juice,"or... Create a new blog on their new website (and maybe do a 301 redirect from the old blog)? Or are there better options that I'm not thinking of? Thanks for whatever help you can give a newbie. I just want to take good care of my client.
Technical SEO | | TheKatzMeow0 -
Robots.txt & Mobile Site
Background - Our mobile site is on the same domain as our main site. We use a folder approach for our mobile site abc.com/m/home.html We are re-directing traffic to our mobile site vie device detection and re-direction exists for a handful of pages of our site ie most of our pages do not redirect the user to a mobile equivalent page. Issue – Our mobile pages are being indexed in desktop Google searches Input Required – How should we modify our robots.txt so that the desktop google index does not index our mobile pages/urls User-agent: Googlebot-Mobile Disallow: /m User-agent: `YahooSeeker/M1A1-R2D2` Disallow: /m User-agent: `MSNBOT_Mobile` Disallow: /m Many thanks
Technical SEO | | CeeC-Blogger0 -
What steps can you take to help a site that does not change
Hi, i am working on a product and services website www.clairehegarty.co.uk but the problem i have is, the site does not really change. The home page stays the same and the only time it changes is when a new course is advertised. The most important page on the website is http://www.clairehegarty.co.uk/virtual-gastric-band-with-hypnotherapy but we have seen the site drop in rankings because the page is not being updated. This page has all the information you could want on weight loss but we have seen the page drop from number one in google to number four. I would like to know what steps we should take to increase our rankings in google and would be grateful for your suggestions. If i put in articles on the site, had a section where we put a new article every week, would this then get google to visit the whole site more and move our pages back up the rankings, or should we be looking at doing other things.
Technical SEO | | ClaireH-1848860 -
IP Indexing of MySQL with 80,000 links , help please
Hi There, We were just using one server for both Mysql & httpd server. The server's IP address was 207.36.90.69. Time to time the server couldn't handle the requests so we decided to get new servers in order to handle them. When i talk to my system engineer and software developer about this, they've suggested clustering our site http://goo.gl/ITNqs. So we moved our site http://goo.gl/ITNqs to the server (216.87.165.21) but we kept the old machine 207.36.90.69 to use as MySQL server and deleted all HTTP related files last year. Somehow google indexed 80K unnatural links from this old IP 207.36.90.69. We have received an unnatural links warning back in august and got a link related penalty on sept 28th. Our webmaster tools are showing that we have 80,000 link pointing to our site from the old server with only mysql on it. Can someone help us understand how google crawler indexed an IP with no http related files on it for almost a year, 10 months to be exact. Thank you
Technical SEO | | orion680 -
SEO Mox reporting all pages & titles as duplicate, but this is not the case.
HI, I am confused . This week SEOMoz is reporting that all my pages and pages titles are duplicate. This is not the case. I have added geo meta tags to each page - could this be causing the duplicate page content condition? I have no theory about the title duplicate condition. I have uploaded pdfs of these seomoz reports here: http://www.2shared.com/document/JAgS2Ni9/Issue_-Duplicate_Page_Content.html http://www.2shared.com/document/gyXcMsoP/Issue-Duplicate_Page_Title-.html Help please. thanks.
Technical SEO | | RichardB20