Google Giving 404 Errors to Working Pages
-
We have a problem that just came up out of the blue with Google, in particular Webmaster Tools & our Merchant Center. We're getting a 404 errors for 1000s of pages in both of these applications, but the pages are working just fine. Our shopping campaigns have been hit hard as many of our top products have been suspended from our merchant feed. Webmaster tools is giving us 1000s of 404 errors to product & category pages alike. But every page returning a 404 error is working. We've contacted Google and they mention that they are not getting a 404 error, but their crawler seems to be. Has anyone ever experienced this? What could be causing this?
Thanks for any input.
-
Hi Paul, what is the status of this issue? Has it been resolved, or not? Would love an update! Thanks ~ Christy
-
Yes, attackers use code injection techniques to hijack search results. They in fact do use some randomization techniques to make it harder to detect. Conducting a security scan using a tool like Sucuri.net could be helpful but manually reviewing your .htaccess and code may be necessary.
-
Thanks jeff-rackaid.com.
The idea of some sort of fowl play did cross our minds. These errors seemed to appear out of the blue without any significant code changes on our side.
We have done a fetch as Googlebot on a number of pages. We had found that the returns have been inconsistent; we would fetch a particular page and get a "Not found" error one minute and then a "complete" result the next minute. I don't think this is a normal activity.
We've also been tracking the traffic of Googlebot to our site and since Thursday (8/14), the hits from GoogleBot have been going down while the hits from an "unknown bot" have been increasing.
-
This could just be a WMT error. I've seen this from time to time. If it persists for more than 24 hours, then you may want to try digging into it further.
Have you tried fetching as Googlebot
In doing server security work, I have seen some hijacking attempts that will send 301 responses to Googlebot. In some cases, these scripts are improperly deployed resulting in 404 errors or 500 errors. So I would first fetch the site as Googlebot.
Then examine your server's access logs for hits from Googlebot. Confirm that it is indeed Googlebot. You can verify Googlebot IP ranges with reverse DNS:
https://support.google.com/webmasters/answer/80553?hl=en
If there's no foul play, then check for any browser-based detections routines. With the increasing use of mobile, I have seen some code fail to handle bots correctly. The behavior is usually an error not a 404. However, many CMS systemincorrectly send 404 errors for a variety of errors and not just true not found status codes.
-
On Aug 16th i got a similar error mydomain.com/page/feed/ is all giving 404 errors I look at the xml and it shows an xml with title tags it has the site name - page not found. but the feed pages is not index in google.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Any data for Google results page click through rates?
Hi. Trying to find data for click through rate for the Google search results page? If I run Adwords, do I want a PLA listing or a text listing? Or do I work on PLA + Organic or Text + Organic? What percentages do each position get approximately? E-commerce website. Technology sector. Any help?
Paid Search Marketing | | YNWA0 -
A heads-up about problems with the new Google Adwords Keyword Planner tool
I noticed that when I was using this tool, the data in the tables would change, often by a lot (up to 50%) when I sorted the columns. (Did nothing else, just sorted.) Since I was starting a new campaign and really needed data, I contacted Google about this and was told: "I understand that the estimates are changing in the Keyword Planner tool when you sort the data. I reproduced this on my end as well and was able to confirm that this is a known technical issue on our end." "Unfortunately the information in the Keyword Planner Tool is currently not the best source of data for your analysis." They then went on to suggest I just test things blindly. So, what do you do to get information about keyword traffic and ppc estimates?
Paid Search Marketing | | Linda-Vassily0 -
I want to try some Google PPC ads on other sites but don't know what i'm doing.
We have seen a massive drop in traffic this year and i am contemplation using banner ads to try to increase sales and also to help with marketing. the problem is i know nothing about doing this. I have used it in the past but to limited success and i was just stabbing in the dark. I have a few questions. Am i better to target keywords related to the product or to the people who may buy my products? Is it better for direct sales or brand awareness? What kind of ROI can i expect if i get it working well? Is it better to pay for the big keywords or pic all the low hanging fruit? Does it work? Should i employ an expert, are they worth it? Any insights into the world of PPc would be a massive help.
Paid Search Marketing | | mark_baird1 -
Google Analytics Code
I have an ecommerce website and have installed the Google Analytics Code. i am also spending the money for google adwords. i m getting clicks and as well as orders but in google analytics it show that i am getting all the traffic from organic search results whereas my daily budget get exhausted and i do get business for the keywords i bid. i want to ask is there a problem with adwords or anlytics. Or have i placed the wrong code or have placed the code not in a proper format.
Paid Search Marketing | | seosogo0 -
Why doesn't exact match appear to be working for me in Google AdWords tool?
Hi guys, I recently read Rand's article here and tried out the exact match symbols on my keywords. However, these don't appear to be working for me as the results aren't showing up as they do in the above SEOmoz article (attached screenshot). What am I doing wrong? Google_AdWords__Keyword_Tool-20130511-115528.jpg.jpg?resizeSmall&width=832
Paid Search Marketing | | featherseo0 -
Isn't a product page a Landing Page?
Before starting a new ppc campaign, I am working on making my site landing pages Relevant. I see some ppc experts suggest separate, noindex, landing pages. But aren't my dynamically generated product pages landing pages- They have a call to action "add to basket" button, a big photo, and orignal detailed conent- prodct description - below all that. Sometimes I would like to advertise we have a broad selection of a Vendor's line- so then my natural landing page is a categegory page with thumbnail photos and the call to action is clicking the photo or product name to go to the specific product page. Can an experienced adwords person help me understand this better? Do I really want/need to create seperate ppc landing pages? What would the difference be? Thanks as ever Handcrafter
Paid Search Marketing | | stephenfishman0 -
Rating Snippet on Google SERP
Hi Mozers, I have question today. I see lot of Serps with rating review on the snippet, good i am reading on google about that, and i placed it on my website and i checked it, through google test tool and it works! My question is: Which type of rating system can i use on Google Adwords? Only shoping rating, or can i use the same rating system of my content and not on any product-shop on google? Can you tell me please! Thanks, Meti.
Paid Search Marketing | | leadsprofi0 -
Facebook PPC. Using Google URL Builder - Now What?
Hey There! So I've been trying some FB PPC ads. I recently learned I needed to use Google's URL builder to add the appropriate tracking fields into the URL (source, campaign, etc). The FB ad link now uses a custom URL with all the correct parameters. Now what do I do in analytics? Do I create a filter? A goal? Getting a little dizzy going in circles with google analytic help, and I'm hoping someone here can direct me. Thanks! -Dan
Paid Search Marketing | | evolvingSEO0