Google Giving 404 Errors to Working Pages
-
We have a problem that just came up out of the blue with Google, in particular Webmaster Tools & our Merchant Center. We're getting a 404 errors for 1000s of pages in both of these applications, but the pages are working just fine. Our shopping campaigns have been hit hard as many of our top products have been suspended from our merchant feed. Webmaster tools is giving us 1000s of 404 errors to product & category pages alike. But every page returning a 404 error is working. We've contacted Google and they mention that they are not getting a 404 error, but their crawler seems to be. Has anyone ever experienced this? What could be causing this?
Thanks for any input.
-
Hi Paul, what is the status of this issue? Has it been resolved, or not? Would love an update! Thanks ~ Christy
-
Yes, attackers use code injection techniques to hijack search results. They in fact do use some randomization techniques to make it harder to detect. Conducting a security scan using a tool like Sucuri.net could be helpful but manually reviewing your .htaccess and code may be necessary.
-
Thanks jeff-rackaid.com.
The idea of some sort of fowl play did cross our minds. These errors seemed to appear out of the blue without any significant code changes on our side.
We have done a fetch as Googlebot on a number of pages. We had found that the returns have been inconsistent; we would fetch a particular page and get a "Not found" error one minute and then a "complete" result the next minute. I don't think this is a normal activity.
We've also been tracking the traffic of Googlebot to our site and since Thursday (8/14), the hits from GoogleBot have been going down while the hits from an "unknown bot" have been increasing.
-
This could just be a WMT error. I've seen this from time to time. If it persists for more than 24 hours, then you may want to try digging into it further.
Have you tried fetching as Googlebot
In doing server security work, I have seen some hijacking attempts that will send 301 responses to Googlebot. In some cases, these scripts are improperly deployed resulting in 404 errors or 500 errors. So I would first fetch the site as Googlebot.
Then examine your server's access logs for hits from Googlebot. Confirm that it is indeed Googlebot. You can verify Googlebot IP ranges with reverse DNS:
https://support.google.com/webmasters/answer/80553?hl=en
If there's no foul play, then check for any browser-based detections routines. With the increasing use of mobile, I have seen some code fail to handle bots correctly. The behavior is usually an error not a 404. However, many CMS systemincorrectly send 404 errors for a variety of errors and not just true not found status codes.
-
On Aug 16th i got a similar error mydomain.com/page/feed/ is all giving 404 errors I look at the xml and it shows an xml with title tags it has the site name - page not found. but the feed pages is not index in google.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How Google Search works
I watched this video over the weekend. If you haven't yet, this is a great documentary every SEO client should watch. watch?v=tFq6Q_muwG0
Paid Search Marketing | | WebDaytona0 -
Googleweblight Traffic in Google Analytics
Google analytics showing Googleweblight traffic is paid traffic or organic traffic or anything else? If any post related to this query, kindly send that URL.
Paid Search Marketing | | vivekrathore0 -
Site penalized by google
I noticed for a while that our competitors don't rank for any keywords organically and they are using paid ads to gain traffic. They have been in the industry for over 6 years and we are only new and have ranked above them already. How can we find out if a competitor has been penalized? Thanks
Paid Search Marketing | | edward-may0 -
Why does my google analytics show a massive discrepancy from facebook's reported website clicks?
We're running a Facebook news feed ad that is pointing at our homepage. Facebook says that for yesterday there were 47 website clicks. Google analytics shows 15 total visitors from facebook with 3 of them landing on the homepage. I understand that there is likely going to be some discrepancy with users accidentally clicking and clicking back before the page loads, but this seems a little insane. I tested the ad using a page that pulls the Analytics cookie data using php and it is working properly so I don't understand what's happening. The url isn't tagged with utm parameters, which is going to be fixed. Anyone experience this or have any insight as to what could be this issue? Is this click fraud? Edit: For more clarification I was checking on my completely unfiltered google analytics profile/view.
Paid Search Marketing | | spencerhjustice0 -
Have you used an ad network other than Google Adwords?
We received a cold call from a company called Division-D. They make a lot of promises which sound good (but that's what marketers do 🙂 ). Advertising on a non-Google network probably would have fewer restrictions than an Adwords campaign and they say that they are fully transparent. Would it be worth it to listen to their whole pitch?
Paid Search Marketing | | Linda-Vassily0 -
PPC Landing Pages and Rel Canonical
Hi Mozzers! Our company has hundreds of PPC landing pages which are essentially request a quote forms. We also have a request a quote form on our website that is for regular traffic. Currently we just added the "noindex" meta tag to all our PPC landing pages, but I think we can improve this. Should we remove the "noindex" tag, and instead add a rel canonical link pointing to our "main" request a quote form? Thoughts?
Paid Search Marketing | | Travis-W0 -
Paid Press Release Site - Our competitors do it... and it seems to work?
Hi Im seeing our competitors use sites like 24-7pressrelease.com to release rather uninteresting and dubious press releases and it seems to be, looking at their link profiles, the lions share of all links to these particular landing pages. Yet since I've joined SEOMOZ all i've seen is that PR sites don't work and arent worth it. So far, I've resisted doing any PR stuff and have just kept on creating and promoting content which is severely time heavy work. Is there really 0 value in these? If i have 0 PR currently and add just a couple is that worth it? The co. we compete against are at it every week with this site and similar paid sites. Are they making a mistake?
Paid Search Marketing | | xoffie0 -
Google Adwords Clicks v.s. Google Analytics Visits
Hi Guys, This question has been asked several times before but after doing some research, I haven't really found the right solution and/or explanation. I'm currently seeing a 30-50% discrepancy in Adwords Clicks and Analytics Visits, where there are more clicks than visits in most situations. E.g. 74,127 clicks v.s. 46,845 visits (34 add-to-carts, 67 initiated orders, and a revenue of $12,000). Can anybody in the forum help explain this? Thank you, Jurgen P.S. I've also looked at all the tracking codes and everything seems to be alright, I've checked if any internal redirects are stripping off parameters but to no avail. Lastly, I'm not sure if this is a behavioral issue here in SEA--will first click (Adwords) and last click attribution (Analytics) be the only explanation? P.S.S. I'm seeing the same discrepancies with Facebook ads and Analytics.
Paid Search Marketing | | JurgenEstanislao0