Google Giving 404 Errors to Working Pages
-
We have a problem that just came up out of the blue with Google, in particular Webmaster Tools & our Merchant Center. We're getting a 404 errors for 1000s of pages in both of these applications, but the pages are working just fine. Our shopping campaigns have been hit hard as many of our top products have been suspended from our merchant feed. Webmaster tools is giving us 1000s of 404 errors to product & category pages alike. But every page returning a 404 error is working. We've contacted Google and they mention that they are not getting a 404 error, but their crawler seems to be. Has anyone ever experienced this? What could be causing this?
Thanks for any input.
-
Hi Paul, what is the status of this issue? Has it been resolved, or not? Would love an update! Thanks ~ Christy
-
Yes, attackers use code injection techniques to hijack search results. They in fact do use some randomization techniques to make it harder to detect. Conducting a security scan using a tool like Sucuri.net could be helpful but manually reviewing your .htaccess and code may be necessary.
-
Thanks jeff-rackaid.com.
The idea of some sort of fowl play did cross our minds. These errors seemed to appear out of the blue without any significant code changes on our side.
We have done a fetch as Googlebot on a number of pages. We had found that the returns have been inconsistent; we would fetch a particular page and get a "Not found" error one minute and then a "complete" result the next minute. I don't think this is a normal activity.
We've also been tracking the traffic of Googlebot to our site and since Thursday (8/14), the hits from GoogleBot have been going down while the hits from an "unknown bot" have been increasing.
-
This could just be a WMT error. I've seen this from time to time. If it persists for more than 24 hours, then you may want to try digging into it further.
Have you tried fetching as Googlebot
In doing server security work, I have seen some hijacking attempts that will send 301 responses to Googlebot. In some cases, these scripts are improperly deployed resulting in 404 errors or 500 errors. So I would first fetch the site as Googlebot.
Then examine your server's access logs for hits from Googlebot. Confirm that it is indeed Googlebot. You can verify Googlebot IP ranges with reverse DNS:
https://support.google.com/webmasters/answer/80553?hl=en
If there's no foul play, then check for any browser-based detections routines. With the increasing use of mobile, I have seen some code fail to handle bots correctly. The behavior is usually an error not a 404. However, many CMS systemincorrectly send 404 errors for a variety of errors and not just true not found status codes.
-
On Aug 16th i got a similar error mydomain.com/page/feed/ is all giving 404 errors I look at the xml and it shows an xml with title tags it has the site name - page not found. but the feed pages is not index in google.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Yellow Pages advertising and ad sources
From experience I've always been telling clients of mine to stay from Yellow Pages advertising. It has been several years now and it seems that Yellow Pages not only offers just priority listings but also SEO and their own version of Adwords it seems. I received a call from a Yellow Pages sales rep today saying they can promise me 50k impression views for $500/month which is a campaign managed by them and they'll even create the ads as well. When I questioned them on their 9 million sources they have for generating these impressions, if these impressions are local or national they mentioned it works like Adsense in a way. I eventually declined their offer and figured I'd do some research. If I were to create an Adwords Display campaign with that kinda of budget and do it locally by my city, Adwords forecasts are no where near that kind of impression count, expanding the campaign out to all of Ontario would be closer but still not quite that high an impression count. I'm assuming YP doesn't have as large of a network compared to Google either which also makes me more doubtful. What I would really like to know is has anyone had any success with YP advertising compared to Adwords recently especially with their high costs for such services? And does anyone know where exactly YP, Google Adwords, Bing Ads get their web partners and sources from? I know there are ad revenue agencies like Metroland that sell their ad sources to such companies and was curious.
Paid Search Marketing | | FPK0 -
Any data for Google results page click through rates?
Hi. Trying to find data for click through rate for the Google search results page? If I run Adwords, do I want a PLA listing or a text listing? Or do I work on PLA + Organic or Text + Organic? What percentages do each position get approximately? E-commerce website. Technology sector. Any help?
Paid Search Marketing | | YNWA0 -
Return of investment on spend on google adwords
Hi Running an adwords campaign for a builders/construction company namely double glazing what sort of return of investment could I expect to get on a return of £4000 per month? I know its a million dollar question but any insight or thoughts would be appreciated, especially on tracking ROI for example in this case it's just leads via a contact form on potential conservatory, windows or doors work which would be followed up via phone and an onsite visit.
Paid Search Marketing | | offonhols0 -
How to view the sources of visitors who bounced off in Google Analytics?
Hi there, we have a website with a more than 60% bounce rate. I'm trying to find out where these visitors (the ones that are bouncing off) are coming from, to what percentage are they coming from the PPC campaign, from organic search results or referrals. I suspect that the keywords from the PPC campaign are not relevant to the website content (and hence visitors are bouncing off). Does anyone know how to check this in Google Analytics? Thanks in advance!
Paid Search Marketing | | Gabriele_Layoutweb0 -
Google Analytics Code
I have an ecommerce website and have installed the Google Analytics Code. i am also spending the money for google adwords. i m getting clicks and as well as orders but in google analytics it show that i am getting all the traffic from organic search results whereas my daily budget get exhausted and i do get business for the keywords i bid. i want to ask is there a problem with adwords or anlytics. Or have i placed the wrong code or have placed the code not in a proper format.
Paid Search Marketing | | seosogo0 -
Index or Noindex PPC Landing Pages?
Hi all, We have thousands of PPC landing pages for our products. Usually, these pages are very similar and may differ only slightly for the keyword in question. The landing pages are sitting in a sub-domain of our site. From SEO perspective, assuming we don't want to get hit by Panda, Penguin and other animals Google stuffed into its ranking algorithm...Is it a good idea not to index these landing pages at all (i.e. add meta robots - noindex, nofollow to these pages)? What say you? Thanks!
Paid Search Marketing | | ShivaS0 -
Yellow Stars on Google Ads.
Hi, I see some Ads on google.de with a yellow stars. I was researching how they are doing this, and just read some topics online about that. And now, i now finally that this Stars are coming from Google Product Reviews on Google Shopping. I don't sell product, i do Financial Consulting, but those ADS on germany doing the same, our product is consulting. I created an Google Merchant Account, and product feed, but i don't know which is the easiest and fastest way to active this option to review the peoples my consulting-product like this one: http://www.google.de/products/seller?zmi=finanzcheck.de&hl=de&sa=X&ei=Qg4pT5OkMY-FhQfBxdCjBQ&ved=0CCMQwQY http://www.google.de/products/seller?zmi=creditplus.de&hl=de&sa=X&ei=Qg4pT5OkMY-FhQfBxdCjBQ&ved=0CCoQwQY http://www.google.de/products/seller?zmi=norisbank.de&hl=de&sa=X&ei=Qg4pT5OkMY-FhQfBxdCjBQ&ved=0CDEQwQY Can you tell me the steps, from A-Z how to configure all this? Thanks
Paid Search Marketing | | leadsprofi0