Google Giving 404 Errors to Working Pages
-
We have a problem that just came up out of the blue with Google, in particular Webmaster Tools & our Merchant Center. We're getting a 404 errors for 1000s of pages in both of these applications, but the pages are working just fine. Our shopping campaigns have been hit hard as many of our top products have been suspended from our merchant feed. Webmaster tools is giving us 1000s of 404 errors to product & category pages alike. But every page returning a 404 error is working. We've contacted Google and they mention that they are not getting a 404 error, but their crawler seems to be. Has anyone ever experienced this? What could be causing this?
Thanks for any input.
-
Hi Paul, what is the status of this issue? Has it been resolved, or not? Would love an update! Thanks ~ Christy
-
Yes, attackers use code injection techniques to hijack search results. They in fact do use some randomization techniques to make it harder to detect. Conducting a security scan using a tool like Sucuri.net could be helpful but manually reviewing your .htaccess and code may be necessary.
-
Thanks jeff-rackaid.com.
The idea of some sort of fowl play did cross our minds. These errors seemed to appear out of the blue without any significant code changes on our side.
We have done a fetch as Googlebot on a number of pages. We had found that the returns have been inconsistent; we would fetch a particular page and get a "Not found" error one minute and then a "complete" result the next minute. I don't think this is a normal activity.
We've also been tracking the traffic of Googlebot to our site and since Thursday (8/14), the hits from GoogleBot have been going down while the hits from an "unknown bot" have been increasing.
-
This could just be a WMT error. I've seen this from time to time. If it persists for more than 24 hours, then you may want to try digging into it further.
Have you tried fetching as Googlebot
In doing server security work, I have seen some hijacking attempts that will send 301 responses to Googlebot. In some cases, these scripts are improperly deployed resulting in 404 errors or 500 errors. So I would first fetch the site as Googlebot.
Then examine your server's access logs for hits from Googlebot. Confirm that it is indeed Googlebot. You can verify Googlebot IP ranges with reverse DNS:
https://support.google.com/webmasters/answer/80553?hl=en
If there's no foul play, then check for any browser-based detections routines. With the increasing use of mobile, I have seen some code fail to handle bots correctly. The behavior is usually an error not a 404. However, many CMS systemincorrectly send 404 errors for a variety of errors and not just true not found status codes.
-
On Aug 16th i got a similar error mydomain.com/page/feed/ is all giving 404 errors I look at the xml and it shows an xml with title tags it has the site name - page not found. but the feed pages is not index in google.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How Google Search works
I watched this video over the weekend. If you haven't yet, this is a great documentary every SEO client should watch. watch?v=tFq6Q_muwG0
Paid Search Marketing | | WebDaytona0 -
301 Redirects and Google Shopping Feeds
I am moving my site from Volusion to Shopify. The domain remains the same but the URL paths are different. With respect to my Google Shopping feed, is it best to send old URLs (with 301 redirects) or to send the new URLs?
Paid Search Marketing | | vgusvg0 -
How to Tell Google About My Near Duplicate Pages?
For my Adwords campaign, I create a separate landing page for each Ad Group, but are similar enough to one another that they may be considered duplicate content. Should I use a canonical tag on the page to tell Google which page is priority? I don't care about any of those pages ranking in search, I'm just using them for my ads. I also don't want to redirect, clearly. Is the canonical tag the correct way to go?
Paid Search Marketing | | Dino640 -
What's the best call tracking system to use for PPC & subsequent landing pages?
Client has about 30 locations. Not planning to get too fancy (i.e. like putting JS on the page so that a dynamically generated phone is displayed to track keywords). At this point, just we only want to see if PPC is providing telephone conversions. I've used Mongoose Metrics before and it seemed good. However, I don't want to go with something simply because it's what I already know. Would love to know some of your favourites and if there are better options. Also - client is in Canada. Not sure if that makes a difference.
Paid Search Marketing | | woodsy10100 -
Discrepancy between google analytics referrals and 3rd party stats
I have a client who pays to be listed in a industry directory. It is now time for renewal and the directory has come to my client with their statistics, which they claim has sent over 400 visits to my clients site. Having looked in to google analytics, over the same period of time, google analytics has registered 2 visits. Could the directory's stats be true? Or is google analytics 100% correct? Any help or advice in this area would be useful, as my client is concerned if they don't renew they will lose some traffic and leads. Cheers.
Paid Search Marketing | | xposurecreative0 -
Trademarked words in in Google Adwords ads - Why do competitors get to use them?
Hi, The keyword I want to use in my ad is trademarked, so they disqualified my ad. The trademark was specifically cited as the reasoning. I tried this across maybe 5 different ads. All disqualified The thing I don't understand is that there are like 10 other advertisers who are actively using this "trademarked" word in their ads. It's not like 1 scooted past Google, there's a ton of advertisers doing it. So how do I get past them or were they grandfathered in or something? FYI... I tried dynamic insert to see if that could my "trademarked" word in the back door, but no luck. Any other ideas? Thanks!
Paid Search Marketing | | marketingcupcake0 -
How does this company have more characters than allowed on Google Ads?
I thought this was weird and was wondering if anyone knows the answer to this... I attached the image so you can see what I mean. How does this company get away with having more characters than what Google Adwords allows? And why is there a "block ads from" thing underneath this ad, but not the others? Sorry for the bad arrow, I'm on Windows XP lol Thanks you 🙂 G2d9gIr.jpg
Paid Search Marketing | | jhinchcliffe1 -
Adwords Quality Score and On-Page SEO
I'm trying to convince a large, multinational company that is very resistant to change, into making my on-page SEO changes. Compounding this resistance is the fact that the Analytics, SEO, PPC, and web dev departments are all under different people and they don't communicate very well. So, in order to get them to work together, I've decided to appeal to the places where they are sensitive; e.g., the PPC department where they surely have the desire to be more efficient with their budget. To appeal to this sensitivity, and with my goal of getting on-page changes done to help the SEO dept, I'm considering making the argument that my on-page changes will raise their quality score which will in turn lower the amount they are spending on PPC. Basically, is this a fair argument? Do you have an evidence to back this up? Best in the Midwest, Phil p.s. Hi, Joanna 😉
Paid Search Marketing | | PapaRelevance0