Google Giving 404 Errors to Working Pages
-
We have a problem that just came up out of the blue with Google, in particular Webmaster Tools & our Merchant Center. We're getting a 404 errors for 1000s of pages in both of these applications, but the pages are working just fine. Our shopping campaigns have been hit hard as many of our top products have been suspended from our merchant feed. Webmaster tools is giving us 1000s of 404 errors to product & category pages alike. But every page returning a 404 error is working. We've contacted Google and they mention that they are not getting a 404 error, but their crawler seems to be. Has anyone ever experienced this? What could be causing this?
Thanks for any input.
-
Hi Paul, what is the status of this issue? Has it been resolved, or not? Would love an update! Thanks ~ Christy
-
Yes, attackers use code injection techniques to hijack search results. They in fact do use some randomization techniques to make it harder to detect. Conducting a security scan using a tool like Sucuri.net could be helpful but manually reviewing your .htaccess and code may be necessary.
-
Thanks jeff-rackaid.com.
The idea of some sort of fowl play did cross our minds. These errors seemed to appear out of the blue without any significant code changes on our side.
We have done a fetch as Googlebot on a number of pages. We had found that the returns have been inconsistent; we would fetch a particular page and get a "Not found" error one minute and then a "complete" result the next minute. I don't think this is a normal activity.
We've also been tracking the traffic of Googlebot to our site and since Thursday (8/14), the hits from GoogleBot have been going down while the hits from an "unknown bot" have been increasing.
-
This could just be a WMT error. I've seen this from time to time. If it persists for more than 24 hours, then you may want to try digging into it further.
Have you tried fetching as Googlebot
In doing server security work, I have seen some hijacking attempts that will send 301 responses to Googlebot. In some cases, these scripts are improperly deployed resulting in 404 errors or 500 errors. So I would first fetch the site as Googlebot.
Then examine your server's access logs for hits from Googlebot. Confirm that it is indeed Googlebot. You can verify Googlebot IP ranges with reverse DNS:
https://support.google.com/webmasters/answer/80553?hl=en
If there's no foul play, then check for any browser-based detections routines. With the increasing use of mobile, I have seen some code fail to handle bots correctly. The behavior is usually an error not a 404. However, many CMS systemincorrectly send 404 errors for a variety of errors and not just true not found status codes.
-
On Aug 16th i got a similar error mydomain.com/page/feed/ is all giving 404 errors I look at the xml and it shows an xml with title tags it has the site name - page not found. but the feed pages is not index in google.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Website is flagged as Compromised Site by Google
Hi everyone, We have been running Google Ads for a while now and last week all of our Google Ads were paused with reason Compromised Site. We reached out to Google and they identify this page as one of the affected page: https://manpower.com.vn/vi/dich-vu-san-dau-nguoi-and-tu-van-nhan-su-cap-cao? The malicious links they found are:
Paid Search Marketing | | ManpowerVietnam
• googie-anaiytics[.]com
• vty68[.]net We have asked our Website vendor to scan and they found nothing. We would be greatly appreciated if you could help. I tried Google Search Console and even the tool Google Safe Browsing that Google itself suggested but both the tools showed that our website does not have any malicious links at all. And yet Google Ads support team keeps telling us our page contains these links. I am wondering if anyone in the community has experienced this before and how did you address this issue. Or could you guys please help to share any tools that you know can do a deep scan on this page and if possible our entire website to help us identify where the links are located? Please let me know if you need any additional information from us and I would be happy to provide it.3 -
Will google consider it as one click for adwords?
Hi All, Many times I want to check actual page of competitors they are targeting in google adwords. Like when I search for any keywords and my competitors page comes on top ads in google, then I copy url from search result and paste in any other browser will it be consider as click and google will charge to my competitor? Example url - https://www.googleadservices.com/pagead/aclk?------------------------------------------------------------------------&adurl= Thanks!
Paid Search Marketing | | pragnesh96390 -
Google Product Ads
Hi,
Paid Search Marketing | | ChrisHolgate
I was wondering if I could ask is perhaps someone could give me some clarification as to how the amount we bid on Google Product Ads reflects the product positioning on Google Shopping? We have a Google Product Data Feed which is then linked up to our Adwords account so that we can determine a PPC bid amount. In instances like this it doesn't seem to make sense that one person may be paying 10ppc and another 20ppc when the buyers criteria for sorting merchants was purely down to the price. Since the buyer has the option to sort their products in price from minimum to maximum the sort order cannot be manipulated by Google based on the amount the merchant was paying. As such, how is determining a cost per click figure relevant when the customer is searching by base price low > high on Google Shopping? Surely I should just set the limit to £0.01 and rely on the customer determining the sort order (which ultimately will lead to a higher conversion rate) than allowing Google to skew the results based on bidding 20-30 times this amount? I should state that I'm in the UK. I do realise that a high PPC amount will increase our chance of exposure on standard search pages but my question does relate solely to results listed on Google Shopping. Thanks for your help! Chris0 -
Do UTM Parameters reflect in Google Analytics
Hi, We have recently enabled auto tagging in our URLs but not sure if tagging is working correctly. Does Google Analytics shows the utm parameters also in URLs in Google Analytics OR Google shows only the base url (after removing utm parameters) in Analytics. For example: Will http://www.abc.com/?utm_source=Indiaweb&utm_medium=Display&utm_campaign=CPC&utm_content=NRI_newprojects&utm_term=US be shown as is in Google Analytics under PAID Tab or only http://www.abc.com/ will be shown and the utm parameters will be removed in Analytics if auto tagging is enabled. Thanks in Advance 🙂 Regards Anirban
Paid Search Marketing | | vivekrathore0 -
Is there a tool that can use measure and improve the quality score of my PPC landing pages?
Hey guys, I'm trying to improve the quality score for a few of my PPC landing pages. Does any one know a Tool that can help me in the process. Something kind of like the "on page grader" but for quality score. Thanks
Paid Search Marketing | | Felip30 -
Google Analytics Matched Search Query Not Working
On Google analytics for our clients when you check the Matched Search Query under Traffic Sources > Overview, it says "There is no data for this view.". I have Google searched it and i am not finding my answer to why this is not displaying my information. On my personal analytics account when i clicked on matched search query it displays exactly what the person searched when it trigered my adwords ad. I have no idea why this account doesn't display the same info when it appears to be setup in the same way. Example: If i am broad match targeting the keyword "outdoor sports", and someone searched "Canadian outdoor sports for kids" It would show exactly what they searched under Matched Search Query. Anyone know how to resolve this issue?
Paid Search Marketing | | VITALBGS0 -
Increasing Google Ad spend - is it worth it
Hi We are currently spending approx £500 pcm on google ad words however if I increased this spend to £4000 pcm what kind of results would this achieve? For example would it just be more visits per day as the budget is larger? Also what is the best way to track the success of an adwords campaign - the ultimate goal of the campaign would be to generate a lead whether this be a phone call, email or using our book an appointment form. Our service covers a geographical area (Scotland) and for organic search we are doing well 1st pages listings for searches such as pvc doors edinburgh etc so I am unsure whether it's worth increasing my PPC spend or put more resource into SEO, or even Facebook ads?
Paid Search Marketing | | ocelot0 -
Google Ads not showing
Hello, I am having some trouble with my google adwords. I decided to split my existing campaign into two campaigns, one for customers in the UK and one for the rest of the world. The keywords are the same - only the message is different. i.e. Tractor Parts Free UK shipping on Tractor parts mysite.com/tractor-parts & Tractor Parts Fast shipping to Europe from the UK mysite.com/Tractor-Parts According to Google Adwords my UK campaign has had no impressions and no clicks. However if I search for one of the keywords it appears in the search results with the UK text. Anyone got any ideas?
Paid Search Marketing | | DavidLenehan0