Google Giving 404 Errors to Working Pages
-
We have a problem that just came up out of the blue with Google, in particular Webmaster Tools & our Merchant Center. We're getting a 404 errors for 1000s of pages in both of these applications, but the pages are working just fine. Our shopping campaigns have been hit hard as many of our top products have been suspended from our merchant feed. Webmaster tools is giving us 1000s of 404 errors to product & category pages alike. But every page returning a 404 error is working. We've contacted Google and they mention that they are not getting a 404 error, but their crawler seems to be. Has anyone ever experienced this? What could be causing this?
Thanks for any input.
-
Hi Paul, what is the status of this issue? Has it been resolved, or not? Would love an update! Thanks ~ Christy
-
Yes, attackers use code injection techniques to hijack search results. They in fact do use some randomization techniques to make it harder to detect. Conducting a security scan using a tool like Sucuri.net could be helpful but manually reviewing your .htaccess and code may be necessary.
-
Thanks jeff-rackaid.com.
The idea of some sort of fowl play did cross our minds. These errors seemed to appear out of the blue without any significant code changes on our side.
We have done a fetch as Googlebot on a number of pages. We had found that the returns have been inconsistent; we would fetch a particular page and get a "Not found" error one minute and then a "complete" result the next minute. I don't think this is a normal activity.
We've also been tracking the traffic of Googlebot to our site and since Thursday (8/14), the hits from GoogleBot have been going down while the hits from an "unknown bot" have been increasing.
-
This could just be a WMT error. I've seen this from time to time. If it persists for more than 24 hours, then you may want to try digging into it further.
Have you tried fetching as Googlebot
In doing server security work, I have seen some hijacking attempts that will send 301 responses to Googlebot. In some cases, these scripts are improperly deployed resulting in 404 errors or 500 errors. So I would first fetch the site as Googlebot.
Then examine your server's access logs for hits from Googlebot. Confirm that it is indeed Googlebot. You can verify Googlebot IP ranges with reverse DNS:
https://support.google.com/webmasters/answer/80553?hl=en
If there's no foul play, then check for any browser-based detections routines. With the increasing use of mobile, I have seen some code fail to handle bots correctly. The behavior is usually an error not a 404. However, many CMS systemincorrectly send 404 errors for a variety of errors and not just true not found status codes.
-
On Aug 16th i got a similar error mydomain.com/page/feed/ is all giving 404 errors I look at the xml and it shows an xml with title tags it has the site name - page not found. but the feed pages is not index in google.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Clients Keep Googling Themselves
Hi, I have a common problem with my clients where they google their own business name or keywords they want to rank for and freak out when they don't show up on the first page of results. The same is true for my paid search clients. Is there a good way I can explain to them how Googleing themselves is not the best way to know if they are performing well? If there is an article out there that explains it that I can share that would be even better.
Paid Search Marketing | | GuardianOwlDigital0 -
How to Tell Google About My Near Duplicate Pages?
For my Adwords campaign, I create a separate landing page for each Ad Group, but are similar enough to one another that they may be considered duplicate content. Should I use a canonical tag on the page to tell Google which page is priority? I don't care about any of those pages ranking in search, I'm just using them for my ads. I also don't want to redirect, clearly. Is the canonical tag the correct way to go?
Paid Search Marketing | | Dino640 -
Yellow Pages advertising and ad sources
From experience I've always been telling clients of mine to stay from Yellow Pages advertising. It has been several years now and it seems that Yellow Pages not only offers just priority listings but also SEO and their own version of Adwords it seems. I received a call from a Yellow Pages sales rep today saying they can promise me 50k impression views for $500/month which is a campaign managed by them and they'll even create the ads as well. When I questioned them on their 9 million sources they have for generating these impressions, if these impressions are local or national they mentioned it works like Adsense in a way. I eventually declined their offer and figured I'd do some research. If I were to create an Adwords Display campaign with that kinda of budget and do it locally by my city, Adwords forecasts are no where near that kind of impression count, expanding the campaign out to all of Ontario would be closer but still not quite that high an impression count. I'm assuming YP doesn't have as large of a network compared to Google either which also makes me more doubtful. What I would really like to know is has anyone had any success with YP advertising compared to Adwords recently especially with their high costs for such services? And does anyone know where exactly YP, Google Adwords, Bing Ads get their web partners and sources from? I know there are ad revenue agencies like Metroland that sell their ad sources to such companies and was curious.
Paid Search Marketing | | FPK0 -
Google Analytics and WorldPay - Tracking Sales/Conversions
Hi there, I recently remember reading somewhere that tracking code could be used to monitor sales/conversions of eCommerce payments that went through WorldPay. I've been looking around the web for news stories, forums, discussions, but all seem to be from 2007 - 2011; was just wondering if anyone knew any up-to-date info they could point me towards? Thanks
Paid Search Marketing | | bricktech0 -
What are the strongest and most-Google friendly directories to place my business on for the sake of large SEO gains? for the sake of Exposure to customers? What is the best way to invest for ROI nowadays? Thanks.
I do basic SEO stuff as well as marketing for quite a few clients. But, I am wondering which directories or exposure based groups are worth the money? Is a business.com directory listing for $300 a solid investment to get a strong link? Is yext a good move? How about wildfire? I could use some really high DA links to stack on top of the link profiles I have already built through content, etc.? Please advise me. PS Confession: I was once a pre-panda Fiverr link junkie. But I am in recovery. I have an 18 month chip and am currently making amends. 12 steps to SEO freedom baby.
Paid Search Marketing | | creativeguy0 -
A question for Google Adwords experts
Hi Google Adwords experts, We own the trademarks to some keywords. When you search for these keywords, only our ads will ever appear but they don't appear every time a search is made. They're hardly ever appearing now that we've dropped our bid from $1+ to the minimum first page bid (1 cent in some cases). My question is; are the ads showing less because our bid has dropped so low? If so, why is this? If we own the trademark to the keyword and no one else can display ads, any bid that we submit should be accepted by Google, shouldn't it? If you can include a link to any articles that will give me more info, i'll vote for your answer. Thanks!
Paid Search Marketing | | HamiltonIsland0 -
What is the definition of 'Paid links' for Google ?
Many high authority sites are doing paid text linking and linking sites through 'Sponosred linking' sections, But, Google does not seem to be bothered. Just because they are already ruling the industry. Sponsored links are obviously not natural, they are absolutely paid, still Google is giving them priority that is why only people are paying huge for them. Please go through the website http://goo.gl/tgfH and see "Sponored link" section So, What actually Google considers as paid link? nNolr nNolr
Paid Search Marketing | | koamit0 -
Yellow Stars on Google Ads.
Hi, I see some Ads on google.de with a yellow stars. I was researching how they are doing this, and just read some topics online about that. And now, i now finally that this Stars are coming from Google Product Reviews on Google Shopping. I don't sell product, i do Financial Consulting, but those ADS on germany doing the same, our product is consulting. I created an Google Merchant Account, and product feed, but i don't know which is the easiest and fastest way to active this option to review the peoples my consulting-product like this one: http://www.google.de/products/seller?zmi=finanzcheck.de&hl=de&sa=X&ei=Qg4pT5OkMY-FhQfBxdCjBQ&ved=0CCMQwQY http://www.google.de/products/seller?zmi=creditplus.de&hl=de&sa=X&ei=Qg4pT5OkMY-FhQfBxdCjBQ&ved=0CCoQwQY http://www.google.de/products/seller?zmi=norisbank.de&hl=de&sa=X&ei=Qg4pT5OkMY-FhQfBxdCjBQ&ved=0CDEQwQY Can you tell me the steps, from A-Z how to configure all this? Thanks
Paid Search Marketing | | leadsprofi0