Google Shopping Feed being blocked by robots.txt
-
I had created a manual Google Shopping Feed that was working fine, and then someone well meaning put a block in my robots.txt file so Google couldn't read the images folder. because of this, Google now won't accept my feed.
I changed the robots.txt file to allow them to read the images again, but it's been 3 days now and I'm still getting the error saying my products are disallowed because the robots.txt file won't let them scan for images.
Does anyone know how long it will take for Google to see it again?
-
When I manually fetch, the /images folder isn't on the list anymore.
For now I have just reuploaded the images in to a new folder and I'm creating my feed by hand, so that should get around it for now.
Thanks for your help.
-
Did you try manually fetching as Googlebot the robots.txt file via the webmaster tools? If not, do that, then click submit to index. Then do the same thing for some of the images or better if you have a file linking to all images (like an image sitemap). Once that is done, let Google recrawl everything for a few days (even a week) and try again.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
304 "If Modified Header" Triggers Error in Google Ads?
We have a client who is launch some Google Ads campaigns, and they recently asked us to fix 304 "Errors" on their website as per this feedback: "When we inspected the website we came across a number of 304 status errors. In order to get the ads running, we will need all of the website domain status codes converted to 200. “ Of course, all of their website pages return a 200 Status, it's just the HTTP headers that additionally clarify with a 304 Response (not an error). Has anyone else ever run into this issue with Google Ads? IMHO it makes no sense to remove this functionality. Google has even recommended in the past to use this it: https://webmasters.googleblog.com/2008/11/date-with-googlebot-part-ii-http-status.html Thanks for any tips or feedback!
Paid Search Marketing | | mirabile0 -
Google Analytics Matched Search Query Not Working
On Google analytics for our clients when you check the Matched Search Query under Traffic Sources > Overview, it says "There is no data for this view.". I have Google searched it and i am not finding my answer to why this is not displaying my information. On my personal analytics account when i clicked on matched search query it displays exactly what the person searched when it trigered my adwords ad. I have no idea why this account doesn't display the same info when it appears to be setup in the same way. Example: If i am broad match targeting the keyword "outdoor sports", and someone searched "Canadian outdoor sports for kids" It would show exactly what they searched under Matched Search Query. Anyone know how to resolve this issue?
Paid Search Marketing | | VITALBGS0 -
Google Remarketing Tag
Is the code snippet for a Google Remarketing Tag specific to one domain, or will it collect the audience list for any webpage(s) of any domain? Best,
Paid Search Marketing | | ChristopherGlaeser
Christopher0 -
SIte wide links by google display / adsense
hey guys, I had a quick question about my back links that might be coming from adsense. I am trying to help my father our on his site and help him recover from penguin. unfortunately his company hired some shady SEOers to do "SEO". little did my dad know the BLs he were getting might be spammy, thats what I am checking now. When I ran a BL report on him ( i use two tools, SEO spyglass and OSE ) i found that there were many "sitewide" links, but i dont think there were placed there by the webmaster, i think they come from adsense. I know he has a PPC campaign where the daily spend is 3k/ day so I know its very possible that this might be the case. If my tool is picking up BLs from these sites ( which are niche related ) does google count these links for ranking purposes? and might this hurt my rankings if google just sees these as "sitewide links"
Paid Search Marketing | | david3050 -
Google Adwords Conversion Tracking Code Help - Not Showing Conversions
Hi, all. I am having issues with a clients website. They have their website developed by a company http://www.flowerstoreinabox.com.au/ my clients website is http://www.flawlessflowers.com.au the google adwords conversion tracking code has been added to their site. It measures all details as far as ads clicked on, etc.. the only part that is not been measured is the conversions of the adwords campaign. So I cannot see if the ads are successful or what their conversion % is. I have looked at the code on the thank you page and the google adwords conversion code is present on the thank you page after the sale. I am not a coder and so not sure what to look at if all the details on the checkout page exist in the code to measure the adwords conversion ecommerce transactions correctly. I have provided a link to the source code of the competed order page. If someone could look at the code and provide any assistance I would appreciate it. http://dl.dropbox.com/u/16973368/7 may adwords flawless flowers.txt I am also happy to provide you access to the google analytics account if required just give me your email address to set it up. Thanks for all your help Regards Arthur
Paid Search Marketing | | VivaArturo0 -
Adsense and e-shops.To do or not?
I own a furniture e-shop with 240K pageviews per month. Should I put Adsense to gain some more money? Or it would drive my customers away? I see many e-shops using Adsense advertising. Is there a good reason not to use it ?
Paid Search Marketing | | Christos650 -
Google Analytics and Adwords Tracking Codes
A site I help someone with in link building was recently redesigned. I do not have access to the site in any way. Well, after the redesign, no conversions were tracking in Adwords and Analytics ecommerce tracking showed no transactions and no amounts. I found the Analytics code and sent it to their programmer. I have linked the Adwords and Analytics accounts. So now conversions are tracked in Adwords and transactions are tracked in Analytics. However, amounts have vanished and not returned. I'm not technically savvy enough to figure this out. How do I get this Analytics code to track transaction amounts so that they appear in Adwords and in Analytics ecommerce tracking?
Paid Search Marketing | | DanDeceuster0 -
Paid Comparison Shopping Engines
I am looking into starting to use the comparison shopping engines. Any ideas on where to start wtih this? Is there a good place to go that would manage all the different sites?
Paid Search Marketing | | Shopadorn0