Google Shopping Feed being blocked by robots.txt
-
I had created a manual Google Shopping Feed that was working fine, and then someone well meaning put a block in my robots.txt file so Google couldn't read the images folder. because of this, Google now won't accept my feed.
I changed the robots.txt file to allow them to read the images again, but it's been 3 days now and I'm still getting the error saying my products are disallowed because the robots.txt file won't let them scan for images.
Does anyone know how long it will take for Google to see it again?
-
When I manually fetch, the /images folder isn't on the list anymore.
For now I have just reuploaded the images in to a new folder and I'm creating my feed by hand, so that should get around it for now.
Thanks for your help.
-
Did you try manually fetching as Googlebot the robots.txt file via the webmaster tools? If not, do that, then click submit to index. Then do the same thing for some of the images or better if you have a file linking to all images (like an image sitemap). Once that is done, let Google recrawl everything for a few days (even a week) and try again.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Product Ads
Hi,
Paid Search Marketing | | ChrisHolgate
I was wondering if I could ask is perhaps someone could give me some clarification as to how the amount we bid on Google Product Ads reflects the product positioning on Google Shopping? We have a Google Product Data Feed which is then linked up to our Adwords account so that we can determine a PPC bid amount. In instances like this it doesn't seem to make sense that one person may be paying 10ppc and another 20ppc when the buyers criteria for sorting merchants was purely down to the price. Since the buyer has the option to sort their products in price from minimum to maximum the sort order cannot be manipulated by Google based on the amount the merchant was paying. As such, how is determining a cost per click figure relevant when the customer is searching by base price low > high on Google Shopping? Surely I should just set the limit to £0.01 and rely on the customer determining the sort order (which ultimately will lead to a higher conversion rate) than allowing Google to skew the results based on bidding 20-30 times this amount? I should state that I'm in the UK. I do realise that a high PPC amount will increase our chance of exposure on standard search pages but my question does relate solely to results listed on Google Shopping. Thanks for your help! Chris0 -
Google certification
Hi Just wondering what everyones thoughts on Google certification? I was wondering if anyone had any experience doing the analytics and adwords tests? Do you feel they give you a benefit or advantage to others in your field? And also what is the cost of the exams? Thanks in advance
Paid Search Marketing | | TheZenAgency0 -
Why you should never use Google Adwords To Conduct Key Word Research
Buongiorno from 22 degrees C too damn humid Wetherby UK, The other day a client wanted to know how much a ppc campaign would cost with a specific bank of keywords. So off i went and loaded in the key words and set the ads thinking it was not live.... A week later i get a tap on the shoulder asking why weve been invoiced for £xxxx oh dio mio!! The damn campaign went to live. So ive got two questions: 1. Do Google adwords automatically go to Live once youve loaded up phrases and ads, i really thought it would have made it more obvious, A " Would you like your campaign to go live" prompt would have been appreciated. 2. As a safety measure is configuring a Google Alert in Analytics to ping when paid traffic is picked up not a bad idea just so ive got a warning sytem set up so to speak. Grazie tanto,
Paid Search Marketing | | Nightwing
David1 -
How Can I Target Certain Countries in Google AdWords without Excluding Other Countries?
So, here is the situation: Our company works with merchants worldwide (with the exception of those who live in excluded high-risk countries--mostly in Africa), but most of our Google AdWords leads come from Indian merchants. My CEO wants our campaigns to convert leads from other countries (i.e., the UK, Germany, US, Canada, Australia, etc.), but I have no idea how to do that without excluding India. However, my CEO does not want to exclude India from our AdWords campaigns as the leads are profitable. We simply want more diversity with out leads in terms of geographic location. I am sure there are resources on the Web about how to do this, but I am not an Adwords expert and am unsure of what phrases to search to find the answers. Direct advice or helpful links are much appreciated. Regards,
Paid Search Marketing | | Instabill
Meghan0 -
Increasing Google Ad spend - is it worth it
Hi We are currently spending approx £500 pcm on google ad words however if I increased this spend to £4000 pcm what kind of results would this achieve? For example would it just be more visits per day as the budget is larger? Also what is the best way to track the success of an adwords campaign - the ultimate goal of the campaign would be to generate a lead whether this be a phone call, email or using our book an appointment form. Our service covers a geographical area (Scotland) and for organic search we are doing well 1st pages listings for searches such as pvc doors edinburgh etc so I am unsure whether it's worth increasing my PPC spend or put more resource into SEO, or even Facebook ads?
Paid Search Marketing | | ocelot0 -
Ideas on how to track google display network traffic
Does anyone know of a good way to be able to track traffic from Google's display network to a site since this traffic doesn't show up under paid search traffic in Omniture? Thanks! -Margarita
Paid Search Marketing | | MargaritaS0 -
Google Adwords Book
Does anyone have a suggestion on a very recent Google Adwords book?
Paid Search Marketing | | phogan0