Google Shopping Feed being blocked by robots.txt
-
I had created a manual Google Shopping Feed that was working fine, and then someone well meaning put a block in my robots.txt file so Google couldn't read the images folder. because of this, Google now won't accept my feed.
I changed the robots.txt file to allow them to read the images again, but it's been 3 days now and I'm still getting the error saying my products are disallowed because the robots.txt file won't let them scan for images.
Does anyone know how long it will take for Google to see it again?
-
When I manually fetch, the /images folder isn't on the list anymore.
For now I have just reuploaded the images in to a new folder and I'm creating my feed by hand, so that should get around it for now.
Thanks for your help.
-
Did you try manually fetching as Googlebot the robots.txt file via the webmaster tools? If not, do that, then click submit to index. Then do the same thing for some of the images or better if you have a file linking to all images (like an image sitemap). Once that is done, let Google recrawl everything for a few days (even a week) and try again.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Adwords Clicks not registering properly???
Hello Moz World, I am running a Google Adwords campaign utilizing Google Search and Search Partners only. These are traditional text ads. When I look at the analytics through Google Adwords, I am seeing 60 clicks. Great! However, when I look through the keywords in the ad groups, none of my keywords are registering clicks. I also checked search terms under the keyword tab, and no keywords are populating. Where are my ads being clicked, and how can I view information on these clicks. This is a relatively new campaign, and I am still trying to figure out if I am targeting the right keywords. Thanks ahead of time for all the great responses! B/R Will H.
Paid Search Marketing | | MarketingChimp100 -
How does Google Home Services Ads work?
Hi mozzers, I have a plumber client who would like to try the Google Home Services ads but I have not found a guideline on this just yet. Do you know how to set it up? Do I need to use adwords or is it under another google product? The more details you guys have the better! Thanks
Paid Search Marketing | | Ideas-Money-Art0 -
Question regarding Google Adwords?
Just had a question regarding Google Adwords. I have an e-commerce store (kiwimodfurniture.com) in the furniture niche and I originally was planning to create a different ad group for each product. Since I have 1300 products I would have 1300 ad groups. However a lot of the products don't have enough search volume and Google won't display my ads. Then I decided to get a bit more broad. I plan on having an ad group for each sub category on my website. For example, modern lounge chairs, modern arm chairs, modern sofas, etc. Question: Is this too broad? Will the ROI be terrible because of this? Thanks!
Paid Search Marketing | | The_Kiwi_Man0 -
Social Media black hat methods - can google see this?
My site was hit by a Penguin or Panda, for some bad linking in 2012. Ever since then I have been 100% completely white hat, being careful who I pick to my marketing. Once burnt.... Recently, with all the hype of social media being the thing to help you boast rankings, it got me wondering about how Google really can monitor this. I saw this the other day on Elance... I need 5000 Facebook fans. They must be real looking and be coming from US IPs, Preferable real looking US accounts. If people are just going to get false Facebook fans, tweets etc.... then it is no better than all the bad linking. Perhaps Google will come out with Puma penalty (well we have pandas and penguins)
Paid Search Marketing | | Llanero0 -
Increasing Google Ad spend - is it worth it
Hi We are currently spending approx £500 pcm on google ad words however if I increased this spend to £4000 pcm what kind of results would this achieve? For example would it just be more visits per day as the budget is larger? Also what is the best way to track the success of an adwords campaign - the ultimate goal of the campaign would be to generate a lead whether this be a phone call, email or using our book an appointment form. Our service covers a geographical area (Scotland) and for organic search we are doing well 1st pages listings for searches such as pvc doors edinburgh etc so I am unsure whether it's worth increasing my PPC spend or put more resource into SEO, or even Facebook ads?
Paid Search Marketing | | ocelot0 -
Google Analytics and Adwords Tracking Codes
A site I help someone with in link building was recently redesigned. I do not have access to the site in any way. Well, after the redesign, no conversions were tracking in Adwords and Analytics ecommerce tracking showed no transactions and no amounts. I found the Analytics code and sent it to their programmer. I have linked the Adwords and Analytics accounts. So now conversions are tracked in Adwords and transactions are tracked in Analytics. However, amounts have vanished and not returned. I'm not technically savvy enough to figure this out. How do I get this Analytics code to track transaction amounts so that they appear in Adwords and in Analytics ecommerce tracking?
Paid Search Marketing | | DanDeceuster0 -
Google Adwords Book
Does anyone have a suggestion on a very recent Google Adwords book?
Paid Search Marketing | | phogan0 -
Rating Snippet on Google SERP
Hi Mozers, I have question today. I see lot of Serps with rating review on the snippet, good i am reading on google about that, and i placed it on my website and i checked it, through google test tool and it works! My question is: Which type of rating system can i use on Google Adwords? Only shoping rating, or can i use the same rating system of my content and not on any product-shop on google? Can you tell me please! Thanks, Meti.
Paid Search Marketing | | leadsprofi0