Google Shopping Feed being blocked by robots.txt
-
I had created a manual Google Shopping Feed that was working fine, and then someone well meaning put a block in my robots.txt file so Google couldn't read the images folder. because of this, Google now won't accept my feed.
I changed the robots.txt file to allow them to read the images again, but it's been 3 days now and I'm still getting the error saying my products are disallowed because the robots.txt file won't let them scan for images.
Does anyone know how long it will take for Google to see it again?
-
When I manually fetch, the /images folder isn't on the list anymore.
For now I have just reuploaded the images in to a new folder and I'm creating my feed by hand, so that should get around it for now.
Thanks for your help.
-
Did you try manually fetching as Googlebot the robots.txt file via the webmaster tools? If not, do that, then click submit to index. Then do the same thing for some of the images or better if you have a file linking to all images (like an image sitemap). Once that is done, let Google recrawl everything for a few days (even a week) and try again.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Best way to present Google Display /Search Reports
Hi Everyone Im just looking to produce some quite detailed analysis and overview of out google search and display adverts. Can someone suggest a format or template for the best way to present this information as welll as what sort of information would be best to include
Paid Search Marketing | | aplnz20170 -
Gap in Google PPC Ads & Organic search results - New test by Google?
Hi All, Just noticed an unusual gap in PPC ads and organic search results in google NZ. while searched the same term in Google AU, it wasn't the same. Did anyone here see something similar? Is this a new test by Google to get more clicks on PPC ads and pushing down organic results? Looking forward to hear from the community. Cheers, Rattan wcB6DL1.jpg
Paid Search Marketing | | FRL0 -
How To Increase Clicks In Google Shopping?
I have about 613 furniture products in Google shopping and am getting about 2 clicks a day. Any tips on getting more clicks? Current budget is $10 a day at $0.01 per click bid. Should I increase my bid per click or add more products or both? Thanks!
Paid Search Marketing | | The_Kiwi_Man0 -
How do I print off Google Adwords Certification certificate through Google Partners?
Hey everyone, How do I print off Google Adwords Certification certificate through Google Partners?
Paid Search Marketing | | jhinchcliffe1 -
Paid Search Visits Not Showing Up in Google Analytics
Hey all, Just took over SEM for my company, and noticed a bit of a problem with GA. Whereas Adwords has registered 141 clicks on paid campaigns that go to the site, GA has tracked only 5 vists in that time. Two things of note: The GA account was not linked to the Adwords account until today, and also, auto-tagging was not turned on. I understand these two things are important to having proper GA tracking, but I just want to make sure that there aren't any other things I should check right now to make sure I start to see tracked paid visits again. Is there anything else I should try? Cheers.
Paid Search Marketing | | danny.wood0 -
Google Analytics Code
I have an ecommerce website and have installed the Google Analytics Code. i am also spending the money for google adwords. i m getting clicks and as well as orders but in google analytics it show that i am getting all the traffic from organic search results whereas my daily budget get exhausted and i do get business for the keywords i bid. i want to ask is there a problem with adwords or anlytics. Or have i placed the wrong code or have placed the code not in a proper format.
Paid Search Marketing | | seosogo0 -
What are the strongest and most-Google friendly directories to place my business on for the sake of large SEO gains? for the sake of Exposure to customers? What is the best way to invest for ROI nowadays? Thanks.
I do basic SEO stuff as well as marketing for quite a few clients. But, I am wondering which directories or exposure based groups are worth the money? Is a business.com directory listing for $300 a solid investment to get a strong link? Is yext a good move? How about wildfire? I could use some really high DA links to stack on top of the link profiles I have already built through content, etc.? Please advise me. PS Confession: I was once a pre-panda Fiverr link junkie. But I am in recovery. I have an 18 month chip and am currently making amends. 12 steps to SEO freedom baby.
Paid Search Marketing | | creativeguy0 -
Recommend a company for Google Product Feed?
Hi there, Is there a Google Product feed company you've used and can recommend? We're not looking for anyone to manage the Adwords end of it, just help set-up/submit the data feed. I'm NOT looking for a free option, I'm looking for a reliable, efficient way to get the feeds set-up and updated. Thanks!
Paid Search Marketing | | marketingcupcake0