Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Google Shopping Feed being blocked by robots.txt
-
I had created a manual Google Shopping Feed that was working fine, and then someone well meaning put a block in my robots.txt file so Google couldn't read the images folder. because of this, Google now won't accept my feed.
I changed the robots.txt file to allow them to read the images again, but it's been 3 days now and I'm still getting the error saying my products are disallowed because the robots.txt file won't let them scan for images.
Does anyone know how long it will take for Google to see it again?
-
When I manually fetch, the /images folder isn't on the list anymore.
For now I have just reuploaded the images in to a new folder and I'm creating my feed by hand, so that should get around it for now.
Thanks for your help.
-
Did you try manually fetching as Googlebot the robots.txt file via the webmaster tools? If not, do that, then click submit to index. Then do the same thing for some of the images or better if you have a file linking to all images (like an image sitemap). Once that is done, let Google recrawl everything for a few days (even a week) and try again.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Google Ads Subdomain in sitelinks & Composition Change for Strategy Status
I have a basic query but could not find a definite answer on the internet. I am currently running a campaign for the main website of a big education brand and they also have a secondary learning website on subdomain, and I want to add sitelinks of subdomain to the campaign, but I am not sure whether it is allowed or not. The brand I am running ads for is https://www.rauias.com/ and the secondary website is https://compass.rauias.com/ branded slightly different in a subdomain, so should I add the sitelinks of Compass to the main campaign? Also one more silly question My Max Conversion search campaign gave me this status today. "Learning (composition change): Campaigns have been added to or removed from the bid strategy. Google Ads is now adjusting to optimize bids. 5 days left for learning" What does this mean exactly? And Why does it reenter the learning phase whenever I make a small change?
Paid Search Marketing | | rauoff0 -
Clients Keep Googling Themselves
Hi, I have a common problem with my clients where they google their own business name or keywords they want to rank for and freak out when they don't show up on the first page of results. The same is true for my paid search clients. Is there a good way I can explain to them how Googleing themselves is not the best way to know if they are performing well? If there is an article out there that explains it that I can share that would be even better.
Paid Search Marketing | | GuardianOwlDigital0 -
How to deal with the InCorrect Price Issue for the Google Shopping Product Listing Ads?
Hello All, Yesterday when i was checking with the one of the search term for "canvas prints"..i come to know that one of the advertiser EasyCanvasPrints.com is showing Incorrect price. On Search result they guys are showing $7.46 incorrect price for the PLA - Product listing ads. Go to below links: https://www.google.com/search?hl=en&site=webhp&tbs=vw:l,mr:1,seller:8521978&tbm=shop&q=canvas+prints&sa=X&ved=0CJkGELMrahUKEwjmj-PSgfzIAhUHBY4KHc0VBBQ https://www.google.com/?gws_rd=ssl#q=canvas+prints&tbm=shop https://www.google.com/?gws_rd=ssl#q=canvas+prints&start=0 But when we click on it then i can not this price $7.46 http://www.easycanvasprints.com/single-canvas?singlecanvas=1&height=19&width=14&pcode=5345334C6B74647246774137536C786768544B5458776C35644F747855796D39&utm_source=google_base&utm_medium=data_feed I have done various claim and send to Google support about this misguiding price for the Easy Canvas Prints but they not taking any actions on it. Guy Can u please help me how can i pass this message to Google to take actions for this advertiser? Waiting for your reply Regards Dinesh
Paid Search Marketing | | CommercePundit0 -
Hire Products on Google Shopping
Has anyone got any experience with advertising products for hire rather than for sale on Google Shopping? Is it allowed? How does it perform?
Paid Search Marketing | | ese0 -
Why does my google analytics show a massive discrepancy from facebook's reported website clicks?
We're running a Facebook news feed ad that is pointing at our homepage. Facebook says that for yesterday there were 47 website clicks. Google analytics shows 15 total visitors from facebook with 3 of them landing on the homepage. I understand that there is likely going to be some discrepancy with users accidentally clicking and clicking back before the page loads, but this seems a little insane. I tested the ad using a page that pulls the Analytics cookie data using php and it is working properly so I don't understand what's happening. The url isn't tagged with utm parameters, which is going to be fixed. Anyone experience this or have any insight as to what could be this issue? Is this click fraud? Edit: For more clarification I was checking on my completely unfiltered google analytics profile/view.
Paid Search Marketing | | spencerhjustice0 -
CPC or CPM for Google Display Network?
HI all I'm setting up my first Remarketing campaign on the display network. I'm targeting those that have visited a specific product page at the moment and therefore there won't be a massive amount of traffic to remarket to - roughly no more than 50 clicks/day. My question is - what is the best bidding option for a campaign like this? Not sure whether to go for CPM or traditional CPC. I have previously found CPM much better for Facebook but obviously thats very different to Google. All help appreciated!
Paid Search Marketing | | SamMaley0 -
Increasing Google Ad spend - is it worth it
Hi We are currently spending approx £500 pcm on google ad words however if I increased this spend to £4000 pcm what kind of results would this achieve? For example would it just be more visits per day as the budget is larger? Also what is the best way to track the success of an adwords campaign - the ultimate goal of the campaign would be to generate a lead whether this be a phone call, email or using our book an appointment form. Our service covers a geographical area (Scotland) and for organic search we are doing well 1st pages listings for searches such as pvc doors edinburgh etc so I am unsure whether it's worth increasing my PPC spend or put more resource into SEO, or even Facebook ads?
Paid Search Marketing | | ocelot0 -
What is a good CTR for a Google AdWords Remarketing banner campaign?
Hello there, given that in the banners we offer a promotion with "some bonus if you sign up", what is from your experience a good CTR for a Google AdWords Remarketing banner campaign? Many thanks to everyone that answers. YESdesign
Paid Search Marketing | | YESdesign0
