Google Shopping Feed being blocked by robots.txt
-
I had created a manual Google Shopping Feed that was working fine, and then someone well meaning put a block in my robots.txt file so Google couldn't read the images folder. because of this, Google now won't accept my feed.
I changed the robots.txt file to allow them to read the images again, but it's been 3 days now and I'm still getting the error saying my products are disallowed because the robots.txt file won't let them scan for images.
Does anyone know how long it will take for Google to see it again?
-
When I manually fetch, the /images folder isn't on the list anymore.
For now I have just reuploaded the images in to a new folder and I'm creating my feed by hand, so that should get around it for now.
Thanks for your help.
-
Did you try manually fetching as Googlebot the robots.txt file via the webmaster tools? If not, do that, then click submit to index. Then do the same thing for some of the images or better if you have a file linking to all images (like an image sitemap). Once that is done, let Google recrawl everything for a few days (even a week) and try again.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Top of funnel google ads campaign not hardly converting, why?
Hi, I really hope someone can help me with this. I'm running two search ad campaigns and a google shopping campaign in google ads. The search campaigns are targeting top-of-funnel keywords as the business doesn't have universally known collections which everyone would search for so they are just unique to my business. So the campaigns are driving traffic but really converting whereas google shopping is converting because searchers are looking for particular products so they're lower down the funnel closer to aking a purchase decision. I feel I've optimised the campaign well and for the most part, most keywords have 7/10 quality score. The landing page seems fine. However, our offering wasn't as strong as competitors so we've offered a discount the same as them to compete. Since I started google ads we have nearly doubled our monthly revenue and the product types targeted in campaigns have increased in quantity sold so it seems it's having an effect but the campaigns aren't showing a good performance. Does anyone have any suggestions or input that could help me? I looked at first interaction attribution model and even there it's not performing well which makes this even more difficult to resolve. I'm thinking I should enable USER id feature in Google analytics so i can track signed in users across devices which may then help attribute sales to paid search channel as I saw in search console that the keyword that generates the most traffic to the site is our brand name and we're not a well-known brand so makes me think they may be starting their buyer's journey on a work computer on their mobile and finishing on their computer at home as an example. However, I don't believe this will be the main cause or solution as I would only have data for signed in users which still won't give me the full picture. Also if the campaign is optimised effectively but conversions are minimal could not having many conversions affect quality score? If someone can help or provide me with a different perspective it would be much appreciated. Please let me know if I need to clarify or explain further. I hope I've made myself clear. Thanks, T
Paid Search Marketing | | TZ19820 -
Google Analytics showing my Adwords campaign bounce rate at 0%
I am relatively new to Adwords, and I can't figure out why the Adwords section of Analytics is showing all my site visitors at 0% bounce rate. Does that mean the account connection is not done right? Obviously Google ads are not a 0% bounce rate. If I can't get that to work, does anyone know how Google ads appear in Traffic? Is it Direct or Referral? I'm sure there's some simple answer I'm just not aware of, I would appreciate anyone's help. Thanks!
Paid Search Marketing | | Crystalline_150 -
Google Remarketing Targeting
I've been thinking lately about employing re-marketing in AdWords, and have been doing some research on it. My findings keep pointing to the fact that you can't target only people who visited your site but didn't convert. I keep thinking this cannot be true because it's simply too ludicrous to be. Why else would you want to use re-marketing? Can someone please either confirm or deny this? Thanks
Paid Search Marketing | | UnderRugSwept0 -
Do UTM Parameters reflect in Google Analytics
Hi, We have recently enabled auto tagging in our URLs but not sure if tagging is working correctly. Does Google Analytics shows the utm parameters also in URLs in Google Analytics OR Google shows only the base url (after removing utm parameters) in Analytics. For example: Will http://www.abc.com/?utm_source=Indiaweb&utm_medium=Display&utm_campaign=CPC&utm_content=NRI_newprojects&utm_term=US be shown as is in Google Analytics under PAID Tab or only http://www.abc.com/ will be shown and the utm parameters will be removed in Analytics if auto tagging is enabled. Thanks in Advance 🙂 Regards Anirban
Paid Search Marketing | | vivekrathore0 -
Best practice to separate paid from organic conversions in Google Analytics
I have a PPC campaign for a client with standalone landing pages with a form, not reachable from the website (although in the same domain). I've added the AdWords conversion code to the "thank you" page and I also added a Goal in
Paid Search Marketing | | DoMiSoL
Google Analytics whose counter is increased every time the thank you page is reached. This way I can track conversions with both AdWords and Analytics. Is that correct? Should I import back in AdWords the goals from Analytics, as suggested in the AdWords account? I have another landing page with a form in the website, where I send users coming from
organic search, so I set up a second goal in Analytics for the thank you page of this form. Is this the reason why I am supposed to import in AdWords the analytics' goals, so that I could see both kind of conversions in both accounts? But the most important question is: If I send both PPC/organic visitors to the same landing page is there still a way to separate PPC from Organic conversions? Thank you very much for your advice. DoMiSoL Rossini0 -
Google Adwords Conversion Tracking - Recording Wrong Page
Hi Guys I have a problem with my Google Adwords conversion tracking. Basically whenever I check to see which page it is recording, it shows me the incorrect one. Now I probably checked a thousand time now and the conversion tracking code is not on this specific page, but is on the one that I really want to track. I have also checked that the code is correct and that there is nothing missing. But strangely enough when I look at historical data, it does show that is was tracking conversions on the correct page, but for some reason the past couple of weeks it's reporting conversions from another page, which is the incorrect one. If somebody could please give me some insight as to what could maybe be the cause of this, I would appreciate it. Thank You Dave
Paid Search Marketing | | DavidZA10 -
SIte wide links by google display / adsense
hey guys, I had a quick question about my back links that might be coming from adsense. I am trying to help my father our on his site and help him recover from penguin. unfortunately his company hired some shady SEOers to do "SEO". little did my dad know the BLs he were getting might be spammy, thats what I am checking now. When I ran a BL report on him ( i use two tools, SEO spyglass and OSE ) i found that there were many "sitewide" links, but i dont think there were placed there by the webmaster, i think they come from adsense. I know he has a PPC campaign where the daily spend is 3k/ day so I know its very possible that this might be the case. If my tool is picking up BLs from these sites ( which are niche related ) does google count these links for ranking purposes? and might this hurt my rankings if google just sees these as "sitewide links"
Paid Search Marketing | | david3050 -
Google PPC Management
Okay, so I have a client who wants me to manage their ppc on Google. It seems like either they give me access to their PPC account or I manage it via my own account and pre-bill for the cost, later supplying reports. Are those the two options? Thanks...MJ
Paid Search Marketing | | 945010