Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Google Shopping Feed being blocked by robots.txt
-
I had created a manual Google Shopping Feed that was working fine, and then someone well meaning put a block in my robots.txt file so Google couldn't read the images folder. because of this, Google now won't accept my feed.
I changed the robots.txt file to allow them to read the images again, but it's been 3 days now and I'm still getting the error saying my products are disallowed because the robots.txt file won't let them scan for images.
Does anyone know how long it will take for Google to see it again?
-
When I manually fetch, the /images folder isn't on the list anymore.
For now I have just reuploaded the images in to a new folder and I'm creating my feed by hand, so that should get around it for now.
Thanks for your help.
-
Did you try manually fetching as Googlebot the robots.txt file via the webmaster tools? If not, do that, then click submit to index. Then do the same thing for some of the images or better if you have a file linking to all images (like an image sitemap). Once that is done, let Google recrawl everything for a few days (even a week) and try again.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Website is flagged as Compromised Site by Google
Hi everyone, We have been running Google Ads for a while now and last week all of our Google Ads were paused with reason Compromised Site. We reached out to Google and they identify this page as one of the affected page: https://manpower.com.vn/vi/dich-vu-san-dau-nguoi-and-tu-van-nhan-su-cap-cao? The malicious links they found are:
Paid Search Marketing | | ManpowerVietnam
• googie-anaiytics[.]com
• vty68[.]net We have asked our Website vendor to scan and they found nothing. We would be greatly appreciated if you could help. I tried Google Search Console and even the tool Google Safe Browsing that Google itself suggested but both the tools showed that our website does not have any malicious links at all. And yet Google Ads support team keeps telling us our page contains these links. I am wondering if anyone in the community has experienced this before and how did you address this issue. Or could you guys please help to share any tools that you know can do a deep scan on this page and if possible our entire website to help us identify where the links are located? Please let me know if you need any additional information from us and I would be happy to provide it.3 -
Website is flagged by Google as Compromised Site
Hi everyone, We have been running Google Ads for a while now and last week all of our Google Ads were paused with reason Compromised Site. We reached out to Google and they identify this page as one of the affected page: https://manpower.com.vn/vi/dich-vu-san-dau-nguoi-and-tu-van-nhan-su-cap-cao? The malicious links they found are:
Paid Search Marketing | | ManpowerVietnam
• googie-anaiytics[.]com
• vty68[.]net We have asked our Website vendor to scan and they found nothing. We would be greatly appreciated if you could help. I tried Google Search Console and even the tool Google Safe Browsing that Google itself suggested but both the tools showed that our website does not have any malicious links at all. And yet Google Ads support team keeps telling us our page contains these links. I am wondering if anyone in the community has experienced this before and how did you address this issue. Or could you guys please help to share any tools that you know can do a deep scan on this page and if possible our entire website to help us identify where the links are located? Please let me know if you need any additional information from us and I would be happy to provide it.1 -
Unsolved How should I update the grouping of keywords in a google ads account
hi, I have a google adwords account running for a while in a fairly competitive market in a major city so there is only one geo location with many suburbs or council areas as popular searched. I have keywords that are 2-4 words long and very similar. I have had one keyword in its own campaign, several in one campaign and a location campaign. The location campaign has several adgroups for specific suburbs. My question is that the most popular search terms are similar but in different campaigns and I am wondering if this is not the best way. for example I have these keywords in separate campaigns as exact match and phrase match
Paid Search Marketing | | salliWW
rubbish removal
rubbish removal near me
rubbish removal Washington But the way google uses exact match seems to be changing and I am concerned these would be best in one adgroup. Also these keywords trigger similar phrases, for example, waste removal. Is it best to put them in one campaign with one ad group or one campaign with separate adgroups, or leave as is. As competition has increased I need to bid for top of page now and need to keep budget rises as little as possible..0 -
301 Redirects and Google Shopping Feeds
I am moving my site from Volusion to Shopify. The domain remains the same but the URL paths are different. With respect to my Google Shopping feed, is it best to send old URLs (with 301 redirects) or to send the new URLs?
Paid Search Marketing | | vgusvg0 -
Looking at google shopping results from other country
Hi, I run shops in several languages out of London. One of our key revenue drivers is google shopping. It is important for me to look the the shopping search results for example in germany. Recently Google changed something so when I want to look at the german shopping results from here, eg. http://www.google.de/shopping it always shows me the english ones with prices in pounds. Is there a trick to still get the foreign results? Thanks in advance Dieter
Paid Search Marketing | | Storesco1 -
Google Analytics showing my Adwords campaign bounce rate at 0%
I am relatively new to Adwords, and I can't figure out why the Adwords section of Analytics is showing all my site visitors at 0% bounce rate. Does that mean the account connection is not done right? Obviously Google ads are not a 0% bounce rate. If I can't get that to work, does anyone know how Google ads appear in Traffic? Is it Direct or Referral? I'm sure there's some simple answer I'm just not aware of, I would appreciate anyone's help. Thanks!
Paid Search Marketing | | Crystalline_150 -
Why does my google analytics show a massive discrepancy from facebook's reported website clicks?
We're running a Facebook news feed ad that is pointing at our homepage. Facebook says that for yesterday there were 47 website clicks. Google analytics shows 15 total visitors from facebook with 3 of them landing on the homepage. I understand that there is likely going to be some discrepancy with users accidentally clicking and clicking back before the page loads, but this seems a little insane. I tested the ad using a page that pulls the Analytics cookie data using php and it is working properly so I don't understand what's happening. The url isn't tagged with utm parameters, which is going to be fixed. Anyone experience this or have any insight as to what could be this issue? Is this click fraud? Edit: For more clarification I was checking on my completely unfiltered google analytics profile/view.
Paid Search Marketing | | spencerhjustice0 -
How Can I Target Certain Countries in Google AdWords without Excluding Other Countries?
So, here is the situation: Our company works with merchants worldwide (with the exception of those who live in excluded high-risk countries--mostly in Africa), but most of our Google AdWords leads come from Indian merchants. My CEO wants our campaigns to convert leads from other countries (i.e., the UK, Germany, US, Canada, Australia, etc.), but I have no idea how to do that without excluding India. However, my CEO does not want to exclude India from our AdWords campaigns as the leads are profitable. We simply want more diversity with out leads in terms of geographic location. I am sure there are resources on the Web about how to do this, but I am not an Adwords expert and am unsure of what phrases to search to find the answers. Direct advice or helpful links are much appreciated. Regards,
Paid Search Marketing | | Instabill
Meghan0