Google Shopping Feed being blocked by robots.txt
-
I had created a manual Google Shopping Feed that was working fine, and then someone well meaning put a block in my robots.txt file so Google couldn't read the images folder. because of this, Google now won't accept my feed.
I changed the robots.txt file to allow them to read the images again, but it's been 3 days now and I'm still getting the error saying my products are disallowed because the robots.txt file won't let them scan for images.
Does anyone know how long it will take for Google to see it again?
-
When I manually fetch, the /images folder isn't on the list anymore.
For now I have just reuploaded the images in to a new folder and I'm creating my feed by hand, so that should get around it for now.
Thanks for your help.
-
Did you try manually fetching as Googlebot the robots.txt file via the webmaster tools? If not, do that, then click submit to index. Then do the same thing for some of the images or better if you have a file linking to all images (like an image sitemap). Once that is done, let Google recrawl everything for a few days (even a week) and try again.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Running Google Ad Grants? How Much Is Your Monthly Spend?
Hi all - here's a question for everyone running Google Ads through the Ad Grant. How much of the $10,000 available to your account per month do you actually end up spending? I'm trying to see if I am in line with others in the industry. Would you mind sharing with me the type of nonprofit and the amount you're able to spend of the grant per month, on average? Thank you!
Paid Search Marketing | | newwhy0 -
Looking at google shopping results from other country
Hi, I run shops in several languages out of London. One of our key revenue drivers is google shopping. It is important for me to look the the shopping search results for example in germany. Recently Google changed something so when I want to look at the german shopping results from here, eg. http://www.google.de/shopping it always shows me the english ones with prices in pounds. Is there a trick to still get the foreign results? Thanks in advance Dieter
Paid Search Marketing | | Storesco1 -
How Do I Track AdCenter Keyword Data in Google Analytics?
Like everyone else, I am looking for new ways to gather as much keyword data as I can in the wake of the dreaded (not provided) epidemic. This question focuses on keyword data from Paid Search. We all know this is very simple with AdWords because the data is right there in Google Analytics. MSN adCenter, however, is a different story as these parameters need to be added to the end of each destination URL. Here are the parameters I'm using: utm_source=Bing&utm_medium=cpc&utm_term={QueryString}&utm_content={AdID}&utm_campaign=Leads Everything is working well with the exception of {QueryString} which is returning nothing. I would really like to solve this issue because I do not have the time to add specific parameters for each keyword in all of my campaigns. Any advice would be greatly appreciated!
Paid Search Marketing | | IDASEO0 -
How does this company have more characters than allowed on Google Ads?
I thought this was weird and was wondering if anyone knows the answer to this... I attached the image so you can see what I mean. How does this company get away with having more characters than what Google Adwords allows? And why is there a "block ads from" thing underneath this ad, but not the others? Sorry for the bad arrow, I'm on Windows XP lol Thanks you 🙂 G2d9gIr.jpg
Paid Search Marketing | | jhinchcliffe1 -
How can i track keywords of Google Product Listing Ads in Google Analytics
I have thousands of products in my feed to Google Shopping (Google Merchant Center). I have also set utm source, medium and campaign in URL. I have integrated my Google Adwords(With Auto Tagging) with my Google Merchant Center. My Question is, I can see campaign in google analytics but inside campaign i am not able to see keywords (From which those click are being received) I wonder to know that does anyone can help me to track Product Listing Ads keywords in Google Analytics. Thanks,
Paid Search Marketing | | CommercePundit0 -
Google Adwords Conversion Tracking Code Help - Not Showing Conversions
Hi, all. I am having issues with a clients website. They have their website developed by a company http://www.flowerstoreinabox.com.au/ my clients website is http://www.flawlessflowers.com.au the google adwords conversion tracking code has been added to their site. It measures all details as far as ads clicked on, etc.. the only part that is not been measured is the conversions of the adwords campaign. So I cannot see if the ads are successful or what their conversion % is. I have looked at the code on the thank you page and the google adwords conversion code is present on the thank you page after the sale. I am not a coder and so not sure what to look at if all the details on the checkout page exist in the code to measure the adwords conversion ecommerce transactions correctly. I have provided a link to the source code of the competed order page. If someone could look at the code and provide any assistance I would appreciate it. http://dl.dropbox.com/u/16973368/7 may adwords flawless flowers.txt I am also happy to provide you access to the google analytics account if required just give me your email address to set it up. Thanks for all your help Regards Arthur
Paid Search Marketing | | VivaArturo0 -
Adwords Product Listing Ads & Google Analytics mis-reporting
I hope you're sitting comfortably, this could be a long one and loaded with questions! Cut to the chase: Why is traffic from google product ads showing as 'organic' traffic in GA? Here's the scenario: Google Shopping I have thousands of products in a feed to google shopping (froogle, google base, google merchant, whatever you like to call it, I'll settle for google shopping for the purpose of this question). The URLs of this feed is tagged with GA tracking data (notably utm_source=GoogleBase&utm_medium=Product-Search), I have also tagged this with internal tracking which comes through in the back-end to assign orders to that specific source. In this case 'GOOGLEBASE'. Adwords Product Listing Ads As you know, a new (ish) feature of adwords pulls in your products from google shopping so that you get a richer ad (image, title, price) and displays this in the 'advert section' of the SERP. Once setting up a few of these, I noticed I was getting a fair amount of traffic for these new ads, taking one example, which resided in a relatively specific ad group (advertising Aviation Snips). Naturally, I wanted to find out which keywords were driving that traffic in order to improve the ads, or kill them if they weren't working. What was interesting is that I can't find anything about that traffic anywhere in adwords or google analytics. 254 clicks to 'aviation snips' must show up somewhere in analytics, if not the keywords, then what about the product? Analytics is showing nothing like that quantity of visits to those product landing pages where you'd expect. It's like ghost traffic. Google Analytics Since experimenting with product listing ads the organic traffic in GA has suddenly shot up, looking at the new keywords they are all queries which when I test them show up product listing ads in the SERP so it's obviously the paid listing ads driving this traffic. Why is google reporting these as organic, rather than paid? I also noticed a keyword appear as * in the PAID segment of analytics. I thought this was my missing aviation snips traffic, but digging into the landing pages for the * keyword, they are many different ones. There's a connection between the * and product listing ads, but what is it? Is the traffic being doubly reported? Back End Meanwhile we've seen an increase for orders tagged in the back-end of GOOGLEBASE which makes sense - google are pulling in my google shopping feed into the paid part of the SERPs and these are generating sales. Here are some of my initial thoughts / theories: 1. When google pulls in google shopping results into the organic part of the SERP, these get reported as ORGANIC in google analytics, even if you've tagged them otherwise. It seems they strip the tags out. This makes it very difficult to know if your google shopping feed is working well, or if you are doing well on standard organic traffic. 2. Google isn't separating out traffic as PAID with their new product listing ads, completely skewing the reports. It makes it look like you've gained great natural organic listings when if fact you are paying. 3. With relation to the missing Aviation Snips data - maybe google is showing a huge variety of products for that adgroup (even though it's specific) and therefore I can't see the traffic to the specific products that you'd expect. This I'm most confused about and wondered if I've missed a trick in setting the product listing ads up? I've attached a couple of screenshots which I hope will help clarify some of this. I can see product listing ads being great if you could get proper data to analyse and improve them. So here are my questions again if anyone can help? How do I see which keywords are driving the product listing ads? How do I see the landing pages for the product listings ads? What is the * keyword coming through in GA? How can you get GA to report product listing ads as paid rather than organic? Thank you so much. If I can gather enough data on this all and work it out I'll try to write up in a blog post to help others. 0rOMM.png GUAE0.png fWPL7.png
Paid Search Marketing | | ewanr0 -
New v Returning in Google Analytics with Adwords
I am trying to figure out an issue with Google Analytics. What i am stumped on is I see traffic from AdWords coming in (accounts linked) and I see new v returning user. Does the return visit still show even if a user came back in via direct or organic? Or is it that these return visits are clicking on the ad again to come back as visits and clicks match in the reports?
Paid Search Marketing | | RadicalMedia0