Issue with a particular command of robots.txt! Help needed!
-
Hi all,I'm facing a strange issue with a website: www.foodmood.itI've written this robots.txt: www.foodmood.it/robots.txt in which I'm using all commands I've tested and used on other websites.The problem is that this website is not indexing correctly, and my fear is that I've written the robots in a wrong way.In this forum I've been taught that this command Disallow: /*? should be substituted with Disallow: /? in order to be sure the crawler is not indexing all the URLs containing a question mark.My question is: do you think this command modified in the above way can cause a problem to my website?I repeat that I've used it on several sites and this is the first time I'm having this kind of problems.Thanks in advance for your help.A.
-
I would in future tend to trust sources closer to being official rather than someone on a forum. Remove the extra * so its just Disallow: /*?
You can find more info here - https://support.google.com/webmasters/answer/156449
You can also test your robots in your webmaster tools so don't forget to give that a go if in doubt.
Hope that helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Facebook conversions - issue in calculation
Hi, I have a few campaigns for conversions on Facebook, but any of them don't show to me real numbers. There are 4 times more conversions on Facebook than in GA. I did a little research. The problem is that - Facebook pixel calculates all possible conversions from all sources, and because my campaign results are wrong e.g.: Facebook campaign results: Conversions: 10 | Cost per conversion: 1 GA for that campaign (real numbers): Conversions 1 | Cost per conversion: 1 GA from all campaigns and sources: 10 It's that correct? Pls help. Br. Marco
Conversion Rate Optimization | | marcop21 -
IE & Edge issues with site relaunch - advice appreciated
Hi, I've been involved in a major ecommerce site relaunch, redesign and backend and have been involved in several successful ones before. On the whole things have gone great. Of course there are some minor bugs to fix, rendering issues etc but my real concern is a significant decline in conversion rate BUT only for IE and Edge users. All other major browsers conv rate has increased. Trawling through analytics and the site itself in those browsers there is no obvious sticking points e.g bounce rate has improved on all browser inc IE & Edge, no particular point in the funnel is suffering more than others, no particular page or landing page is doing much worse than others etc. it just seems like all the kpi's (except bounce) are down a little on the 2 microsoft browsers, which has a significant impact. One of the things that changed on relaunch is that we moved to https and im wondering if that might be causing an issue with IE / Edge security or privacy settings or that functionality on the site that relies on cookies is being affected, though in testing we haven't come across anything. I'd appreciate any advice or insight. Thanks, Andy
Conversion Rate Optimization | | AndyMacLean0 -
Google Experiments issues
Hey fellow Mozzers! We're in the middle of working on CRO for a client of ours and we were going to try out Google Experiments for the first time. Following the click path described on the Google help page should take me to an option that says 'Create Experiment', but this isn't coming up - do we need to create the various URLs before it will let us set up an experiment, or has the system changed now? I've found in the past Google has a habit of updating its interfaces but not the advice on using the affected tools, so wondering if I'm looking at old information? Secondly, does the Experiment show a user the same variation of the page throughout their journey? What I mean by that is: their site currently has a real mish-mash of page styles, and I think a large part of boosting their conversions is probably down to ensuring consistency across the site as it currently seems like you're bouncing around different sites. But will this issue be made worse by running Experiments - ie, will I enter the site on Variation A, click a link and be shown the next page in Variation B and so on? If so, are we better off running the experiment on one page at a time and using what we've learnt to impact the next page? Thank for any help you can give! Nick.
Conversion Rate Optimization | | themegroup1 -
Help: Trouble converting customers with new adwords campaign for a new site
I have just launched my brand new e-commerce site www.zenory.co.nz We are wanting to expand global as you can see we have com.au and also .com but due to our min budget we had to start with NZ first for organic search and a min monthly budget on adwords which doesn't come close to what our competitors are paying. Really is it worth paying out our limited budget with adwords? Or should be put that into ranking organic search. While we have only just started our adwords PPC campaign and I think it has only been roughly two weeks - We have had around 18 people sign up, to which we have a 3 step process, however, we are struggling to convert and complete a transaction which customer places credit card details in step 3. Does anyone have any ideas around how we could better optimize or perhaps make any suggestions? Our competitors spend rather large amounts of up to 3000k - 300k per month on adwords, and there is just no competing with that. Any suggestions I would definitely be open to... Thanks alot
Conversion Rate Optimization | | edward-may0 -
Help with ecommerce duplicate pages and SEO advice(magento base site)
Hi, We have a magento build site (www.mokee.eu) and are selling our own branded goods. So far it is a very limited range of products. It's 1 baby crib in 5 variations. We recently started getting more sales from the site, so I started to look a bit more into optimising our site. I rewrote item name, created better descriptions, added meta titles and description etc. and subscribed to the MOZ analytics platform to understand a bit better ways to improve things up. From what I saw we have a big issue of duplicated content because our product pages are the same and only the product colour changes, which is something google apparently doesn't like However it is important for us that each colour get referenced by google so people who search for grey cot can find a picture of our grey cot etc... Also I was thinking to create only on multi variation page with all colour but when you have only 1 product to sell it might look a bit empty on the site. 1- Do you guys have some advise on how to go round this issue? 2- Do you have any other advise for my site in particular to optimise things and actually do you think i should be worried at all with such a small catalogue? Thanks Sam
Conversion Rate Optimization | | mokeestore0 -
UX Design: Do Directional Cues Help?
Hi, Bit of a different subject really to the usual SEO chat but as most of you know UX/CRO fits in nicely with SEO. For those of you who know about directional cues, what are your experiences with them, what types of directional cues worked best for you? And has anyone had any positive experiences with cues and social buttons? For those who are not sure what directional cues are: http://www.ioninteractive.com/post-click-marketing-blog/2010/11/19/how-to-use-design-to-form-directional-cues-on-landing-pages.html Thanks
Conversion Rate Optimization | | activitysuper0 -
Need Advice on Home page Conversion Rate Improvement - not much $$s
Anyone out there have some suggestions for how I can improve my home page and increase my lousy conversion rate? I've spent years on the content and SEO optimization of my site and very little time on making a home page that sells stuff. Caveat - I don't have the money to go to one of those fancy companies who do a complete makeover and charge in the tens of thousands. Any suggestions would be greatly appreciated! Jean http://www.northwest-wine.com
Conversion Rate Optimization | | JeanYates0 -
TestFreaks.com Opinions Needed
I'm looking into testfreaks for a client - frankly i'm having trouble answering a few of my own questions about them, namely: Can Google spider the test freaks javascript link? Can Google then crawl the reviews in the frame generated? Will Google count that as dupe content? (the content in the frame seems to reside on the testfreaks.com domain..) Do you think this is a safe method of increasing conversions? Seems all good to me, I'm mainly concerned about dupe content (and whether reviews written within the testfreaks interface can then be spidered ... and i'm not sure it can be).
Conversion Rate Optimization | | CheapGames990