Are there detrimental effects of having multiple robot tags
-
Hi All,
I came across some pages on our site that have multiple robot tags, but they have the same directives. Two are identical while one is for Google only. I know there aren't any real benefits from having it set up this way, but are there any detrimental effects such as slowing down the bots crawling these pages?
name="googlebot" content="index, follow, noodp"/>
Thanks!
-
Like Dmitri mentioned, it shouldn't really matter it's redundancy. In the last case it could sometimes be useful for bigger sites to make statement or tags specific to certain engines to keep their behaviours from being different.
-
Hi there.
There shouldn't be any difference, only extra bytes to load. The first rule will be what will tell bots what to do. It's simply redundant rules.
Hope this helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Structuring navigation for maximum effect
Hi, I am working with a client (in the property niche) who has 200+ links on each page of their site mainly due to an extensive navigation menu. They have good domain authority (although some competitors have a lot better) and some excellent links from some fantastic domains but the keywords just aren’t moving. (Sidenote: most links point to the home page with some going to property detail pages not location pages which is where I’d like people to be landing). I am reviewing the site structure and other technical aspects and have some questions regarding how the navigation is structured. Firstly is 200+ links an ok number to have? Everything I read points to 100 being a magic number to aim for. Secondly, the site navigation menu contains a list of locations. The first tier being country, the second tier drops down to list the regions within that country, then a third tier drop down appears to list the towns and cities in those regions. So from any page in the site you can drill down to town/city locations. (Sidenote: I have run Hotjar on the site which shows most people are using the search facility not the navigation menu to search) Is this style of navigation ok or does it dilute the link authority/pagerank/juice being past to each page? Would a better option be to have the first and second tier in the drop down then the third level town navigation to appear in the sidebar at page level in the appropriate sections? What effect would such a change have on rankings?
On-Page Optimization | | caravan0 -
Can Robots.txt on Root Domain override a Robots.txt on a Sub Domain?
We currently have beta sites on sub-domains of our own domain. We have had issues where people forget to change the Robots.txt and these non-relevant beta sites get indexed by search engines (nightmare). We are going to move all of these beta sites to a new domain that we disallow all in the root of the domain. If we put fully configured Robots.txt on these sub-domains (that are ready to go live and open for crawling by the search engines) is there a way for the Robots.txt in the root domain to override the Robots.txt in these sub-domains? Apologies if this is unclear. I know we can handle this relatively easy by changing the Robots.txt in the sub-domain on going live but due to a few instances where people have forgotten I want to reduce the chance of human error! Cheers, Dave.
On-Page Optimization | | davelane.verve0 -
Rich snippets for multiple breadcrumbs
Hey there,
On-Page Optimization | | Supertramp
I have been playing around with rich snippets for multiple breadcrumbs for quite a bit now - without any success. It would be great if someone could point me to an example where this has been implemented correctly. I followed the Google recommendation but it doesn't seem to work for me. See also: http://searchenginewatch.com/article/2335753/Matt-Cutts-If-You-Have-Multiple-Breadcrumbs-Google-Picks-the-First-One Thanks for your help. Cheers,
Jochen0 -
Blank Title and Description Tags
Hi guys. Some times web platforms that I do work on have pages that I normally do not optimize. They more often than not have blank meta titles and meta descriptions. If I put titles and descriptions on these pages, no matter how minor, would it help the site as a whole to rank better? Thanks!
On-Page Optimization | | oomdomarketing0 -
How to ALT tag correctly many similar images?
scenario: I have a product page with some text about the product and 12-15 different images af the product: details, colours, different views... how should I name an alt tag them correctly, been them actually really similar? Is it keyword stuffing to use the same name containing a relevant keywords?
On-Page Optimization | | DavideM0 -
Alt tagging photos.
Here is the background. My wife has a website selling childrens clothing. All the basics of this webshop is through a company that have some 300 other sites. 2-4 times a year arond 100 products have to be added to the shop. Pictures are of course highly important. Some pictures are supplied by producer of clothes some we have to take ourself. Pictures supplied by producer is not tagged. When we are adding a product; avail sizes,prices, product description, which folder it is to be shown in etc is added. Pictures are added but there is no functionality for adding alt tag to the pictures. Is there any way i can incorporate the tag into the picture file eg .jpg before its added here or is it impossible is this impossible ? Thanks for all help. Dan
On-Page Optimization | | danlae0 -
Should I let Google index tags?
Should I let Google index tags? Positive? Negative Right now Google index every page, including tags... looks like I am risking to get duplicate content errors? If thats true should I just block /tag in robots.txt Also is it better to have as many pages indexed by google or it's should be as lees as possible and specific to the content as much as possible. Cheers
On-Page Optimization | | DiamondJewelryEmpire0 -
Alt tag matching product titles - e-commerce
Hey all, Just wondering if it is ok to match the alt tag to product titles. Imagine an e-commerce site that lists a whole lot of products on any one page for any one category. Each product listing has a thumbnail image beside it. The easiest way to implement this dynamically is to use the product title for the alt tag. Anyone had any experience with this? Is it overkill / spam of keywords - given that the product title is repeated. Our current situation is that our alt tags are simply blank or say 'photo' which is no good, and we have hundreds of thousands of pages. Cheers, Croozie
On-Page Optimization | | sichristie0