Are there detrimental effects of having multiple robot tags
-
Hi All,
I came across some pages on our site that have multiple robot tags, but they have the same directives. Two are identical while one is for Google only. I know there aren't any real benefits from having it set up this way, but are there any detrimental effects such as slowing down the bots crawling these pages?
name="googlebot" content="index, follow, noodp"/>
Thanks!
-
Like Dmitri mentioned, it shouldn't really matter it's redundancy. In the last case it could sometimes be useful for bigger sites to make statement or tags specific to certain engines to keep their behaviours from being different.
-
Hi there.
There shouldn't be any difference, only extra bytes to load. The first rule will be what will tell bots what to do. It's simply redundant rules.
Hope this helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What heading tag to use on sidebars and footers
Hello, I have some awareness of how to use H1, H2 and H3.
On-Page Optimization | | kowston
H1 only once per page as the main page heading.
H2's should be subheadings, H3's are sub-sub headings of the and so on.
This structure gives hierarchy and opportunities to use additional keywords in an order of priority. I can clearly understand how this would work in an article but what about other content on the page such as global/frequently repeated elements like sidebars and footers? I see sites - and in particular, I have examed SEO focused sites - that use H3, H4 and H5 in these instances seemingly giving themselves scope to use at least H2 tags as part of the page content and break out of the structure hierarchy when dealing with sidebars and footers. I suppose this could signal theses headings are sections of the page that are less relevant than the main article content but that is just an assumption. I don't know what is correct.0 -
Is it okay to leave off H1 tags?
I know that SEO uses H1 and H2 mainly and there should only be one H1 and there can be multiple H2 tags. But the site I’m reviewing generally has no H1 on a page and multiple H2 tags. The Page Title reflects the title of the page, so maybe this is okay as is? They have the styling down just so, so I don’t want to make them change it if it’s okay.
On-Page Optimization | | amybethmegjo0 -
How does Google handle read more tags in Wordpress
Hi Everyone I am wondering how Google handles the read more tag in Wordpress. I pasted the link to a blog post on Google and found nothing (domain.com/post#readmore). Then I paste the version without #readmore (domain.com/post) and found that Google indexed the page but with the option to click "read more" to read it. The full blog post is not in their index, just the version asking you to read more. Is this because Google hasn't gotten to it or is Google ignoring it. I am not sure but ideally I rather have the full blog post indexed, not the read more version. I am curious to whether this will cause duplicate content issues. What are your experience with this and is it advisable to use an alternate method for read more. Maybe with a Wordpress plugin. Thanks in advance.
On-Page Optimization | | gaben0 -
Magento Canonical & Default Robots Settings
Hello! I'm working with Magento 1.9 for an eCommerce site with several hundred products. Currently I understand it is best practices to use the Canonical tag, however I also have my default robots set to "Index, Follow". Will this cause an issue having product pages set to index, follow but also having a canonical tag included? What are some best practices regarding Magento default robots & canonical tags? Any help is appreciated.
On-Page Optimization | | BretDarby0 -
Prevent Indexing of URLs Based on Tags
I started my website as a blog over at Posterous, but decided to turn it into a full scale business website with a self-hosted WordPress theme. Shortly after transitioning from Posterous to WordPress, I noticed that Google was indexing not only my old blog posts, but the URLs of my blog posts based on the tags they have. Is there any reason why this is a problem? I'm sure it shouldn't qualify as duplicate content, but for some reason it just feels a bit sloppy to me to have all of these pages indexed...Is this a non-issue? Should I just be more discriminating with my use of 'tags' if it bothers me? JiGLH.png
On-Page Optimization | | williammarlow0 -
Nofollow images to sculpt internal anchor tags
One of my client tags image-links with nofollow if those links are before a regular HTML link in the source code, e.g.:
On-Page Optimization | | Sebes
.
.
.
Check our page aboutreally cool shoes. They do this to "better pass anchor tags" to the page /page-about-shoes.html. My question: Is this a good practice to do? Thanks Sebes0 -
Time lag to see effect on rankings after a good optimization
Once you do an optimise / make some (hopefully positive!) changes to pages re keywords etc - how long does it take for you to move up the rankings - if indeed you do actually move up... I made some changes last week and see some slight movement this monday - can I expect more of a movement over a period of a few weeks? Or does it take longer? Maybe tricky question to answer but hopefully you know what I mean...
On-Page Optimization | | inhouseninja0 -
What is the effect of too many internal links on a page?
Hi there! We have been doing a great effort during the last year but our main competitor is still above us in search rankings. Basically, the main differente remains now in the number of internal links, specially in our homepage. We have more than 200 and they only have around 100, so I think we are wasting too much link power among some irrelevant pages. What could be the effect of this?
On-Page Optimization | | bodaclick0