Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Robots and Canonicals on Moz

Technical SEO

433

PMPLawMarketing last edited by

We noticed that Moz does not use a robots "index" or "follow" tags on the entire site, is this best practice?

Also, for pagination we noticed that the rel = next/prev is not on the actual "button" rather in the header

Is this best practice? Does it make a difference if it's added to the header rather than the actual next/previous buttons within the body?
1 Reply Last reply
Reply Quote 0
DirkC last edited by

You don't have to put index & follow - that the default behaviour. It's only when you don't want to be indexed or links to be followed that you have to indicate it.

Rel next/previous have to be in the header - check https://support.google.com/webmasters/answer/1663744?hl=en - not on the links themselves.

Dirk
1 Reply Last reply
Reply Quote 1

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

Do I have a robots.txt problem?

I have the little yellow exclamation point under my robots.txt fetch as you can see here- http://imgur.com/wuWdtvO This version shows no errors or warnings- http://imgur.com/uqbmbug Under the tester I can currently see the latest version. This site hasn't changed URLs recently, and we haven't made any changes to the robots.txt file for two years. This problem just started in the last month. Should I worry?
Technical SEO | | EcommerceSite

0
Canonical URLs on location based offers

hello world. i offer first aid courses in different locations in switzerland. now i'm not sure if i have to make the single registration pages rel="canonical" or not. example:
location 1 -> course list @ Nothelferkurse Thun
location 2 -> course list @ Nothelferkurse Bern the content is almost the same. how do i have to handle with it? thanks for your help!
Technical SEO | | alekaj

2
Canonical URLs in an eCommerce site

We have a website with 4 product categories (1. ice cream parlors, 2. frozen yogurt shops etc.). A few sub-categories (e.g. toppings, smoothies etc.) and the products contained in those are available in more than one product category (e.g. the smoothies are available in the "ice cream parlors" category, but also in the "frozen yogurt shops" category). My question: Unfortunately the website has been designed in a way that if a subcategory (e.g. smoothies) is available in more than 1 category, then itself (the subcategory page) + all its product pages will be automatically visible under various different urls. So now I have several urls for one and the same product: www.example.com/strawberry-smoothie|SMOOTHIES|FROZEN-YOGURT-SHOPS-391-2-5 and http://www.example.com/strawberry-smoothie|SMOOTHIES|ICE-CREAM-PARLORS-391-1-5 And also several ones for one and the same sub-category (they all include exactly the same set of products): http://www.example.com/SMOOTHIES-1-12-0-4 (the smoothies contained in the ice cream parlors category) http://www.example.com/SMOOTHIES-2-12-0-4 (the same smoothies, contained in the frozen yogurt shops category) This is happening with around 100 pages. I would add canonical tags to the duplicates, but I'm afraid that by doing so, the category (frozen yogurt shops) that contains several non-canonical sub-categories (smoothies, toppings etc.) , might not show up anymore in search results or become irrelevant for Google when searching for example for "products for frozen yoghurt shops". Do you know if this would be actually the case? I hope I explained it well..
Technical SEO | | Gabriele_Layoutweb

0
Categories and rel canonical

Hello everyone, I have a doubt in how to approach this problem. I have a local business website, and i want to rank this website for our main KW. So the idea is to rank the main Keyword to the home page www.sitename.com At the same time we blog every week and one of the categories is the same has the main Keyword. It makes sense because the majority of the blog posts are about it. In a certain way the homepage and the category page are competing for the same keyword. How can i approach this problem? Should i use rel canonical in the category page, pointing to the homepage? Thanks for your help.
Technical SEO | | Barbio

0
Blank Canonical URL

So my devs have the canonical URL loaded up on pages automatically, and in most cases this gets done correctly. However we ran across a bug that left some of these blank like so: Does anyone know what effect that would have? I am trying to provide a priority for this so I can say "FIX IT NOW" or "Fix it after the other 'FIX IT NOW' type of items". Let me know if you have any ideas. I just want to be sure I am not telling google that all of these pages are like the home page. Thanks!
Technical SEO | | SL_SEM

0
SeoMoz robot is not able to crawl my website.

Hi, SeoMoz robot crawls only two web pages of my website. I contacts seomoz team and they told me that the problem is because of Javascript use. What is the solution to this? Should I contact my webdesign company and ask them to remove Javascript code?
Technical SEO | | ashish211

0
Robots.txt Syntax

Does the order of the robots.txt syntax matter in SEO? For example (are there potential problems with this format): User-agent: * Sitemap: Disallow: /form.htm Allow: / Disallow: /cgnet_directory
Technical SEO | | RodrigoStockebrand

0
Using the Canonical Tag

Hi, I have an issue that can be solve with a canonical tag, but I am not sure yet, we are developing a page full of statistics, like this: www.url.com/stats/ But filled with hundreds of stats, so users can come and select only the stats they want to see and share with their friends, so it becomes like a new page with their slected stats: www.url.com/stats/?id=mystats The problems I see on this is: All pages will be have a part of the content from the main page 1) and many of them will be exactly the same, so: duplicate content. My idea was to add the canonical tag of "www.url.com/stats/" to all pages, similar as how Rand does it here: http://www.seomoz.org/blog/canonical-url-tag-the-most-important-advancement-in-seo-practices-since-sitemaps But I am not sure of this solution because the content is not exactly the same, page 2) will only have a part of the content that page 1) has, and in some cases just a very small part. Is the canonical tag useful in this case? Thank you!
Technical SEO | | andresgmontero

0