Welcome to the Q&A Forum

Hi Sam, have PM'd you.

A search query in Google shows 156 indexed results.  Yet Roger has completed a crawl and returned a single page.  The website is table based, but there appear to be no redirects or Javascript blocking bots so I'm unsure why Roger has under delivered.  The problem is not unique to Roger.  I ran the site through Screaming Frog's desktop crawler and it also returned a single page.

I'm wondering if there is something in the site code I don't know to look for that is stopping Roger & Screaming Frog from crawling the site.

Appreciate any insights you can offer.

PS.  I've read https://seomoz.zendesk.com/entries/409821-Why-Isn-t-My-Site-Being-Crawled-You-re-Not-Crawling-All-My-Pages- and don't think these suggested causes apply.

Thanks for both of your replies.  As per my question it was around whether there is any value having a blank robots.txt file.  Philipp's answer was right on the money.

I've read an audit where the writer recommended creating and uploading a blank robots.txt file, there was no current file in place.  Is there any merit in having a blank robots.txt file?

What is the minimum you would include in a basic robots.txt file?

Thank you Alan.

I'm reviewing a website that has used the H3 tag in the Navigation Menu.

I've not seen that before and first thought is it is a dodgy.  Tags should relate to content on the page not link to another page.

As a result of using H3 in Nav the ratio of content wrapped in Heading tags vs body content is quite high.

My recommendation is to remove H3 tag from Nav but having searched Moz and not finding an article to verify that recommendation thought I'd ask the question.

Hi Paul

I appreciate your explanation of when to use Canonical tags.  I had previously thought they were limited to redirecting www.domain.com to domain.com.

I understand your solution to the Dupes problem and will be searching SEOMoz's resources for how to write rewrites and Search & Replace filters using RegEx in Analytics for that matter.

It's not the first time you've provided an high quality answer to a question of mine.  I very much appreciate your contribution to my growing knowledge and the SEOMoz community.

Best

Nic

I'm auditing a site and would appreciate your help with possible explanations and solutions as to why Google Analytics in the Content Drilldown page is showing what appears to be duplicate pages. (Refer image)

I'm wondering if I have got my head around the rel=canonical tag because the page I'd consider a duplicate "page/" has a Canonical tag pointing to "~/page.html"

This is the tag from the page Locations/

rel="canonical" href="http://www.domain.com/Locations.html" /> so am unsure why both versions of the page are generating views.  Shouldn't the Canonical tag work like a 301 redirect?

I'm unsure how the pages using the path page/ are generating so many views because I have not been able to find them and they are not indexed by Google.

Unfortunately the site is built using a Propriety CMS I'm not familiar with.

exK4EqrU25

I appreciate all your responses.

Paul, thanks for your detailed reply.

Best

Nic

Thanks for the quick reply.

Because the install is "out-of-the-box" I expected they were right. 
What is SEOMoz trying to tell me about the tags?