Moz Crawl Test Tool - SEO Web Crawler showing up with no details
-
So basically I have ran the Moz Crawl Test tool twice for this url "bubblingwithenergy.info" and both times the report has listed 1 URL when there is obviously a lot more if you check the site.
My question is, why is the Moz Crawl only reporting 1 URL when there are heaps? Is there a possibility it is being blocked and if so what would be blocking it?
This website is using a CMS called Infusion and it is based off CMSMS (CMS Made Simple).
Any answers would be greatly appreciated.
Cheers
-
Glad I could help!
-
Thanks Chiaryn, I hadn't noticed the site not being canonicalized.
I'll fix now and try again
-
Hey There,
I took a look at your site and it would seem that all of the links on the page bubblingwithenergy.info actually lead to pages on the www.bubblingwithenergy.info subdomain. Unfortunately, our crawl test tool only tracks sites at the subdomain level, so you would need run the crawl test for www.bubblingwithenergy.info to get a full crawl of the site.
I hope this helps! Please let me know if you need any further assistance with your crawl test.
Chiaryn
-
Our help desk can take a closer look and give you more details. In the meantime, here's a page that gives common reasons why we're only able to crawl a single page.
http://moz.com/help/guides/search-overview/crawl-diagnostics/rogerbot
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I added a privacy policy link to my footer and now Moz is showing thousands of 4xx errors
My website didn't have a privacy policy so I added one and put the link in the footer menu. When I did this, Moz came back telling me that there are a lot of new errors on the site. Is this a bad thing? Do I need to address it? HY59Iks sYyAHCB
Moz Bar | | elisa175910 -
When I try to run a Moz report, it sends me to a 404 page?
Hey there. I'm trying to export a .pdf to send to my client. When I click "export pdf", the page sits for a second then goes to a 404 page? I've never seen this before. Is anyone else getting this problem?
Moz Bar | | TaylorRHawkins2 -
Alternative to Moz Content?
Hi, Looks like moz content is really gone 😞 Does anyone have an alternative that does sort of the same thing?
Moz Bar | | mikeymosh1 -
MozBar shows country incorrectly
My site is hosted in Reston, VA yet the MozBar shows the Canadian flag next to the URL. Does anyone know why this is happening? Screen-Shot-2016-06-16-at-9.29.07-AM.png
Moz Bar | | sbapts0 -
Moz Pro Question: Does the amount of keywords you are allowed to search reset each month?
I am a Moz Pro subscriber and I really love the new Keyword Explorer tool. One question I have that I couldn't find a clear answer was regarding the number of monthly keyword queries. Do they reset each month? I hope they do.
Moz Bar | | joemaclean0 -
Is Moz Bot Broken?
Moz Bot says I have millions of issues with duplicate content. One item says that it has over 50 duplicates! I downloaded the CSV it gave me to look into it. All of my products have many different ways to get them, so I've set up rel=canonicals for the master one. So, I'd assume Mozbot would ignore those. But the interesting thing I've found is that of these 50 duplicates, some of them (on the same CSV I downloaded) are completely different products, with completely different URL's. and completely different titles and completely different meta descriptions and completely different product descriptions. So, 3 questions: Is Moz bot broken? Does it not recognize canonicals? Why is it seeing 3 very different products as exactly the same product? I'm so confused and since I work for a national company, the only way I can give actual examples is through a private message session. I guess I'm wondering if anyone else has come across this issue? Because I'm completely baffled.
Moz Bar | | DIAMA0 -
Problem Downloading Crawl Error Report PDF's
I am trying to download the PDF reports for the various 'crawl errors' - now some of them are quite large but would that justify why I am unable to download - the error is a straightforward one, see attached. Any ideas? Andy aDlViIN
Moz Bar | | TomKing0 -
Crawl Diagnostics - nofollow - reducing duplicate pages
Hi I'm looking at a crawl diagnostic report, I can see I have many duplicate pages, the reason for this is that when a brand filter is applied to a page. IE
Moz Bar | | chameleondm
www.mysite.com/mycategory - lets say this is the product listing page
www.mysite.com/category/mybrand - and this is the same page but with a brand filter applied
www.mysite.com/category/myotherbrand - and this is the same page but with a different brand filter applied I had intially appendeded the meta title, description and keywords with some extra content if a brand filter was applied, because the page on the whole does have different content. IE I would have a custom meta information, H1 tag and products on that page just for that specific brand.
However I am wondering if these two pages are really just competing with each other as lots of the content will be the same. Should I scrap that approach and use either nofollow on the brand filter link, or simply use a canonical. Thanks, James1