Moz is only crawling 2 pages
-
Hi,
I found a similar thread, but it did not provide a clear-cut answer. We have had this campaign running for over a year, and we are always adding content to the website, but Moz is only ever able to crawl 2 pages, Screaming Frog only picks up 12, but I know there is a lot more than that. None of our pages are set to no-index, so I do not know what is causing this. Welcoming any ideas/solutions.
Thanks
-
@Dave,
We are having the same issue. We are getting our HTTP and HTTPS crawled but nothing else. Google is able to crawl our site and I see HTML links in the source code. Any idea why we'd be experiencing this?
-
Thank you! We will look into this.
-
Hi Aimee, Dave here from the help team
I took a look at your account and I see a campaign called JHM that only has two pages crawled, so I am assuming that is the site in question. The two pages are the domain and then the redirect to the WWW version. When I load the last page we crawled and then look at the source code, I noticed that the site is entirely javascript and does not contain any other HTML links. Since our crawler follows HTML link structure, we are hitting this page and then stopping when we don't find anything else to crawl. Hopefully that helps to clarify, let me know if you have any other questions about this or feel free to reach out to us at help@moz.com.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Limit MOZ crawl rate on Shopify or when you don't have access to robots.txt
Hello. I'm wondering if there is a way to control the crawl rate of MOZ on our site. It is hosted on Shopify which does not allow any kind of control over the robots.txt file to add a rule like this: User-Agent: rogerbot Crawl-Delay: 5 Due to this, we get a lot of 430 error codes -mainly on our products- and this certainly would prevent MOZ from getting the full picture of our shop. Can we rely on MOZ's data when critical pages are not being crawled due to 430 errors? Is there any alternative to fix this? Thanks
Moz Bar | | AllAboutShapewear2 -
Re-connect Goggle Analytics to Moz
I lost the GA account connection to my moz campaign account. I am re-connecting now but on the traffic settings, when I am about to disconnect, I get a warning that I will lose the historical data, what is the impact of loosing this data for the campaign? Thank you
Moz Bar | | RaquelSaiz0 -
Duplicate page found with MOZ crawl test?
When I crawl my website www.radiantguard.com, the crawl test comes back with what appears to be a duplicate of my home page: http://www.radiantguard.com and http://www.radiantguard.com/ Does the crawler indeed see two different pages and therefore, are my search engine rankings potentially affected, AND is this because of how my rel canonical is set up?
Moz Bar | | rhondafranklin0 -
In Moz Medium Pro how many pages can you track for keyword rankings at a time? I know you can track up to 50 in Standard.
I would possibly like to upgrade my subscription from Standard to Medium because I want to be able to track more pages in Rank Tracker. Unfortunately, the product descriptions do not include how many pages you can track in Rank Tracker.
Moz Bar | | VacasaSEM0 -
Where to find one off crawl report
Hello, I don't know if I am being a bit daft but I don't seem to be able to find the area where I can request a one off crawl report anymore (rather than setting up a campaign). Can someone let me know where this is now? Thanks!
Moz Bar | | RikkiD220 -
Moz.com Report a Problem or Provide Feedback
Two things. First, I could not find exactly where to report an issue or provide feedback about the website. I don't need to contact about Moz Analytics or any other products. I just want to provide feedback about the Moz Blog. I think it would be nice to be able to report an issue or provide feedback to "Roger" and have that item sent to the appropriate department for review. A lot of websites tend to use "webmaster@example.com" for this, but anything would work. My suggestion is to offer a feedback form on the Contact Moz page. Second, the issue I wanted to report has to do with blog comments. I left a comment early this morning and, with me being on Central Time and the timestamp for comments using Seattle local time, I was surprised to see that my comment had been posted "2 hours ago" immediately after I clicked "Submit." I presume this text is dynamic and that, in Seattle, you see "seconds ago" or something but, being in Wisconsin, I see "2 hours ago." This is confusing mainly because I have no idea how long ago other comments may have been posted. P.S. There isn't a question category for the Moz Blogs so I am choosing Moz - Other Research Tools. I view the blogs as a Product Moz provides so maybe adding "Moz - Blogs" to the Moz Product Help list of categories would be appropriate.
Moz Bar | | GeorgeAndrews0
