Moz crawling doesn't show all of my pages
-
Hello,
I'm trying to make an SEO on-pages audit of my website.
When using the SEO crawl, i see only one page while i have much more pages in this website (200+). Is it an issue with the sitemap ? The robot.txt ?
How can i check and correct this. My website is discoolver.com
-
Hi there,
Sam from Moz's Help Team here!
So, I took a look at your site, and unfortunately I believe this is a result of our crawler's inability to work with Javascript. Any client side loaded content will not be rendered to our crawler as we are only seeing what is rendered by your server.
Our crawler works by parsing the source code of your site, looking at HTML elements. If your site is primarily Javascript, then the data you get back with regards to the crawl report won't be completely accurate because of this. There's no real workaround that I can recommend for this one, since it is a technical limitation of our tools, but there are some good blog posts and discussions in the Q&A about this if you head over to our Help Hub.
While the tools and data that rely on our crawl of your site may not return the best results because of that Javascript, your keyword rankings and link profile should work just fine.
You might also want to check out a few tools that are compatible with Javascript, like Botify or Screaming Frog.
I'm really sorry I can't be of more help here; Please let me know if there's anything else I can help with, or if there are any follow-up questions you might have!
-
Thanks for the answers.
I believe the issue is about a rel=canonical from the homepage which links to an external website...
Can this tag prevent a good website crawl ?
-
So just looking it appears you don't have a robots.txt file or a sitemap. At least one that I could easily find.
This Moz post might help when creating one.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
MOZ Domain Authority Change frequency
Hello Team, I just want to know - is there any MOZ DA algorithm update frequency because we have not seen any movement in DA on website from last few months. Also, is there any matrices which affecting DA that might we are missing. Thanks in Advance.
Link Explorer | | adlift0 -
Why is Link Explorer showing the same domain strength for domain and sub-domain? Shouldn't it be different?
I believe in the past the sub-domain score was different than the domain score in Link Explorer. Now I am seeing that it is reporting the same score. I have to use exact page to get a sense of how strong the sub-domain is.
Link Explorer | | Liamis0 -
I couldn't check Page authority or Domain Authority for any page, what can be reason?
I am trying to check DA and PA for page but not able to do this. Tried it before two days and it was working fine, problem occurring today. I want help regarding this issue, is anyone other facing this problem. Kindly help me out (provide some other way to check DA/PA).
Link Explorer | | JessicaThompson1 -
How many pages Google crawl in free version
I am using moz pro 30 days trial version.Can Anybody tell me how many pages moz crawl in a day or in a week.Because its two days and only 2 pages they crawled. Thanks
Link Explorer | | VarinderS0 -
No backlinks reporting in MOZ OSE?
We have a bunch of links and none of them report in MOZ OSE. Does the MOZ OSE tool have a cache that takes a while to refresh? We have recently moved over to CloudFlare and since the move the numbers do not add up. Here is a link to a ahrefs screenshot. Any insights would be greatly appreciated. moz.png
Link Explorer | | seanallen0070 -
Why does OSE show different link equity for homepage with and without trailing slash?
Hi all, I am working with a developer who believes OSE (Open Site Explorer) is flawed. His reasoning is that OSE shows completely different link equity and domain authority for these two URLs [company name is purposely withheld]: http://www.mydomain.com/us/ and http://www.mydomain.com/us NOTE: http://www.mydomain.com/us has been properly 301-redirecting to http://www.mydomain.com/us/ for years. The developer's argument is that the URL that is being 301-redirected shouldn't have any link equity at all, therefore OSE is flawed. Here is the response I would like to give him. Please feel free to poke holes, provide feedback or flat out correct me if I am wrong: Dear inquisitive developer, Any URL that is being linked to by another site that has link equity will get link equity passed to it. This is true even if the URL is a page that doesn't exist. What it can't do (if it doesn't exist) is then pass that link equity on to another page. Moz's OSE is showing separate link equity for the two versions of this URL because other sites have linked to both versions. The fact that one 301-redirects to the other is good and ensures that link equity from one is passing to the preferred URL. The 301-redirect does not, however, remove link equity from the first URL, but rather passes the existing link equity from one to the other. Consequently, Moz's OSE is not flawed, but rather is displaying the link equity of one URL that is benefiting the other via a 301-redirect. Sincerely, Dana
Link Explorer | | danatanseo3 -
Learn how to use Open Site Explorer to find opportunities in your links' anchor text. Get your Daily SEO Fix!
In today's Daily SEO Fix, Tori dives into using Open Site Explorer to find opportunities—particularly potential keyword ranking opportunities—in your links' anchor text. Watch "How to Use Open Site Explorer to Check Your Anchor Text" to get started! The Daily SEO Fix is an ongoing series of Moz tool tips and tricks in under 2 minutes. To watch all of our videos so far, and to subscribe to future ones, make sure to check out the Daily SEO Fix channel on YouTube!
Link Explorer | | MattRoney4 -
Why Moz doesn't offer tool similar like SEOprofiler Link Disinfection?
Hi Moz, As I have been your member & using pro tool for more than an year, it's been amazing experience working and using your each tool's function tool, wehther to check on-page grader, rank tracking, on-page crawling issue, keyword difficulty and the one my best for link analysis is Open Site Explorer etc. I came here to ask about something which I didn't find here than other providers is most popular Bad Link Detection Tool. As **SEOprofiler Link Disinfection **offers their customers to use this to get all of their bad or spammy links harming them to rank high or getting away from ranking goal. Let me know, are you planning anything similar to this to bring soon in your tools and provide your members to take benefits of such type function as well OR should i go to SEOprofiler for this? Best,
Link Explorer | | Futura
Teginder Ravi0