Moz crawling doesn't show all of my pages
-
Hello,
I'm trying to make an SEO on-pages audit of my website.
When using the SEO crawl, i see only one page while i have much more pages in this website (200+). Is it an issue with the sitemap ? The robot.txt ?
How can i check and correct this. My website is discoolver.com
-
Hi there,
Sam from Moz's Help Team here!
So, I took a look at your site, and unfortunately I believe this is a result of our crawler's inability to work with Javascript. Any client side loaded content will not be rendered to our crawler as we are only seeing what is rendered by your server.
Our crawler works by parsing the source code of your site, looking at HTML elements. If your site is primarily Javascript, then the data you get back with regards to the crawl report won't be completely accurate because of this. There's no real workaround that I can recommend for this one, since it is a technical limitation of our tools, but there are some good blog posts and discussions in the Q&A about this if you head over to our Help Hub.
While the tools and data that rely on our crawl of your site may not return the best results because of that Javascript, your keyword rankings and link profile should work just fine.
You might also want to check out a few tools that are compatible with Javascript, like Botify or Screaming Frog.
I'm really sorry I can't be of more help here; Please let me know if there's anything else I can help with, or if there are any follow-up questions you might have!
-
Thanks for the answers.
I believe the issue is about a rel=canonical from the homepage which links to an external website...
Can this tag prevent a good website crawl ?
-
So just looking it appears you don't have a robots.txt file or a sitemap. At least one that I could easily find.
This Moz post might help when creating one.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
MOZ DA IS NOT INCRAESING
Hey my website on business cards its DA is not increasing. is there any way to increase its DA.
Link Explorer | | cartwrightkar0 -
Non owned URL showing up in rank tracker report
Hello, In my weekly rank tracker report, I have a non owned URL showing up with GA UTM params in there. How is this possible and how is it possibly ranking under a different domain?
Link Explorer | | dlarusso.teguar1 -
Does moz pro standard give access to open site explorer & keyword explorer?
Does moz pro standard give access to open site explorer & keyword explorer?
Link Explorer | | SearchOpt1 -
Only two pages crawled
Hi community, I'm having trouble viewing data for all of our pages. Moz is only crawling two of our pages, and we have a lot more than that. Any suggestions? Thanks, Emily
Link Explorer | | SkuidEmily0 -
Why don't links from Reddit show up in Site Explorer?
Some are follow and some are no follow. They show up in webmaster tools and not in site explorer. In addition why do some other links show up in webmaster tools but not site explorer?
Link Explorer | | RafeTLouis0 -
Why does Open site explorer only show a fraction of the linked Domains that Google does?
One of my sites ( http://www.georgerossphotography.com ) shows 19 root domains and 155 links on Open Site Explorer. This doesn't pass the sniff test with me and when I look at Google Webmasters they show 120 domains with 1,870 links. I am assuming that Google use it's own data for ranking purposes which makes me question the validity of Open Site Explorer? Am I missing something ? I have been using OSE as my primary tool and now I feel that it has little value. I would appreciate any feedback. George.
Link Explorer | | sirgeorge0 -
Moz & Other Sites Not Showing in Link Profile?
I'm curious to know why Moz, YouTube, G+ and some other links are not showing the OSE link profile as NOFOLLOW or DOFOLLOW for our website whiteboardcreations.com? When doing analysis, we see a lot of companies YouTube pages with their NF link and G+ page links and even see a lot of the Moz community members with their Profile pages showing the NF link or the DF links. I'm confused as to why OSE is not picking up any of our links from those respective sites. Any thoughts? Thank you in advance. - Patrick
Link Explorer | | WhiteboardCreations0