Moz crawling doesn't show all of my pages
-
Hello,
I'm trying to make an SEO on-pages audit of my website.
When using the SEO crawl, i see only one page while i have much more pages in this website (200+). Is it an issue with the sitemap ? The robot.txt ?
How can i check and correct this. My website is discoolver.com
-
Hi there,
Sam from Moz's Help Team here!
So, I took a look at your site, and unfortunately I believe this is a result of our crawler's inability to work with Javascript. Any client side loaded content will not be rendered to our crawler as we are only seeing what is rendered by your server.
Our crawler works by parsing the source code of your site, looking at HTML elements. If your site is primarily Javascript, then the data you get back with regards to the crawl report won't be completely accurate because of this. There's no real workaround that I can recommend for this one, since it is a technical limitation of our tools, but there are some good blog posts and discussions in the Q&A about this if you head over to our Help Hub.
While the tools and data that rely on our crawl of your site may not return the best results because of that Javascript, your keyword rankings and link profile should work just fine.
You might also want to check out a few tools that are compatible with Javascript, like Botify or Screaming Frog.
I'm really sorry I can't be of more help here; Please let me know if there's anything else I can help with, or if there are any follow-up questions you might have!
-
Thanks for the answers.
I believe the issue is about a rel=canonical from the homepage which links to an external website...
Can this tag prevent a good website crawl ?
-
So just looking it appears you don't have a robots.txt file or a sitemap. At least one that I could easily find.
This Moz post might help when creating one.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Solved Moz Link Explorer slow to find external links
I have a site with 48 linking domains and 200 total links showing in Google Search Console. These are legit and good quality links. Since creating a campaign 2 months ago, Moz link explorer for the same site only shows me 2 linking domains and 3 total links. I realise Moz cannot crawl with the same speed and depth as Google but this is poor performance for a premium product and doesn't remotely reflect the link profile of the domain. Is there a way to submit a sitemap or list of links to Moz for the purpose of crawling and adding to Link Explorer?
Link Explorer | | mathewphotohound0 -
MOZ Domain Authority Change frequency
Hello Team, I just want to know - is there any MOZ DA algorithm update frequency because we have not seen any movement in DA on website from last few months. Also, is there any matrices which affecting DA that might we are missing. Thanks in Advance.
Link Explorer | | adlift0 -
Give a Solution my DA is not increasing and not index my backlinks in MOZ??
DA of my site is not increasing. It seems like Moz is not indexing my backlinks. Multiple backlinks of my site [ Tech Spotty ] is not indexing in Moz that is why DA is not increasing. Backlinks of my site have indexed in both Ahref and Semrush both not showing in Moz. DR has increased to 51 but DA is still 7. If anyone has the solution please let me know.
Link Explorer | | fbowable1 -
Custom ranking report based on pages
Is it possible to generate a report that shows the keywords and position per page? For example Page xyc ranks for keyword1 - position 5, keyword2 - position 32, keyword3 - position9. I don't want to input the keywords, I want to be told via the report. I am trying to find out what SEO weight certain pages/sections of the website offer and if its OK to pull the content to change it into something else.
Link Explorer | | differentmoney0 -
Backlinks not showing on Open Site Explorer's Just-Discovered Links
Hi guys! My name is Edgar. I've recently been adding a bunch of backlinks to the site i work for, and most of them have a very high DA (DA > 80. Wohoo!). Nevertheless i'm often feel a bit frustrated when i check my site with the OSE, because just a few part of these links are showed in the just-discovered section, although i created them few days ago. So, i would like to know why is this happening, how long it take for my links to get crawled, and when can i stop getting frustrated on this? Than you very much! Edgar.
Link Explorer | | PCBU0 -
Error getting your data in moz ose
Why am I receiving a "There was an error getting your data" in moz ose? Everything worked fine yesterday but now I'm having trouble getting link metrics for my site.
Link Explorer | | TitanDigital1 -
What's with Moz continuously pushing back the Index Update date?
Moz seems to keep pushing back the Index update date, it was the 24th until the 24th, then it got changed to the 30th, now it is may 5th.... What is the reason for this?
Link Explorer | | mgladman1 -
[No Title] in Top Pages using Open Site Explorer
Hello!
Link Explorer | | eagleleather
All of my pages contain properly formatted title tags which display in the browser. However, when I view the 'Top Pages' area of the Open Site Explorer, 99% of those pages show [No Title] in the Page Title & URL column. Does anyone know what might be causing this?0