Moz crawling doesn't show all of my pages
-
Hello,
I'm trying to make an SEO on-pages audit of my website.
When using the SEO crawl, i see only one page while i have much more pages in this website (200+). Is it an issue with the sitemap ? The robot.txt ?
How can i check and correct this. My website is discoolver.com
-
Hi there,
Sam from Moz's Help Team here!
So, I took a look at your site, and unfortunately I believe this is a result of our crawler's inability to work with Javascript. Any client side loaded content will not be rendered to our crawler as we are only seeing what is rendered by your server.
Our crawler works by parsing the source code of your site, looking at HTML elements. If your site is primarily Javascript, then the data you get back with regards to the crawl report won't be completely accurate because of this. There's no real workaround that I can recommend for this one, since it is a technical limitation of our tools, but there are some good blog posts and discussions in the Q&A about this if you head over to our Help Hub.
While the tools and data that rely on our crawl of your site may not return the best results because of that Javascript, your keyword rankings and link profile should work just fine.
You might also want to check out a few tools that are compatible with Javascript, like Botify or Screaming Frog.
I'm really sorry I can't be of more help here; Please let me know if there's anything else I can help with, or if there are any follow-up questions you might have!
-
Thanks for the answers.
I believe the issue is about a rel=canonical from the homepage which links to an external website...
Can this tag prevent a good website crawl ?
-
So just looking it appears you don't have a robots.txt file or a sitemap. At least one that I could easily find.
This Moz post might help when creating one.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Google redirect backlink created. Do I have to ping this for Moz to recognize it?
Google redirect backlink created. Do I have to ping this for Moz to recognize it?
Link Explorer | | dlwnsh05100 -
MOZ link explorer is not showing any result
Whenever I am searching in link explore, it is only showing the blanks with default zero value. It was showing data for my website 1 hour ago but now not showing. SYphSNw
Link Explorer | | gb.select4you3 -
Backlink not showing on Link Explorer
Hello, Our team have been doing link building for a month, however non of the links are coming up in MOZ Link Explorer. We used link tracker to check, and it is not linking back. when checking on the other blog's site, they are linking back but we are unable to see it in moz. For example:
Link Explorer | | WAUBIKE
Indiegogo: https://www.indiegogo.com/projects/wau-the-best-feature-packed-smart-ebike#/
NewAtlas: https://newatlas.com/wau-ebike-affordable/56791/ These both links are linking back to us at www.waubike.com, and we can see it on google web masters, but we cannot see it on Moz? We have checked our server and they confirmed they are not blocking Moz's crawlers. Anyone else have this issue ?0 -
Fastest way to get new backlinks recognised by Moz?
Hi all, I have seen a few discussions / advice pieces around this, but wondered what the current view is on the fastest way to get new backlinks recognised by Moz? I have seen people say that the content needs to be shared (e.g. on Twitter), and advice around creating Bitly links. I am not convinced that these techniques are working. On a related note, my website is very large. I have around 2.5m pages. Most of these pages are 3-4 clicks from the home page, but I have a small amount of important content much higher up in the site (1-2 clicks from the home page). Does Moz crawl pages nearer the home page more frequently, or does it make a pass of all pages on the site before it starts at the beginning again? If it makes a complete pass of all pages, then presumably making my site smaller will help to get Moz to see new content more quickly? Is there any other value to be gained in making a large site smaller? Many thanks in advance, Neil.
Link Explorer | | NHARRIS10 -
Top Pages in OSE
Hey, I'm using OSE to determine top pages for some domains. This works great for some sites, but I'm finding with a few sites only the home page comes up in the 'top pages' list - is this because the home page is the only one with a PA above one? Cheers
Link Explorer | | wearehappymedia0 -
Page Authority = 1 of linking page?
I am trying to determine if any of our PR services or inbound links are hurting our SEO. To do this I am using the Open Site Explorer tool and checking some of the URL's that link to us. While doing this I found a page that has a Page authority of 1/100 most other links have a decent authority...does this score mean this page has been penalized by Google? If not what else could a 1/100 mean?
Link Explorer | | Bertrand131 -
My Facebook / Twitter Shares Not Showing Up
In Open Site Explorer, my Google+ shares are showing up but any shares on Twitter and Facebook are not. I am wondering if anyone has any ideas as to why this might be happening? My site is www.riddelllaw.com. Thanks
Link Explorer | | bpurdue0 -
Why Moz doesn't offer tool similar like SEOprofiler Link Disinfection?
Hi Moz, As I have been your member & using pro tool for more than an year, it's been amazing experience working and using your each tool's function tool, wehther to check on-page grader, rank tracking, on-page crawling issue, keyword difficulty and the one my best for link analysis is Open Site Explorer etc. I came here to ask about something which I didn't find here than other providers is most popular Bad Link Detection Tool. As **SEOprofiler Link Disinfection **offers their customers to use this to get all of their bad or spammy links harming them to rank high or getting away from ranking goal. Let me know, are you planning anything similar to this to bring soon in your tools and provide your members to take benefits of such type function as well OR should i go to SEOprofiler for this? Best,
Link Explorer | | Futura
Teginder Ravi0