Moz crawling doesn't show all of my pages
-
Hello,
I'm trying to make an SEO on-pages audit of my website.
When using the SEO crawl, i see only one page while i have much more pages in this website (200+). Is it an issue with the sitemap ? The robot.txt ?
How can i check and correct this. My website is discoolver.com
-
Hi there,
Sam from Moz's Help Team here!
So, I took a look at your site, and unfortunately I believe this is a result of our crawler's inability to work with Javascript. Any client side loaded content will not be rendered to our crawler as we are only seeing what is rendered by your server.
Our crawler works by parsing the source code of your site, looking at HTML elements. If your site is primarily Javascript, then the data you get back with regards to the crawl report won't be completely accurate because of this. There's no real workaround that I can recommend for this one, since it is a technical limitation of our tools, but there are some good blog posts and discussions in the Q&A about this if you head over to our Help Hub.
While the tools and data that rely on our crawl of your site may not return the best results because of that Javascript, your keyword rankings and link profile should work just fine.
You might also want to check out a few tools that are compatible with Javascript, like Botify or Screaming Frog.
I'm really sorry I can't be of more help here; Please let me know if there's anything else I can help with, or if there are any follow-up questions you might have!
-
Thanks for the answers.
I believe the issue is about a rel=canonical from the homepage which links to an external website...
Can this tag prevent a good website crawl ?
-
So just looking it appears you don't have a robots.txt file or a sitemap. At least one that I could easily find.
This Moz post might help when creating one.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why is there difference in keywords of moz and ahrefs
Hello, my welding helmets website Helmet Adviser is about reviews and is causing me confusion. When I check my site keywords in Moz it shows lesser keywords and when I check in ahrefs it shows more. Same is for backlinks. But Moz keywords research is very authentic and i want to rely on it for keywords and backlinks too. Please elaborate for me why is there diff between Moz and ahref, so I can better utilize Moz by understanding what is going on in the background.
Link Explorer | | ericcampbell10 -
Is there any study or detailed report on How Moz & Google calculates domain authority ?
I want to know, Is there any detailed report or study done by someone on the Domain authority calculations between Google & Moz. Mainly, I would like to know 1. How Google calculates Domain Authority and How Moz does ? 2. Is there any correlation in majority of the cases or both differs vastly ?
Link Explorer | | sssnee20 -
How MOZ OSE Work and calculate Compare Links Metrics ?
I want to know everything about compare links metrics. Like how Moz work and calculate this value of Internal Equity-Passing Links External Equity-Passing Links Total Equity-Passing Links Total Internal Links Total External Links Total Links in each metrics ( Page Specific Metrics: Subdomain Metrics: Root Domain Metrics: ) Each metrics Show different value for same metrics.
Link Explorer | | HuptechWebseo0 -
Top Pages are all 301
Hi, New to Moz, so sorry if this is a n00b question. I can see on the 'Top Pages' page, that the HTTP status of all my Top Pages is 301, which means they have been permanently redirected. I am trying to find out what they have been redirected from / to so that I can clean them up and make then nice 200s, but I can't see the info anywhere? 😕
Link Explorer | | plainsailing0 -
Different numbers in Moz bar vs. OSE
Hi, On a Google SERP, when i activate the MOZ toolbar one of the sites says it has 1,258 links / 667 RDs. But when I open this same site up in OSE I get 3 inbound links (see attch). What's going on? 0Au9H
Link Explorer | | sanjosepainting0 -
Really odd 404 URL's
Hi I'm getting some really odd 202 errors, I can't think that someone would link to me like this " http://sussexchef.com/contact-us/http.sussexchef.com/contact-us/ " There are 95 of them to deal with, I've checked my site and I can click though all the links on my site with out coming across 1 404. Any ideas? All the best Ben hiZnv0Y
Link Explorer | | SussexChef830 -
How Is a Page Crawled by Moz When Moz Says 'No Links'?
As above, really. I've crawled a new client's site to find the Moz crawler has identified a handful of 404 errors. The Moz crawler says these pages have '0 linking domains', and OSE has no data for these pages. So how are these pages being crawled by Moz and what should I advise my client?
Link Explorer | | xerox4320