Getting your site totally indexed by SEOMOZ
-
Hi guys!
Ijust started using SEOMOZ software and wondered how it could be that my site has over 10.000 pages but in the Pro Dashboard it only indexed about 1500 of them. I've been waiting a few weeks now but the number has been stable ever since. Is there a way to get the whole site indexed by SEOMoz software?
Thanks for your answers!
-
Thanks Abe!
As soon as I can analyse the whole site, including all the links, i will get back at you.
I think you got a good point about the links. I don't think SEOmoz can do anything about that
Greets,
-
Hello,
I'm sorry that some of your pages didn't end up getting crawled. There's a lot of reasons why this could have happened, some of which have to do with our crawler, and others that have to do with a site. Basically, the crawler finds pages by crawling all of the links on the homepage/front page and then crawling all of the pages those links took him to, and so forth, until all of the pages we can find under that directory are crawled. Usually, if a page is linked to from the homepage, it should end up getting crawled. If it doesn't, it's either a sign that those pages aren't as accessible as they could be to search engines, or that there is an issue with our crawler. Some of the time, it's a problem with Javascript - our crawler can't handle Javascript very well right now. Other times, content was created a little bit after we crawled but before we finished processing and putting up the results. That content will be captured in the next crawl usually. It can also be due to meta tags or robots.txt telling rogerbot not to crawl.
On the whole, I'm not sure why some of your pages wouldn't be showing up in the crawl. Can you let me know some examples of pages that should be in the crawl but didn't end up in your campaign? If you could also outline the links going to those pages, I can send all that information over to our engineering team and we can try to diagnose the issue. Thanks a ton!Talk to you soon,
Abe Schmidt-
SEOmoz Helpster
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why my site not crawl?
hi all me allow rogerbot in robots.txt but rogerbot can't crawl my site my site: toska-co.ir
Moz Pro | | jahanidawodi0 -
Major site overhaul
Hi guys and girls After reading all the content It became apparent that our website is a bit of a dog. I'm about to update our site with a new theme and content on moz.com I've found myself becoming so much more confident at all this. I've read all the material I can on Moz re: Site migration but still have one question. How do I find out all the links that I need to 301 before I make the new site live? Please don't worry about patronizing me! I'm really new at this! Ben
Moz Pro | | SussexChef830 -
Site Not Indexing & SEOMoz Reporting ZERO On-Page Report Crawls
Any help on this would be MUCH appreciated. One of my sites, aironeairsolutionsinc.com, has recently been rebuilt and the pages tweaked for some basic optimization. Based on my experience, those tweaks (geared toward keywords with relatively low competition locally) usually bump my local sites up into the top 20 or 30 at worst. 3 weeks later, it seems my site is still not indexing with Google. In addition, I AM NOTICING THAT THE ON PAGE REPORTS IN SEO MOZ ARE NOT REGISTERING THAT ANY PAGES ARE BEING CRAWLED. Again, any help from Moz staff would be awesome! :} Thanks, Ricky
Moz Pro | | RickyShockley0 -
Rogerbot did not crawl my site ! What might be the problem?
When I saw the new crawl for my site I wondered why there are no errors, no warning and 0 notices anymore. Then I saw that only 1 page was crawled. There are no Error Messages or webmasters Tools also did not report anything about crawling problems. What might be the problem? thanks for any tips!
Moz Pro | | inlinear
Holger rogerbot-did-not-crawl.PNG0 -
Why does SEOMoz only crawl 1 page of my site?
My site is: www.thetravelingdutchman.com. It has quite a few pages, but for some reason SEOMoz only crawls one. Please advise. Thanks, Jasper
Moz Pro | | Japking0 -
How to force SeoMoz to re-crawl my website?
Hi, I have done a lot of changes on my website to comply with SeoMoz advices, now I would like to see if I have better feedback from the tool, how can I force it to re-crawl a specific campaign? (waiting another week is too long :-))
Moz Pro | | oumma0 -
Seomoz toolbar - Server location
Hello, We target french countries and it seems IP server location is important. So we took some hosting at Planete Hoster (located in Canada) with French IP, but our seomoz toolbar says our website is located in Canada 😞 See: http://www.aupaindantan.fr/ Could you please explain? do we need to change the hoster and to take one in France or this one is ok? Thank you for your answer
Moz Pro | | ahernoux0