Getting your site totally indexed by SEOMOZ
-
Hi guys!
Ijust started using SEOMOZ software and wondered how it could be that my site has over 10.000 pages but in the Pro Dashboard it only indexed about 1500 of them. I've been waiting a few weeks now but the number has been stable ever since. Is there a way to get the whole site indexed by SEOMoz software?
Thanks for your answers!
-
Thanks Abe!
As soon as I can analyse the whole site, including all the links, i will get back at you.
I think you got a good point about the links. I don't think SEOmoz can do anything about that
Greets,
-
Hello,
I'm sorry that some of your pages didn't end up getting crawled. There's a lot of reasons why this could have happened, some of which have to do with our crawler, and others that have to do with a site. Basically, the crawler finds pages by crawling all of the links on the homepage/front page and then crawling all of the pages those links took him to, and so forth, until all of the pages we can find under that directory are crawled. Usually, if a page is linked to from the homepage, it should end up getting crawled. If it doesn't, it's either a sign that those pages aren't as accessible as they could be to search engines, or that there is an issue with our crawler. Some of the time, it's a problem with Javascript - our crawler can't handle Javascript very well right now. Other times, content was created a little bit after we crawled but before we finished processing and putting up the results. That content will be captured in the next crawl usually. It can also be due to meta tags or robots.txt telling rogerbot not to crawl.
On the whole, I'm not sure why some of your pages wouldn't be showing up in the crawl. Can you let me know some examples of pages that should be in the crawl but didn't end up in your campaign? If you could also outline the links going to those pages, I can send all that information over to our engineering team and we can try to diagnose the issue. Thanks a ton!Talk to you soon,
Abe Schmidt-
SEOmoz Helpster
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does SEOMOZ planing to restructure OSE metrics?
As you know SEO slowly turning into SEM and some metrics and numbers from Open Site Explorer are no so relevant any more. As a customer of SEOMOZ product i am warning if you guys are planning to add more value and ranking metrics according to the new ranking metrics and factors to your tools?
Moz Pro | | JasonOliveira0 -
Does SEOmoz have a tool to find mirror sites?
I heard from a company that is trying to get my clients SEO business that they discovered multiple sites mirroring our site's content. Does SEOmoz have a tool to find these websites? Or does Google?
Moz Pro | | thomas.wittine0 -
Is it possible to submit a page to the seomoz index?
We recently got added to dmoz and botw and would like to see those links considered in our domain authority as we are tracking our progress and comparing ourselves to other sites. Is it possible to submit links to the seomoz index manually to have those tracked? (If I am even understanding this correctly)
Moz Pro | | hyperthalamus0 -
SEOmoz campaign - keyword rankings...
Hi there, I have a quick question: Does it make a difference if I add keywords to a campaign with the '[' and ']' brackets included? I just realized that I had copy/pasted many of my keywords from the exported CSV from the Google AdWords Keyword Tool and I fear that the keyword rankings on SEOmoz might factor the brackets as part of the keywords themselves. Thanks in advance! Ben
Moz Pro | | BenHammer0 -
About NOFOLLOW tag for SEOmoz analysis
Hi all, Another issue while trying to resolve all the duplicate content SEOmoz reports to me. May be some of you guys can help: I have a dynamic error page on our website, generated in case of error, that can happen on many urls. Of course that one should not be indexed. I added the following tag on the HEADER: name="robots" content="NOODP,NOINDEX,NOFOLLOW" /> To me this should prevent from having this page indexed, but also from having this page reported by SEOmoz analyzer as duplicate content. Any hints?
Moz Pro | | nuxeo0 -
SEOMoz Crawler and rel_canonical_tag Errors
This tag is showing up on category pages (that do not have a duplicate page on the site). In mid November Google cut our traffic by 30%. Could this tag be confusing the spider? According to the moz crawler - we seemed to be dinged for this on 95% of our pages. Is this hurting us? It seems to direct back to the same page.EG: From the FMI3600 Page http://www.brick-anew.com/FMI-3600-Fireplace-Doors.html: http://www.brick-anew.com/FMI-3600-Fireplace-Doors.html"> There is only one page for the FMI 3600 Fireplace Door category - however, it does have the same products on it as other FP Door Category pages,
Moz Pro | | SammyT0 -
SEOmoz keyword rankings in campaign report
Hi. Does anybody know where the rankings summary has moved to in the campaign reports? I want to know how many keywords have moved up or down in the last week and can't find it anywhere!
Moz Pro | | neooptic1