Getting your site totally indexed by SEOMOZ
-
Hi guys!
Ijust started using SEOMOZ software and wondered how it could be that my site has over 10.000 pages but in the Pro Dashboard it only indexed about 1500 of them. I've been waiting a few weeks now but the number has been stable ever since. Is there a way to get the whole site indexed by SEOMoz software?
Thanks for your answers!
-
Thanks Abe!
As soon as I can analyse the whole site, including all the links, i will get back at you.
I think you got a good point about the links. I don't think SEOmoz can do anything about that
Greets,
-
Hello,
I'm sorry that some of your pages didn't end up getting crawled. There's a lot of reasons why this could have happened, some of which have to do with our crawler, and others that have to do with a site. Basically, the crawler finds pages by crawling all of the links on the homepage/front page and then crawling all of the pages those links took him to, and so forth, until all of the pages we can find under that directory are crawled. Usually, if a page is linked to from the homepage, it should end up getting crawled. If it doesn't, it's either a sign that those pages aren't as accessible as they could be to search engines, or that there is an issue with our crawler. Some of the time, it's a problem with Javascript - our crawler can't handle Javascript very well right now. Other times, content was created a little bit after we crawled but before we finished processing and putting up the results. That content will be captured in the next crawl usually. It can also be due to meta tags or robots.txt telling rogerbot not to crawl.
On the whole, I'm not sure why some of your pages wouldn't be showing up in the crawl. Can you let me know some examples of pages that should be in the crawl but didn't end up in your campaign? If you could also outline the links going to those pages, I can send all that information over to our engineering team and we can try to diagnose the issue. Thanks a ton!Talk to you soon,
Abe Schmidt-
SEOmoz Helpster
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Total External Links
Hi There, I'm looking at my link profile and my Total External Links dropped uber dramatically back in April. Any way to figure out what the heck happened? My only idea is that this was around the time we launched a new version of the website but I'm not sure it corresponds exactly and anyway the domain didn't change. Possibly some urls did but all have been redirected. Any ideas? Thanks, site is www.nationalpardon.org
Moz Pro | | NationalPardon0 -
Site Not Indexing & SEOMoz Reporting ZERO On-Page Report Crawls
Any help on this would be MUCH appreciated. One of my sites, aironeairsolutionsinc.com, has recently been rebuilt and the pages tweaked for some basic optimization. Based on my experience, those tweaks (geared toward keywords with relatively low competition locally) usually bump my local sites up into the top 20 or 30 at worst. 3 weeks later, it seems my site is still not indexing with Google. In addition, I AM NOTICING THAT THE ON PAGE REPORTS IN SEO MOZ ARE NOT REGISTERING THAT ANY PAGES ARE BEING CRAWLED. Again, any help from Moz staff would be awesome! :} Thanks, Ricky
Moz Pro | | RickyShockley0 -
How to exclude a specific subdomain from SEOMoz Campaign?
Forgive me if I've overlooked something obvious, but how can I exclude a subdomain from a campaign? I want to crawl/analyze mywebsite.com, but not subdomain.mywebsite.com Thanks in advance...
Moz Pro | | ahockley1 -
Is there a way to get the domain authority of a subdomain?
For example, www.storage-mart.com and us.storage-mart.com both show the same DA in OSE. I believe it's the DA of the root domain. How can I compare the DA of the 'www' and 'us' subdomains?
Moz Pro | | Whitespark0 -
Site Explorer - No Data Available for this URL
Hi All I have just joined on the trial offer, im not sure if i can afford the monthly payments, but im hoping SEOmoz will show me that i also cannot afford to be without it! In my proses of learning this site and flicking through each section to see what things do. However when i enter my URL into Site Explorer i get the following message "No Data Available for this URL" My site should be crawl-able, so how do i get to see data for my site/s. I wont post my URL here, as the site has a slightly adult theme.
Moz Pro | | jonny512379
If anyone could confirm if i can post "slightly adult" sites. Best Regards
Jon0 -
SEOMOZ Crawling Our Site
Hi there, We get a report from SEOMOZ every week which shows our performance within search. I noticed for our website www.unifor.com.au that it looks through over 10,000 pages, however our website sells less than 500 products so not sure why or how so many pages are trawled? If someone could let me know that would be great. It uses up a lot of bandwidth doing each of these searches so if the amount of pages being trawled reduced it would definitely assist. Thanks, Geoff
Moz Pro | | BeerCartel750 -
Open Site Explorer Not Working on 99% of Sites
I'm trying to use Open Site Explorer, but whenever I try to I get the error message "Ouch! It Looks Like Something Went South". Interestingly, I don't have this problem when entering a very popular site like google.com, yahoo.com, bbc.co.uk. Is there a problem with the tool at the moment, or something wrong on my end?
Moz Pro | | EssexGirl1 -
Open Site Explorer missing links
Hi, When the update of Open Site Explorer was released I noticed that the new version was missing a huge amount of links that the old version previously found. This still seems to be the case and it's pretty frustrating as we use the tool for our clients. Is this something that everybody is seeing and if so SEOMoz when do you think you'll have a solution? Many thanks
Moz Pro | | JonathanSmith0