Increase number of pages crawled
-
Only one page is being crawled, how do I increase the number to include most of our site?
-
Hi! I am guessing that you're referring to SEOmoz only crawling one page of your site? The list of possible reasons for that is at https://seomoz.zendesk.com/entries/409821-why-isn-t-my-site-being-crawled-you-re-not-crawling-all-my-pages. If none of those are applicable, go to the help hub at http://www.seomoz.org/help and contact our help team and we'll work on figuring it out with you.
-
make sure you are not unintentionally blocking pages in your robots.txt or meta robots tags and that the links on your site are search engine friendly links that the crawlers can follow.
submit the URL(s) to be crawled in google webmaster tools to tell the bots to come around again.
increase the crawlrate manually in WMT
-
Hi Lisa,
OSE will crawl enough pages of your site that are found/relevant at the time of the last crawl.
OSE is not up to date at any one time.
This FAQ shows that some data may be delayed up to 60 days, however in my experience listing new websites, this has been more like a couple of weeks.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to analysis Product List position in Analytic for 2nd Page Clicks?
Hi All, While implementing Product list position when user move to 2nd page then position again start from 1st position so how I will know in google analytic that 1st Position clicked from 1st page, 2nd page, 3rd page etc and same way how do i know if page is sorted with highest or lowest price? I am talking about given below position. dataLayer.push({ 'ecommerce':{ 'currencyCode':'EUR', // Local currency is optional. 'impressions':[ { 'name':'Triblend Android T-Shirt', // Name or ID is required. 'id':'12345', 'price':'15.25', 'brand':'Google', 'category':'Apparel', 'variant':'Gray', 'list':'Search Results', 'position':1 }, Regards, Mitesh
Reporting & Analytics | | Arnold30 -
In Real Time Page Views Showing Down But Users Not Affected what is happening actually?
Hi All, For my ecoommerce site we constantly keep eye on real time analytic many time we see page views suddenly goes down for 1 min only then again started growing but visitors in "Right Now" section not affected. Network team, developer team, DBA team, seo team no one able to find bug from there end. Neither google shows any website down, server error or 404 etc in search console. So what is exactly happening when pageviews go down? Do really visitor affected If no then also why and if yes then also why? Please help. Thanks!
Reporting & Analytics | | amu1230 -
Is there a way to map your on-page SEO changes with the organic growth?
Hi Mozzers, I was just wondering if there's a way we can map our on-page SEO changes with the increase/decrease in organic traffic. For instance, I introduced brand pages' link the product page breadcrumbs and suddenly organic traffic for my brand pages increase from X to 2X in 1 couple of weeks. Now, this can be because of this breadcrumb change purely or because of some algorithm update or may be, bots started finding the content interesting and hence, started ranking them up (in case the brand pages were launched recently). So, you can't say which change should be mapped to what increase/decrease in organic traffic. Or, is there a way to map this?
Reporting & Analytics | | _nitman0 -
How to get multiple pages to appear under main url in search - photo attached
How do you get a site to have an organized site map under the main url when it is searched as in the example photo? SIte-map.png
Reporting & Analytics | | marketingmediamanagement0 -
Increase in 404 errors in Webmaster Tools
We have recently updated our website www.cooke.co.uk and twice webmaster tools have reported an increase in 404 errors. However, these errors are not for normal pages, they are things like http://www.cooke.co.uk/?post_type=crown_enquiry&p=1045 I have used the redirection tool in WordPress to redirect all these links to the homepage but does anyone know why this is happening since it is the second time I had to do it. Thanks.
Reporting & Analytics | | AAttias0 -
Why My Site Got 1000% increase in organic traffic from day to night?
Did Google run any update Monday or recently? My site www.shirts4geek.com, strangely had a 1000% organic traffic increase from day to night. I didn't do anything in this site for long a time... but Monday I had a lot traffic coming from organic and every other day this week the site is doing extremely well on traffic and sales. I'm ranking first page for many keywords relate to my products. I wish I could figure out what happens so I can replicate it. The site has very links and the On Page Optimization is kind of basic. Does any have any idea how it could be possible? Have any one seen something similar lately?
Reporting & Analytics | | Felip30 -
What does "on first page" mean in seomoz ranking reports?
Hi - When reports here show numbers of keywords appearing "on first page", there must be some implicit assumption made about the number of results listed per page. 1. Can anyone tell me what that assumption is? Is it 10? 20? 2. What about universal results Local links? If the answer to number one is, for instance, 20 results per page, then are there any assumptions made about the number of universal results Local links included? I'm just trying to understand what the reports mean. Thanks, Tim
Reporting & Analytics | | tcolling0 -
Number of Visitor Entries to page via search engine
Hi, I wanted to figure out the most optimal way to track the number of visitors that comes to a specific page on my blog via search engine only. I know Google Analytics has a "top landing page" filter, but that includes all visitors that comes in directly or other channels. Is there a way to figure out how many visitors a certain page received that was generated through only search engine? Does SEOmoz have this capability?
Reporting & Analytics | | kevinyu10290