My report only says it crawled 1 page of my site.
-
My report used to crawl my entire site which is around 90 pages. Any idea of why this would happen?
-
Here's a replacement post with some of the same information at http://moz.com/help/pro/why-can-t-rogerbot-crawl-my-site. You can also send a note to the help desk at help@moz.com and we'll help you figure out what's up.
-
Hi Keri:
I am trying to run a crawl on two different sites where this is happening. I've come across your response in two posts, six months apart. However the article you reference produces a 404 error. Can you point me to the new location of that information? Thank you.
-
We have had a few crawl hiccups lately. Some reasons why this happens are at https://seomoz.zendesk.com/entries/409821-why-isn-t-my-site-being-crawled-you-re-not-crawling-all-my-pages and if that doesn't work, please do go to http://www.seomoz.org/help and open up a ticket with us.
-
I have it set as a campaign. This would of been my second crawl for this month. I had relatively low errors, warnings, but all my errors are set to zero so that is a good thing :). It almost looks as if my homepage is the only one being indexed, but i checked my other pages and all seems to be well. I will put a ticket in.
Thanks,
-
Nate
A little more info would help. I looked at your url and all seems ok on the face of it. Was this a crawl test or a campaign? Did you get a summary page and did it show any crawl errors? Warnings? etc.?
If it was a campaign and if in the past ...used to crawl entire site... put a ticket in with support or email help@seomoz.org. They are quick to help.
Hope this helps,
-
From what I gather from reading up on this over the last few days, SEOmoz does a quick crawl of your site then does a re-crawl which is later on. Think it takes up to 7 days for a full crawl.
If you have just started, I wouldn't worry too much at this stage!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate page titles for blog snippets pages
I can't figure the answer to this issue, on my blog I have a number of pages which each show snippets and an image for each blog entry, these are called /recent-weddings/page/1 /2 /3 and so on. I'm getting duplicate page titles for these but can't find anywhere on Wordpress to set a unique title for them. So http://www.weddingphotojournalist.co.uk/recent-weddings/…/2/ has the same title as http://www.weddingphotojournalist.co.uk/recent-weddings/…/3/
Technical SEO | | simonatkinsphoto0 -
Log files vs. GWT: major discrepancy in number of pages crawled
Following up on this post, I did a pretty deep dive on our log files using Web Log Explorer. Several things have come to light, but one of the issues I've spotted is the vast difference between the number of pages crawled by the Googlebot according to our log files versus the number of pages indexed in GWT. Consider: Number of pages crawled per log files: 2993 Crawl frequency (i.e. number of times those pages were crawled): 61438 Number of pages indexed by GWT: 17,182,818 (yes, that's right - more than 17 million pages) We have a bunch of XML sitemaps (around 350) that are linked on the main sitemap.xml page; these pages have been crawled fairly frequently, and I think this is where a lot of links have been indexed. Even so, would that explain why we have relatively few pages crawled according to the logs but so many more indexed by Google?
Technical SEO | | ufmedia0 -
How do I influence what page on my site google shows for specific search phrases?
Hi People, My client has a site www.activeadventures.com. They provide adventure tours of New Zealand, South America and the Himalayas. These destinations are split into 3 folders in the site (eg: activeadventures.com/new-zealand, activeadventures.com/south-america etc....). The actual root folder of the site is generic information for all of the destinations whilst the destination specific folders are specific in their information for the destination in question. The Problem: If you search for say "Active New Zealand" or "Adventure Tours South America" our result that comes up is the activeadventures.com homepage rather than the destination folder homepage (eg: We would want activeadventures.com/new-zealand to be the landing page for people searching for "active new zealand"). Are there any ways in influence google as to what page on our site it chooses to serve up? Many thanks in advance. Conrad
Technical SEO | | activenz0 -
Used Machines Site - Should I delete sold machines pages?
I´ll start posting in a wordpress blog used machines (excavators and wheel loaders) from a local company. They buy used machines every day and sell machines every day also. When They sold a machine should I: A) Edit the page with a sold machine text and show similar machines? B) Change the category of the post ( to something like sold machines)? C) Make a 301 redirection to one similar machine? D) Keep the page and Make a 301 redirection to one similar machine? E) Delete the page and Make a 301 redirection to one similar machine? F) Keep the page and Make a 301 redirection to top10 machines? G) Delete the page and Make a 301 redirection to top10 machines? F) Any Suggestions are welcome 🙂
Technical SEO | | SeoMartin10 -
On-Page Report Says 'F', and I'm Confoozled As to Why
I'm primarily interested in how we failed in our "Broad Keyword Usage in Title" category. The Keyword Pair we're gunnin' for is: "Mac Windows" Our current page title is: "CrossOver: Windows on Mac and Linux with the easiest and most affordable emulator - CodeWeavers" This is, I grant, ugly. However, bear with me. SEOMoz Report Card says "Easy Fix!" and suggests: "Employ the keyword in the page title, preferrably as the first words in the element." I humbly submit that "Mac" and "Windows" IS in the page title. So what am I missing? Is it the placement of the words relative to each other, or relative to the start of the sentence? Or is the phrase "CrossOver:" somehow blocking the rest of the sentence from being read? Are colons evil? I'm genuinely mystified as to why (from a structural standpoint) our existing title tag is failing this test, and I'd be delighted for answers and/or feedback. Thanks in advance.
Technical SEO | | CodeWeavers0 -
My site is showing blanks for the competitive analysis and only 1 for domain. Why?
I have filled in all the details and set the campaign up as a root domain. The site has been up for 4 days, and has been crawled. Please help!
Technical SEO | | EdgePM0 -
Once we make changes to our site is there a way to force the engines to re-crawl it faster?
After we implement canonicals URLs, or make some other significant change to our site that is going to impact our SEO, is there a way to force Google or other search engines to re-index us faster? Would manually re-submitting a sitemap do this?
Technical SEO | | askotzko0 -
On-Page Report Card, rel canonical
My site has the rel canonical tags set up for it. The developers say that it is set up correctly. Looking at the source code myself, it looks (to my untutored eyes) to be set up correctly. However, on the On Page Report Card for every page I have checked, it says that it doesn't point to the right page. I'd really like to change all my 'B's to 'A's, but I simply can't see what the issue is.
Technical SEO | | Breakout0