Pages crawled dropped like a stone
-
set up a new campaign
seomoz crawled the site and did about 1500 pages
the last crawl it now only lists 1 page
I can see anyway to see why, the site has not changed so why has the number of pages dropped?
-
Here's a post from our help desk on why sometimes only one page is crawled. https://seomoz.zendesk.com/entries/409821-why-isn-t-my-site-being-crawled-you-re-not-crawling-all-my-pages If that doesn't solve your problem, please send an email to help@seomoz.org. Thanks!
-
You can't force it to crawl more frequently. If they start a manual crawl for you, it will take a couple days, not a week.
-
Seriously, that's exactly what happened to me once. Roger starts its crawl from the homepage and then goes deeper. Sometimes he malfunctions. If you email help, they can start another manual crawl for you.
-
so what was it, and how quick was it solved?
That worries me a little as if i now have to wait another week, I cant sit here doing nothing while I wait for it to crawl again and see if my last round of changes has improved things?
Can you force it to crawl more frequently
-
looks like its only crawled the home page so what would stop it past the home page, if it had errors would it tell me, as i know there are more pages as the last crawl it did over 1500
-
That happened to me a few months ago and it turned out to be an issue with SEOmoz, not with my site. This is something you should email the help desk about.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate Home Page
Hi, I have a question around best practise on duplicate home pages. The /index.aspx page is showing up as a top referrer in my analytics. I have the rel=canonical tag implemented for the www.mysite.com on both pages. Do I need to 301 the /index.aspx to the mysite.com? I have a lot of links pointing to the /index.aspx (half of those are coming from the mysite.com). www.mysite.com/index.aspx www.mysite.com Many thanks Jon
On-Page Optimization | | JonRaubenheimer0 -
Too Many On-Page Links
If a page has more than 100 links, rather than splitting up the page into multiple pages, is it ok to use name="robots" content="noindex, follow" />? The page in question lists links to articles so the page itself isn't that important to appear in serps, but the articles are the helpful content pages: www.ides.com/articles/processing/injection-molding/
On-Page Optimization | | Prospector-Plastics0 -
To Many Links On Page
I'm having a problem on a crawl warning for our main site. The warning is that every one of my pages has to many links, a little over 1,000 on almost all of them. I think this is because our category list on our left hand sidebar has so many categories, and that sidebar appears on every last one of our pages even all the way into our products. Can anyone take a look and tell me if this is the reason why and what I could possibly do about this? Thanks in advance! www.Ocelco.com
On-Page Optimization | | Mike.Bean0 -
Would I be safe canonicalizing comments pages on the first page?
We are building comment pages for an article site that live on a separate URL from the article (I know this is not ideal, but it is necessary). Each comments page will have a summary of the article at the top. Would I be safe using the first page of comments as the canonical URL for all subsequent comment pages? Or could I get away with using the actual article page as the canonical URL for all comment pages?
On-Page Optimization | | BostonWright0 -
On page optimisation reports
Hello, How do I configure these reports to check my landing pages, rather than just my home page? Thanks, Bilal
On-Page Optimization | | PLP0 -
Duplicate Page Titles
I have over 200 duplicate page titles on a site that I am working on. Does putting a date at the end of some of them make it a unique enough title?
On-Page Optimization | | SavingSense0 -
I am optimizing my webpages according to suggestions from the On Page Report Card. Should I have more than one keyword for a page?
I am optimizing my webpages according to suggestions from the On Page Report Card. Should I have more than one keyword for a page or should I make separate pages for each keyword even when they are similar? Will Google penalize me for making similar pages? Imagine selling, bargain milk chocolate peanut clusters. Keywords examples could be: Bargain chocolate Bargain milk chocolate Bargain milk chocolate peanut clusters Bargain chocolate peanut clusters Chocolate peanut cluster bargains Milk chocolate peanut cluster bargains Etc. Will one page called http://mycompany/bargainmilkchocolatepeanutclusters.com be OK or should I have one called http://mycompany/bargainmilkchocolate.com and one called http://mycompany/bargainmilkchocolatepeanutclusters.com and one called http://mycompany/chocolatepeanutclusterbargains.com , etc.? Thanks for your advice.
On-Page Optimization | | KSHAYY0 -
Getting pages indexed by Google
Hi SEOMoz, I relaunched a site back in February of this year (www.uniquip.com) with about 1 million URL's. Right now I'm seeing that Google is not going past 110k indexed URL's (based on sitemaps). Do you have any tips on what I can do to make the site more likeable by Google and get more indexed URL's? All the the part pages can be browsed to by going to: http://www.uniquip.com/product-line-card/suppliers/sw-a/p-1 I've tried to make the content as unique as possible by adding random testimonials and random "related part numbers" see here: http://www.uniquip.com/id/246172/electronic-components/infineon/microcontrollers-mcu/sabc161pilfca Do I need to wait more time and be more patient with Google? It just seems like I'm only getting a few thousand URL's per day at the most. Would it help me if I implemented a breadcrumb on all part pages? Thanks, -Carlos
On-Page Optimization | | caneja0