Number of pages crawled in dropping from 4 to 2
-
The report on our campaign shows that up to 2 pages are being crawled now from 4. However, our site has more pages than this.
We recently inserted code to allow crawlers. what can we do to resolve this? please assist.v
-
Hi there,
Thank you for reaching out! I took a look at the issue, it looks like what went on is that you have a few 302 redirects in place on your site where it formed a series that took Roger to a place where he is having trouble crawling your site. Here's what the interaction looks like:
Initial homepage ---302---> intermediary index page ---302----> final landing index page.
This interaction is not an idea situation with Roger crawling your site, since it has a traditional problem crawling redirects in the first place, this is an issue with the site structure that caused this issue.
In regards to your site having more pages, it looks like to get to those pages, you would have to register or log in, at this time roger does not the ability to fill out forms in a crawl. Unfortunately I am not a web developer, so I don't know the exact way to implement changes on your end to allow our crawler to crawl your site.
Hope that helps, I will keep this thread open to allow others to chime in.
Best,
Peter
SEOmoz Help Team.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Pages Competing With One Another
Hello, We are ranking for an acronym, which I understand can lead to fickle rankings. However, we have two pages ranking page one - two for the same keyword, but they do so in spite of each other. By this I mean, one page will rank, while the other is nowhere to be found. It seems that the one page (a blog post) is more likely to rank on the weekends while the product page is more likely to rank on the weekdays. I would like the product page to rank all the time, and to target another keyword with the blog post. Would removing the keyword from the blog post allow the product page to rank all the time - or would it lead to no pages ranking during times when the blog post would otherwise be ranking? I should note the blog post has more external links and is not exactly optimized for the keyword, while the product page has more internal links and is optimized for the keyword.
On-Page Optimization | | Tom3_152 -
Should I set paramters to maximize the number of producs on all category pages for a retail website?
We have a retail website with over 20K products and do many things to reduce duplicate content including canonicals & parameters. In setting up parameters in Google Search Console, we have told Google to ignore the option to list more products, so the category pages that are indexed have only the default 12 products on them. I don’t want to create too much duplicate product content by doing this, but if there are only 12 products on a category page, the content is very thin Is it better to have as much product content as possible? My question: Should we set the parameter to follow the default (12 products) or should set it to 200 so there are more products associated with the category page?
On-Page Optimization | | apsltd1 -
Duplicate page content
Hi Crawl errors is showing 2 pages of duplicate content for my clients WordPress site: /news/ & /category/featured/ Yoast is installed so how best to resolve this ? i see that both pages are canonicalised to themselves so presume just need to change the canonical tag on /category/featured/ to reference /news/ ?(since news is the page with higher authority and the main page for showing this info) or is there other way in Yoast or WP to deal with this & prevent from happening again ? Cheers Dan
On-Page Optimization | | Dan-Lawrence0 -
How to rank well on 2 keywords - 2 separate pages or 1 combined page
Hi, I have a website about allergy. We ar developing new content, and through keyword research I have discovered that "dog allergy" and "cat allergy" are both very common searches. However, the cause, and symtoms are very alike for these 2 types of allergy so it would make sense to combine the two allergies on one page. So my question is: What do I choose to increase my chances to ranke the best I can for both "cat allergy", and "dog allergy"? Should I develop 2 separate pages for cat & dog allergy or should I do a combined page? (We would of course review the texts so no duplicate content/text would be used if we chose to have 2 pages) I would be so greatful for your advice!! Kind regards, Jeanette
On-Page Optimization | | Mylan-GDM0 -
10 Mobile Pages. 5 Desktop Pages. Canonnical to where?
I have a mobile site with more pages than the desktop site. Normally I would just point the page equivalents to the desktop site using the rel canonnical tag. What about the 5 pages? Do I just leave them be? Thanks
On-Page Optimization | | Imajery0 -
Is On Page SEO Dead?
Hey Guys, Search Engine Roundtable has published a short post about this a few days ago, quoting senior member at WebmasterWorld forums who said: "The way I see it, on-page text today is for the "relevance" part of the total algorithm. The whole algorithm is, in broad strokes, "relevance + connectedness + quality". After you've clearly stated the relevance of the page, then the rest of your ranking power comes from elsewhere. I've added on-page bold tags with no effect. I've added or changed h1 elements with no effect. Not too long ago, those might well have done something, but that's not the game anymore. And moving from a table layout to a CSS-P layout today might get you nowhere, too. It all depends how deeply complicated the table layout was, I think." http://www.webmasterworld.com/google/4408395.htm Is it true? Is on-page SEO really dead? What do you think?
On-Page Optimization | | ShivaS0 -
Landing page too long
In my first seomoz test I have many tilte pages for products that are over 70 charachers long. The part #'s are long like 10-782-10-10-10-PPxxxx etc. All these part #'s are not my key products and I could delete or truncate. My question is if the part numbers are not that important, is it OK to leave them as is or is ranking being damaged because they exist?
On-Page Optimization | | Wales0 -
Https and secure pages
Hello, I have a facebook badge in my footer. Is it okay if I make the code call on https. It makes the page secure for IE. I have also have done this for images. These secure urls are also being called on non secure pages. But I don't think that matters does it? Code below. Thanks Tyler
On-Page Optimization | | tylerfraser0