Number of pages crawled in dropping from 4 to 2
-
The report on our campaign shows that up to 2 pages are being crawled now from 4. However, our site has more pages than this.
We recently inserted code to allow crawlers. what can we do to resolve this? please assist.v
-
Hi there,
Thank you for reaching out! I took a look at the issue, it looks like what went on is that you have a few 302 redirects in place on your site where it formed a series that took Roger to a place where he is having trouble crawling your site. Here's what the interaction looks like:
Initial homepage ---302---> intermediary index page ---302----> final landing index page.
This interaction is not an idea situation with Roger crawling your site, since it has a traditional problem crawling redirects in the first place, this is an issue with the site structure that caused this issue.
In regards to your site having more pages, it looks like to get to those pages, you would have to register or log in, at this time roger does not the ability to fill out forms in a crawl. Unfortunately I am not a web developer, so I don't know the exact way to implement changes on your end to allow our crawler to crawl your site.
Hope that helps, I will keep this thread open to allow others to chime in.
Best,
Peter
SEOmoz Help Team.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Keyword ranking for different page than the page optimized
I have optimized "equipment trailer for rent" on this page: http://www.bigtrailerrentals.com/flatbed-trailer-rentals/equipment-deckover. I'm wondering if anyone can tell me why Google has chosen to rank the keyword phrase for this page: http://www.bigtrailerrentals.com/flatbed-trailer-rentals/equipment-24 This is just one example. It has happened on several of my pages / keywords.
On-Page Optimization | | BigTrailerRentals0 -
My site on desktop browser: page 2 /mobile browser: page 0
Using my two most pertinent keywords in Chome my site shows up page two. Using the same keywords on my iPhone does not show my site at all (I clicked on to page 15). I have a mobile ranking of 84 on Google PageSpeed Insights. Could be a bit higher but not enough to totally ignore my site. What am I missing?
On-Page Optimization | | artsp0 -
Google Search Console issue: "This is how Googlebot saw the page" showing part of page being covered up
Hi everyone! Kind of a weird question here but I'll ask and see if anyone else has seen this: In Google Search Console when I do a fetch and render request for a specific site, the fetch and blocked resources all look A-OK. However, in the render, there's a large grey box (background of navigation) that covers up a significant amount of what is on the page. Attaching a screenshot. You can see the text start peeking out below (had to trim for confidentiality reasons). But behind that block of grey IS text. And text that apparently in the fetch part Googlebot does see and can crawl. My question: is this an issue? Should I be concerned about this visual look? Or no? Never have experienced an issue like that. I will say - trying to make a play at a featured snippet and can't seem to have Google display this page's information, despite it being the first result and the query showing a featured snippet of a result #4. I know that it isn't guaranteed for the #1 result but wonder if this has anything to do with why it isn't showing one. VmIqgFB.png
On-Page Optimization | | ChristianMKG0 -
To create extra pages, or not to create extra pages?
I'm responsible for a site where we cater for all kinds of medical & legal problems. I recently conducted keyword research that shows a lot of questions being 'asked' in relation to the conditions we cater for. Naturally, I want to create content to answer these questions. We have a page for 'Cancer compensation' - the 'possible content' that answers questions won't necessarily help someone claiming compensation for cancer mistreatment, BUT someone who asks a question relating to cancer, answered in the 'possible content' may find the 'cancer compensation' page useful. SO! Do I: Add this content to the existing 'cancer compensation' page? Create individual pages of content answering each question, linking to the 'cancer compensation' page? or do I amalgamate all the answers into one heafty 'resource' page that sits elsewhere on the site? What do you think? Thanks in advance. John King
On-Page Optimization | | Muhammad-Isap0 -
Area pages
As area pages are seen as trying to game google (see link below) is their a 'better way' to target multipe areas (100 odd)? https://support.google.com/webmasters/answer/2721311?hl=en Cheers
On-Page Optimization | | webguru20140 -
Local Service Pages
We've all been here before if you do local. What type of content should go on a local service page when dealing with multiple service locations? You could: Describe Services List Local News Articles List staff in that location (although I would prefer in the staff page for that city) Testimonials from that location or service But what happens when you are describing something that needs no explanation. Or a medical procedure that requires no localization and altering the wording can actually cause legal problems if misstated. Matt Cuts recommends a few sentences to a paragraph to describe a service, but my experience hasn't found this to hold up locally. Any ideas or suggestions about how this could be remedied?
On-Page Optimization | | allenrocks0 -
How do I get other pages to show in SERPs
Why is it that when you google a domain like yahoo.com you sometimes get a main SERP and 6 sub SERPs below it. This concerns the 1st position.
On-Page Optimization | | ribandhull0 -
Optimization of home page
Hi there I have an issue which, despite searching hard, I simply cannot find the right solution for. We have an index page that used to rank pretty well for a main industry keyword. However following a revamp of the site last year the kw slipped and no longer brings in decent traffic levels. The problem seems to be that the old static site had a sprinkling of variable anchor text links that brought value to the home page. Instead of the main anchor being "home" we would revert to "main keyword" and variations across the site sometimes in t he content but mainly on the nav bars. However the new CMS design structure restricts us considerably with anchor distribution and so instead we opted for the site logo on the masthead to have an ALT tag for "main keyword" but so as not to game google too much we added .."home" to the tag. Probably pointless but we figured it could do no harm. This ALT text is site wide Problem now is that we have lost the spread of internal nav bar anchors and variety etc. We have slipped in the serps for "main keyword" and I cant help thinking we are not maximising the anchors as we should. So what Im coming to is this.... How can we tell if Google is picking up the ALT tage anchor as the main anchor to rank the site at the expense of all internal text anchors. Despite retaining lots of embedded anchors - according to the Moz metrics these are not being picked up because OSE suggests the ALT tag anchor is taking precedence. The serps probably support this view as well. Should we: a) Vary the masthead ALT if there is no way of avoiding this being the most important link / anchor on the page b) Remove the ALT anchor and instead opt for content links high on the page (we do have nav bar links saying "Home" site wide as well which may overrid the embedded links?) c) Leave the ALT alone and still push for content anchors as described in b) What is the best way to handle this..? Best wishes and thanks Morch
On-Page Optimization | | Morch0