Google Index/Cashe questions
-
I have 15k+ pages. I have 4.5k pages indexed.
What relation is the google cashe to indexing pages? My site gets cashed every two days. The competition in my SERP goes 2-3weeks to get cashed. What does this indicate? Is your cashe date your last google crawl?
How can I get google to crawl my site? Is there a way I can get google to crawl my site starting from an internal page. This way I could set up a better linking structure that would benefit from doing activities that get that page indexed to help get my site indexed more thoroughly...
-
I guess I might try that. I was concerned 40-50 links on an internal page (very internal = No PR) would kill that page and any chance of the internal pages ranking.
-
Yes, you have a good take on it JML. I too would love to hear what others have to say about this.
Have you thought about putting a "View All" option (link) on your listings pages? This could make it possible for both users and Google bot to access all of the listings without having to deal with the latency inherent with paginated pages. (Googe's own research has shown that users prefer scrolling through lots of content instead of having to move from one page to another....just a thought).
-
So if I can get google to come to an interior page, how deep will it dig. Perhaps I need to figure out how many times can I call google per month, then have that many interior pages that have a significant number of links that lead to additional static pages (each link) that are linked out as well.
Like a pyramid. Google enters Interior Page (A). It's a static page (wordpress) that links 99 links that all link to 99 pages that link to 99 pages. Google would go about three in? I could get more indexed like this.
My page is linked well. It's dynamic content (real estate listings) that have hubs set up. There is a lot of pagination which is what I think google stops at. It enters subdivision "X" and there are 10 listings per page, paginated. There are 300 listings in that subdivision. I don't think google is going too far in to that subdivisions listings page. I need to understand google indexing better.
I invite more participants. Thank you Dana. I need more info all Help!
-
Yes, you can get Google to crawl your site starting from an interior page using "Fetch as Googlebot" which is available as an item in the left hand navigation menu is Google Webmaster tools. After entering the URL of the page click on "Submit to Index" and then a box will open that gives the choice of submitting just that URL or submitting the URL plus all linking pages. Choose that second option. You can only do this a limited number of times a month so be judicious about which ones you submit this way.
As far as cache date, convention wisdom is that the more recent your cache date, the better. What this means is that Google is actually crawling your site more often. A cache date of 3 weeks or more happens when Google has come to your site or page many times but rarely finds any new content. WHen that's the case, google bot visits less frequently. Because Google values fresh content, it's better to have a newer cache date and to have google bot visiting more frequently.
I would be a little bit concerned that you have 15K pages and only 4.5K indexed. That ratio seems low to me. This might be an indication that google bot is having trouble crawling your entire site. Also, how new is your site? Is it a few months old or a few years old? Google bot crawls new sites more frequently, simply because they are new content. Over time, depending on how often your content is edited, updated or new content is posted, the crawl schedule will change.
I know this is only a partial answer to your question. But hopefully it provides a little insight.
Dana
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How long does Google take to reduce the index size?
A few months ago, we have incorporated our custom search in our website www.ergodotisi.com . We hadn't been paying a lot of attention to our webmaster analytics, to find out a few months later than the Google Index had grown from 2K- 3K pages to one million because it was crawling all combinations of search filters. We have now followed the right instructions to add noindex meta tags and blocked most search result pages from the robot.txt. We allow indexing of some main categories by setting new seo-friendly url structures. A few weeks have passed and the index size has only reduced to 700K. How long does it take before it removes most of the duplicated search result pages from the index? Is it still crawling those pages but has not fully decided to remove most of them? How bad is this for SEO?
On-Page Optimization | | cplastiras840 -
Google Website title not showing correctly
Hi Im not sure what triggered this - Page title is showing up as 'Isagenix Australia' while it should be <title>Buy Isagenix with 30 Day money back guarantee & Free Shipping in June</title> Previous title was 'Isagenix Australia - Read Isagenix reviews & buy isagenix products' but now it seems to have a mind of its own. Any suggestions would be helpful
On-Page Optimization | | IsaCleanse0 -
Too Many on page links on my homepage question?
Question, on moz analytics, for my homepage, I've gotten the " Too many on page links" notification every crawl. I've always ignored it because i didnt think it affected ranking or anything really. The on page links on the bottom of our homepage are landing pages. Most users reach those pages by searching those specific pages on google. We just decided to put them on the bottom of our page for unknown reasons. My question is, should i remove the landing pages on the bottom of our homepage? WIll it improve search rankings for my homepage? if i do remove them, should i put the landing pages on another page besides the homepage? Does google index my website better without the on page links on my homepage? My website is- prestigeluxuryrentals.com
On-Page Optimization | | prestigeluxuryrentals.com0 -
Question Re Cornerestone Page And Anchor Text For Internal/External Links
Suppose I create a cornerstone page with the targeted keyword "Dog Collars". I write a dozen articles on various dog collars and point a link from each article to my cornerstone page. Should the anchor text for the links from each of those articles to the cornerstone page be "Dog Collars" or should they vary, but still be relevant to "Dog Collars" for best SEO? Should half of them be "Dog Collars" and the other half various? Also, if I have 12 articles and all of the anchor text is already "Dog Collars", should I go back and change them so that they all don't say the same thing? If hope my question makes sense ... thanks in advance. I will give thumbs up for helpful responses and suggestions 😉
On-Page Optimization | | Humanovation0 -
My report is showing duplicate titles.. for http://www.mysite.com/ & http://mysite.com
Is this because I setup my campaign wrong in seo moz or should I have my site setup differently to forward all traffic without the www to the www version? Or vise versa? Thanks for any advice!
On-Page Optimization | | Fridaythe15th0 -
Google vs. Bing
We are having some really good results with our SEO strategies for local search and long tail searches for our clients on Google; however, Bing is a completely different story in a couple of cases. What is Bing looking for that Google is not? We have even noticed that something may rank well in Bing then not show up at all in Google? Any help would be greatly appreciated.
On-Page Optimization | | Strategexe0 -
Site structure suggestions/feedback
I asked this on Reddit and got some some decent answers. I'm curious to see what the pro's of SEOmoz think. I've got a lead generation site for forklift parts--liftxparts.com. You can think of it similar to car parts, where we have sections for specific brands (e.x. Toyota forklift parts) and sections for specific categories (e.x. forklift filters). Right now, the site is structured in two main levels: the top level is a dozen or so brands (separate pages for Toyota forklift parts, Clark forklift parts, etc), and then the second level is the categories (separate pages for a dozen or so different categories like forklift filters, forklift engine parts, etc.).If you check out one of the pages, like Clark forklift parts for example (our top landing page)--liftxparts.com/clark-forklift-parts.html, you'll see that on the brand pages (they're all structured the same), we list all the different categories (with links to the same second level category pages) and "search" buttons. All pages point to the same lead capture form.This has been working pretty well--about 90% of visitors end up on our lead capture form, and a high percentage of those convert. We're working on increasing organic traffic now and I'm thinking our structure could use some improvement.Looking at the analytics, there are a lot more impressions for keywords like "clark forklift" than "clark forklift parts". One gap I've uncovered is while our average position, and by extension CTR and traffic, for phrases like "clark forklift parts" is quite good, it's not so good for broader and higher searched terms like "clark forklift". Should we add another level of hierarchy targeted to just general brands? So now we have content for clark forklift parts, but should we add a page for terms like "clark forklift"? Or should we just add some broader content to the existing brand pages? The pages are quite long already, I'm afraid adding more content to the bottom of the page isn't very functional. Our thinking is that we can increase average position for higher searched terms by adding content targeted to those terms. The question is how exactly to go about it and how to work it into our current site structure? Any feedback related to our site structure or even just related ideas about other ways to approach our goal of increasing organic traffic would be very much appreciated! Thanks!
On-Page Optimization | | wisamabdulla0 -
Scripts question
My question is whether search engines will crawl the page before or after scripts run on the page. I have a H1 that will be replaced with a canvas by jquery script. Will search engines see the H1 or the canvas?
On-Page Optimization | | lojdqvist0