Google Index/Cashe questions
-
I have 15k+ pages. I have 4.5k pages indexed.
What relation is the google cashe to indexing pages? My site gets cashed every two days. The competition in my SERP goes 2-3weeks to get cashed. What does this indicate? Is your cashe date your last google crawl?
How can I get google to crawl my site? Is there a way I can get google to crawl my site starting from an internal page. This way I could set up a better linking structure that would benefit from doing activities that get that page indexed to help get my site indexed more thoroughly...
-
I guess I might try that. I was concerned 40-50 links on an internal page (very internal = No PR) would kill that page and any chance of the internal pages ranking.
-
Yes, you have a good take on it JML. I too would love to hear what others have to say about this.
Have you thought about putting a "View All" option (link) on your listings pages? This could make it possible for both users and Google bot to access all of the listings without having to deal with the latency inherent with paginated pages. (Googe's own research has shown that users prefer scrolling through lots of content instead of having to move from one page to another....just a thought).
-
So if I can get google to come to an interior page, how deep will it dig. Perhaps I need to figure out how many times can I call google per month, then have that many interior pages that have a significant number of links that lead to additional static pages (each link) that are linked out as well.
Like a pyramid. Google enters Interior Page (A). It's a static page (wordpress) that links 99 links that all link to 99 pages that link to 99 pages. Google would go about three in? I could get more indexed like this.
My page is linked well. It's dynamic content (real estate listings) that have hubs set up. There is a lot of pagination which is what I think google stops at. It enters subdivision "X" and there are 10 listings per page, paginated. There are 300 listings in that subdivision. I don't think google is going too far in to that subdivisions listings page. I need to understand google indexing better.
I invite more participants. Thank you Dana. I need more info all Help!
-
Yes, you can get Google to crawl your site starting from an interior page using "Fetch as Googlebot" which is available as an item in the left hand navigation menu is Google Webmaster tools. After entering the URL of the page click on "Submit to Index" and then a box will open that gives the choice of submitting just that URL or submitting the URL plus all linking pages. Choose that second option. You can only do this a limited number of times a month so be judicious about which ones you submit this way.
As far as cache date, convention wisdom is that the more recent your cache date, the better. What this means is that Google is actually crawling your site more often. A cache date of 3 weeks or more happens when Google has come to your site or page many times but rarely finds any new content. WHen that's the case, google bot visits less frequently. Because Google values fresh content, it's better to have a newer cache date and to have google bot visiting more frequently.
I would be a little bit concerned that you have 15K pages and only 4.5K indexed. That ratio seems low to me. This might be an indication that google bot is having trouble crawling your entire site. Also, how new is your site? Is it a few months old or a few years old? Google bot crawls new sites more frequently, simply because they are new content. Over time, depending on how often your content is edited, updated or new content is posted, the crawl schedule will change.
I know this is only a partial answer to your question. But hopefully it provides a little insight.
Dana
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
News site and duplicate/cannibalism/old
Hey everybody. I am working with a handful of medical news websites and some of these sites are rather large. I am noticing/suspecting there is some cannibalism going on here. How do news sites deal with this? Do they noindex the old stuff? Update the old stuff instead of writing a new piece all together? Curious what to do!
On-Page Optimization | | HashtagHustler0 -
Why my website some pages is not index in google ?
Hi, I have submitted my pages in Google fetch for consideration tool but they are not indexed yet in the Google search. Additionally, there is also no error shown by the Google.
On-Page Optimization | | seo.kishore890 -
H1 question
is it recommended to have the page title labeled as H1? or better to have page title and separate H1 ? thank you
On-Page Optimization | | gergi0 -
Re="tag" Question
Hello, I own the site I putted rel="tag" in categories and product links , its correct? There are a lot of categories and products , I wont get penalized right? Just making sure to know if Im doing it right , thank you for help me 🙂
On-Page Optimization | | matiw0 -
Question Regarding Site Structure
I have a quick question regarding site structure that I hope some of you guys could share your opinion on. I watched a white board friday from Rand a little while back where he explains that you need to try and make the site structure as flat as possible. He was saying try having no more that 3 links from the home page to get to the desired location. My question is this. I am looking at a site that has a pretty complex structure that I am trying to clear up as much as possible without making any of there rankings suffer. So they have www.domian.com/general-category/district/town/ and sometimes www.domian.com/general-category/district/town/item-specifics Now i know it is not good as it is, but they are dubious about changing too much as they have some serious traffic coming to the site. But, my question is that all the pages can be found from the home page through the menus/sub-menus. But do these count as a direct link from the home page. Also a problem is that because of this mozbot has detected that there are too many links from the home page and suggested that it should be below 200. But should I make these menu links no index or no follow. Obviously, by doing this, if the link does count as direct from the home page it wont after doing this. Thanks Jenson
On-Page Optimization | | jensonseo0 -
Scripts question
My question is whether search engines will crawl the page before or after scripts run on the page. I have a H1 that will be replaced with a canvas by jquery script. Will search engines see the H1 or the canvas?
On-Page Optimization | | lojdqvist0 -
Advice on why page isn't being indexed in google top 1000 for keyword
Hi, http://www.cgcomposites.com.au/composite-material.html This page isn't listed for keywords 'composite material' It has been live for a few weeks and gets grade A report for onpage optimisation? regards Michael
On-Page Optimization | | bluelilyseo0 -
Page Analysis on our asp.net site is showing the following for HTML Text - //
paintball-online.com This is consistent on every page, despite these pages having text. I assume the SEOMoz tool is working just fine and we have a coding issue that may be hindering our SEO efforts. Any ideas/suggestions? Thanks
On-Page Optimization | | Istoresinc0