Google Index/Cashe questions
-
I have 15k+ pages. I have 4.5k pages indexed.
What relation is the google cashe to indexing pages? My site gets cashed every two days. The competition in my SERP goes 2-3weeks to get cashed. What does this indicate? Is your cashe date your last google crawl?
How can I get google to crawl my site? Is there a way I can get google to crawl my site starting from an internal page. This way I could set up a better linking structure that would benefit from doing activities that get that page indexed to help get my site indexed more thoroughly...
-
I guess I might try that. I was concerned 40-50 links on an internal page (very internal = No PR) would kill that page and any chance of the internal pages ranking.
-
Yes, you have a good take on it JML. I too would love to hear what others have to say about this.
Have you thought about putting a "View All" option (link) on your listings pages? This could make it possible for both users and Google bot to access all of the listings without having to deal with the latency inherent with paginated pages. (Googe's own research has shown that users prefer scrolling through lots of content instead of having to move from one page to another....just a thought).
-
So if I can get google to come to an interior page, how deep will it dig. Perhaps I need to figure out how many times can I call google per month, then have that many interior pages that have a significant number of links that lead to additional static pages (each link) that are linked out as well.
Like a pyramid. Google enters Interior Page (A). It's a static page (wordpress) that links 99 links that all link to 99 pages that link to 99 pages. Google would go about three in? I could get more indexed like this.
My page is linked well. It's dynamic content (real estate listings) that have hubs set up. There is a lot of pagination which is what I think google stops at. It enters subdivision "X" and there are 10 listings per page, paginated. There are 300 listings in that subdivision. I don't think google is going too far in to that subdivisions listings page. I need to understand google indexing better.
I invite more participants. Thank you Dana. I need more info all Help!
-
Yes, you can get Google to crawl your site starting from an interior page using "Fetch as Googlebot" which is available as an item in the left hand navigation menu is Google Webmaster tools. After entering the URL of the page click on "Submit to Index" and then a box will open that gives the choice of submitting just that URL or submitting the URL plus all linking pages. Choose that second option. You can only do this a limited number of times a month so be judicious about which ones you submit this way.
As far as cache date, convention wisdom is that the more recent your cache date, the better. What this means is that Google is actually crawling your site more often. A cache date of 3 weeks or more happens when Google has come to your site or page many times but rarely finds any new content. WHen that's the case, google bot visits less frequently. Because Google values fresh content, it's better to have a newer cache date and to have google bot visiting more frequently.
I would be a little bit concerned that you have 15K pages and only 4.5K indexed. That ratio seems low to me. This might be an indication that google bot is having trouble crawling your entire site. Also, how new is your site? Is it a few months old or a few years old? Google bot crawls new sites more frequently, simply because they are new content. Over time, depending on how often your content is edited, updated or new content is posted, the crawl schedule will change.
I know this is only a partial answer to your question. But hopefully it provides a little insight.
Dana
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Ad server not indexed
Hello guys, My client is using an ad server (not sure if i am allowed to tell which one so I will not for now) installed at ads.clientsite.com. It is using noindex, nofollow for preventing Google to index it but also it is blocking like 90 000 other pages on clientsite.com to be indexed/crawled. The guy that applied the noindex tag it is no longer here so I cannot ask him about the logic behind those noindex tags. How big could be the damage to clientsite.com if I will remove the noindex tag from the ad server (ads.clientsite.com? If needed I can PM you the ad server platform we are using, Regards, Ed
On-Page Optimization | | Noriel1 -
Optimizing a URL/menu structure
Hi Mozzers, I'm working on Content Strategy at my job, and I'm close to making some recommendations on short/long-term direction. While I'm there, I want to tackle the URL/menu structure (correct term?), which is a bit of a mess as pages have been created without any consideration for it over time. For ease, let's just say we have 3 main subdirectories of the site (Section A-C), and let's also say that section A also has 3 important subdirectories. From a UX perspective at least, we want a page to look like: example.com/sectionA/subsectionAA/page1 but currently it's example.com/page1 We have dozens and dozens of these examples. To complicate matters a little further, Sections B and C have been earmarked to be consolidated into a new section (D), as they're currently confusing and overlapping, and create roadblocks in user journeys. So a page that is, say: example.com/sectionB/page2 may well want to be: example.com/sectionD/subsectionDA/page2 I'm comfortable enough with technically doing this, as I'm experienced enough in Drupal and have an agency on hand too, BUT - I don't know if there are any SEO pitfalls I need to be wary of when I'm doing this, beyond resubmitting sitemaps, and the trickle-down effects of redirects. Any advice, wise forum? thanks!
On-Page Optimization | | joberts0 -
Blog Site Set-Up/Frequency
Hello! I am a new blogger that is just getting started. All I have done so far is purchase a domain name and signed up with Blue Host. From what I am reading, WordPress seems to be the most recommended plug-in to get going. There is a lot of material out there on SEO and I wanted the community's thoughts on where to start. My blog is intended to provide readers with information on a particular topic. It is a vast area with much to write about - I intend on populating the content myself/with the help of experts in the field. It is not news so it is not time sensitive. Here are my questions: 1. As this is a brand new site, should I be blogging every day or is couple of times a week sufficient? I am able to produce content fairly quickly in the beginning as there is a lot to write about. Should I write a whole lot of content first and then release it on a schedule (twice a week, daily, etc.)? As it is a new site, I don't want it to launch with just one article.. 2. I am taking a WordPress class next week, but as someone that is not too familiar with copy/backlinks, other mechanisms to boost SEO. does WordPress make it easy enough to optimize your site for search results or does it require more expertise? As far as I see, my first tasks are to 1. ) set up the site effectively so people can find it and 2.) create valuable/engaging content. Appreciate any advice on setting up the site, blogging frequency, other tips to get going. I don't want to launch a site and get dinged by Google for reasons I am unware of..At some point, when I have a robust set of content, I am thinking of FB advertising to increase traffic to the site. Seems a bit premature to do that at this point.. Thanks all in advance for your feedback!
On-Page Optimization | | mmprakash0 -
Why are my pages de-indexed?
<form id="form-t3_37nfib9dz" class="usertext" action="http://www.reddit.com/r/SEO/comments/37nfib/why_were_my_pages_deindexed/#"> Hello all, I am very new to SEO. For some reason many of the pages on my site were de-indexed. Specifically the ones linked from this page: However other pages, like the ones linked from this page and this page were not de-indexed. http://www.lawyerconnection.ca/practice-areas/car-accident-injury-lawyers/[1] However the pages linked from this page were not de-indexed: http://www.lawyerconnection.ca/practice-areas/slip-and-fall-lawyers/[2] http://www.lawyerconnection.ca/podcastresources/[3] That first page itself was not de-indexed, just the site that it links to. It just happened today, so maybe I am jumping the gun but I doubt it. When I enter the page into google webmaster tools again and press fetch, one of the child pages, it re-indexes. What could be the problem here? I had someone re-write the content for every city but I have a feeling that there is less differences in the car accidents pages? Is this considered duplicated content do you think? Am I making some other mistake I can't think of? Is it just a one day blip (I doubt it) Let me know, thanks. </form>
On-Page Optimization | | RafeTLouis0 -
Google vs. Bing
We are having some really good results with our SEO strategies for local search and long tail searches for our clients on Google; however, Bing is a completely different story in a couple of cases. What is Bing looking for that Google is not? We have even noticed that something may rank well in Bing then not show up at all in Google? Any help would be greatly appreciated.
On-Page Optimization | | Strategexe0 -
Branded keyword domain not appearing in Google
Hi, I have a site called www.emv-cards.com but the site has a very poor showing on Google for the search term 'emv cards' and this does not make sense to me. It has position #6 on Bing but is not in Google's top 50. Any assistance would be appreciated. regards, George.
On-Page Optimization | | sirgeorge0 -
Question about URLs
Hello! I have a client that wants to upload an URL like this: www.example.com/keyword/page-name.html The main problem is that www.example.com/keyword/ doesn't exist and gives a 404 error so I'd prefer not doing that...... What do you think about this? And if the client wants to go ahead, is there any solution? A 301 to the final page would help? Thank you in advance!
On-Page Optimization | | Juandbbam0 -
Strange Keywords Google Webmaster Tools
Hey, I have a website about "coffee machines". Since a few months I added a vBulletin forum with vbSEO installed. The keywords Google found before I added the forum where highly related to the topic of my website (e.g. "coffee", "machine" etc), which I checked through the webmaster tools. However, I recently checked again and noticed that Google finds mostly keywords like "post", "forum", "thread", "share" etc. with high significance. Those "keywords" only appear on the forum. Now I'm a bit worried since Google states "These should reflect the subject matter of your site." Any advice how to solve that issue? Thanks!
On-Page Optimization | | netminds0