Getting pages indexed by Google
-
Hi SEOMoz,
I relaunched a site back in February of this year (www.uniquip.com) with about 1 million URL's.
Right now I'm seeing that Google is not going past 110k indexed URL's (based on sitemaps).
Do you have any tips on what I can do to make the site more likeable by Google and get more indexed URL's?
All the the part pages can be browsed to by going to: http://www.uniquip.com/product-line-card/suppliers/sw-a/p-1
I've tried to make the content as unique as possible by adding random testimonials and random "related part numbers" see here: http://www.uniquip.com/id/246172/electronic-components/infineon/microcontrollers-mcu/sabc161pilfca
Do I need to wait more time and be more patient with Google? It just seems like I'm only getting a few thousand URL's per day at the most.
Would it help me if I implemented a breadcrumb on all part pages?
Thanks,
-Carlos
-
Carlos
Actually, it is in the index but if you do: site:www.uniquip.com as a search in Google it is not the first result, which it should be. If you do "site:www.uniquip.com" (with the quotes) as a search in Google, it is still only the second result, it should be the first, which is a sign that something is weird, which would require some more investigation.
-Dan
-
Thanks for both tips Dan, I will look into them althought number 2 may be a bit tough.... since there are hundreds of suppliers/categories (bit tough to put in a menu).
as for the page not being indexed I'm showing that it is. http://webcache.googleusercontent.com/search?sourceid=navclient-ff&ie=UTF-8&q=cache%3Ahttp%3A%2F%2Fwww.uniquip.com%2F
is this not the case for you?
-
Thanks for the feedback Brent.
I already my sitemaps setup in groups of 30k with a master sitemap file. http://www.uniquip.com/sm/smindex.xml
I will talk to the developer so we can look into regrouping them and perhaps pickup an indexing pattern.
-
Hi Carlos
It appears there are two major issues with your site not getting indexed.
1. Off-Site - Go to opensiteexplorer and type in your URL. You will see there are many suspicious looking links pointing back to your domain. No matter what you do on-site, if you have really low quality backlinks pointing to your domain (and no good ones to balance things out), nothing you do on-site will help. You'll want to do whatever you can to clean these up (get them removed). You'll also want to work on getting some GOOD backlinks in conjunction with cleaning out the bad ones. There are many resources here on SEOmoz on backlinking strategies.
2. On-site - Your product pages are 4 or more clicks away from the homepage. You really want this to be 3 or less (ideally 1 if possible for some products and categories).
I also noticed that your homepage does not appear to be indexed in Google.
We could go WAY more in depth with this, but in general those seem to be the two major issues.
-Dan
-
Carlos,
There is a great thread you should read about this topic: http://www.seomoz.org/q/can-you-push-too-many-urls-via-sitemaps
As for me, I would recommend creating multiple XML sitemaps where you can track which urls are bing indexed and to also control the submission quantity. You don't want to publish a ton of urls at one time. For the urls that aren't in Google's index, I would no index them for now and slowly submit a small group on a monthly basis, along with different XML sitemaps for tracking.
You have to think as if you were Google, is the content you're submitting valuable and new information? There is no way that 1 million new pages is so valuable or new that isn't already out there. A nice steady submission stream will give you the best results in the long run.
I hope this helps.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Combining products - edit existing product page or 301 redirect to new page?
We want to combine existing products - e.g. 'hand lotion' and 'body lotion' will become 'hand & body lotion'. As such, we'll need to combine the two product pages into one. What would be the best route to take in terms of SEO to do this? My initial reaction is to create a new product page and then 301 or 302 redirect the old products to the new product page depending on if the change is permanent or temporary. Would you agree? Or am I missing something?
On-Page Optimization | | SwankyApple1 -
Please review page for on page SEO
I'm working on an adult dating site review blog and am hoping to build links to the category pages. It's a wordpress blog so the posts are categorised by topics. However can you tell me if there is enough content on the page for google to identify what the page is about? The problem is that the content of each category pages is pulled from the posts. What I think is needed is some static text on the page 2-300 words that use the keyword. Here's an example of a page targeting the keywords 'online dating'. http://www.top-10-dating-reviews.com/category/online-dating/
On-Page Optimization | | SamCUK
[editor's note -- thumbnails on site may not be appropriate for some workplaces] Will the page rank like this if there are a good amount of authorative links or does the page itself need work?0 -
Does Archive pages help in indexation of the site?
Hello, we have an argue internally regarding if we should keep the archive pages on a news site or not. Pro Archive pages help indexation of the news. although not all of us are sure about this. Con archive pages receive from none to little traffic archive pages are source of duplicate content, duplicate titles - which we can manage some how but does it worth? What is your opinion on this topic, should we keep it or not? thanks, Irina
On-Page Optimization | | InformMedia0 -
What are the best practices for google indexing ajax response urls?
We just did a build to our site and our server erros went up to over 9,500. After looking into it, it seems like google is crawling the ajax urls and coming back with the errors. Here is one example http://www.rockymountainatvmc.com/productDetail.do?navType=type&vehicleId=1423&webTypeId=68&navTitle=Drive&webCatId=9&prodFamilyId=29660 If you know of any good articles on this please send them my way.
On-Page Optimization | | DoRM0 -
Main page deindexed by google.
3 days ago our main page('/') has stopped appear in google results. Rest of pages works fine. Even our main page from canadian version of site with similar content works fine. Some times canadian page appears for key word where we had our com version before. But I think this is just result of disappearing com version. Any suggestion were to look? Messages box in google webmastertools is empty. Could this be the question too long page title? PS: Does any way exist to check if we were punished by Google and reason of this? For Bing and Yahoo everything works fine. PPS: We have just found that "cache:our_site.com" and "info:our_site.com" returns in google our_site.ca. So this should be reason of problem. So now we are looking how to fix this.
On-Page Optimization | | ctam0 -
On-Page Report Card
How long will it take to see the results of changes made on my pages based on the On-Page Report Card recommendations? On-Page Report Card
On-Page Optimization | | sansonj0 -
If a site has https versions of every page, will the search engines view them as duplicate pages?
A client's site has HTTPS versions of every page for their site and it is possible to view both http and https versions of the page. Do the search engines view this as duplicate content?
On-Page Optimization | | harryholmes0070 -
Should one page with markers or six separate pages?
Hi - I'm working on a site that was set up with 6 bios on one page, with markers jumping to each person's name. I was thinking about separating those into 6 different pages, but not sure if that's the right thing to do. Advice about keeping the bios on one page vs splitting them up? (Am I more likely to rank for those peoples' names if I have a unique page, or is the one page url with each different marker in it, just as good?) Ranking well for those names isn't a huge goal of the site, but it would be nice to make the choice that would help with that rank. Thanks for your input Emma
On-Page Optimization | | emmas0