Why are some of page indexed and others not
-
I have created a site structure like this:
domain/for-sale/brand
domain/for-sale/brand-model
domain/for-sale/brand-model/pg1
domain/for-sale/brand-model/pg2
domain/for-sale/brand-model/pg3 etc....
I cannot understand why the domain/for-sale/brand-model does not seem to be indexed, yet the domain/for-sale/brand-model/pg6 is?
This is a new site, but I cannot understand why this URL would be indexed without the others...
Any ideas?
My home pages has links to the domain/for-sale/brand, this page has links to domain/for-sale/brand-model1, domain/for-sale/brand-model2 etc, each of these pages have links to domain/for-sale/brand-model/pg1, domain/for-sale/brand-model/pg2 etc...
-
When you're sure the page/ pages is/are accessible (no noindex )
and there is unique, text on the pages
and your pagerank >0
Google will index the page sooner or later. A good backlink or some social media posts can help.
-
Think you have to throw a sitemap up and do some social bookmarking and just wait. I know its infuriating esp if you've worked on site that index the same day.
-
I have search for the actual URL and it is not coming up in google.
I have submitted a site map including all URLs in WMT
Any similar pages that were there before have been 301'd
-
Have you tried to search for a term on one of those not listed pages? Perhaps they are just far back in the search result?
Did you try to submit the url with WMT to have it indexed faster?
Do you have any old urls you can do 301 redirects from to the new not listed pages?
Did you as Kevin suggested submit a sitemap?
-
It is an old site that just has a new design and structure. There are lots of search terms for these pages. I just don't understand why page 6 of search results would be indexed when page 1, 2, 3... are not.
-
Google f.e. will not crawl every page of your site. In fact, they may become aware of pages that they choose not to crawl because they are not likely to be important enough to return in a search result. Beacuse you have a new site, you need time and backlinks. If your content is unique, and when you get some strong relevant backlinks, more pages will be indexed soon.
-
Did you add a sitemap? If you do have a sitemap with these pages (and if everything is correct) give it some time.
If the pages are dynamically generated, and no links to these pages, the bots will not find them (or at least not very easily).
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Building a new page: What on-page SEO would you build in?
Hi all, Building a new page for a fairly competitive keyword. Need to make sure the on-page SEO is pretty top notch, because link building (including internal links) will be difficult. I've optimised the meta description, the alt tags and image names, and included the keyword in the Title Tags. Not a great deal I can do with regards to optimising for mobile or considering migrating to the AMP project because this is handled externally. What else would you suggest? Cheers in advance, Rhys
On-Page Optimization | | SwanseaMedicine1 -
Google Indexing
Hi, We recently launched a new version of our site on the Magento platform. I submitted a new sitemap and on the first crawl only 7 pages out of 132 were indexed...a few days later and we now have 107 indexed (phew). My question is this....how on earth do i find out which pages are indexed and more importantly not indexed? For all i know they might be really important ones so I need to be able to identify the missing pages so i can work on getting them indexed. Nic
On-Page Optimization | | nicc19760 -
Duplicate Page Content for Product Pages
Hello, We have one website which URL is http://www.bannerbuzz.com & we have many product pages which having duplicate page content issue in SEOMOZ which are below. http://www.bannerbuzz.com/backlit-banners-1.html
On-Page Optimization | | CommercePundit
http://www.bannerbuzz.com/backlit-banners-10.html
http://www.bannerbuzz.com/backlit-banners-11.html
http://www.bannerbuzz.com/backlit-banners-12.html
http://www.bannerbuzz.com/backlit-banners-13.html We haven't any content on these pages, still getting duplicate page content errors for all pages in SEOMOZ. Please help me how can i fix this issue. Thanks,0 -
Autogenerated pages
My main product is database conversion software. As it supports tons of databases, it's fairly easy to generate thousands of landing pages simply by variating source/target database names, connection information etc. In fact, I autogenerated almost 25k pages that way. As I didn't want to jeopardize my main site, I placed all that content to a new microsite (www.fullconvert.com) which had no history and no inbound links. Results were nice - site is live two months and in second month already had 1300 visitors. Now, my question is - should I create the same thing on my (old and rather authoritative) main site www.spectralcore.com? I could use a different template to avoid duplicate content. Of course, my main concern is being penalized by Google. In my opinion, this autogenerated content is fine because it provides (tons of) laser-focused landing pages, so visitors will instantly recognize they found what they're looking for. But Google might disagree! What do you think? Is there a danger in trying to leverage authority of my main site in adding 20k+ autogenerated pages with inbound no links to them?
On-Page Optimization | | metadata0 -
No Index help
Hi, I have alot of notices about webpages that are apparently blocked by no index robots, I look through the code on the site and cannot see any coding for this and am confused how to fix the problem. Help anyone?
On-Page Optimization | | Vetshopgroup0 -
Spammy keywords on a page
My client's website has a box of text on each page that is spammy and horrible to read and stuffed with keywords. The text boxes are there only for search engines as they mean nothing to humans. I say remove them as it must be doing more harm than good. However, my client is scared to remove them as the text has been there on each page for ten years and he is worried about a drop in visitor numbers if they are removed. Is he right to be worried?
On-Page Optimization | | mascotmike0 -
Do we need to use the canonical tag on non-indexed pages?
Hi there I have been working in / learning SEO for just over a year, coming from a non dev background, so there are still plenty of the finer points on-page points I am working on. Slowly building up confidence and knowledge with the great SEOMoz as a reference! We are working on this site http://www.preciseuk.co.uk (we are still tweaking the tags and content by the way- not finished yet!) Because a lot of the information is within accordians, a page is generated for each tab of the accordian expanded, for example: http://www.preciseuk.co.uk/facilities-management.php is the main page but then you also have: http://www.preciseuk.co.uk/facilities-management.php?tab=0 http://www.preciseuk.co.uk/facilities-management.php?tab=1 http://www.preciseuk.co.uk/facilities-management.php?tab=2 http://www.preciseuk.co.uk/facilities-management.php?tab=3 http://www.preciseuk.co.uk/facilities-management.php?tab=4 http://www.preciseuk.co.uk/facilities-management.php?tab=5 All of which are in the same file. According to the crawl test, these pages are not indexed. Because it is all in one file, should we add the canonical tag to it, so that this is replicated in all the tab pages that are generated? eg. Thanks in advance for your help! Liz OneResult
On-Page Optimization | | oneresult
liz@oneresult.co.uk2