Why will google not index my pages?
-
About 6 weeks ago we moved a subcategory out to becomne a main category using all the same content. We also removed 100's of old products and replaced these with new variation listings to remove duplicate content issues.
The problem is google will not index 12 critcal pages and our ranking have slumped for the keywords in the categories.
What can i do to entice google to index these pages?
-
In google webmaster tools the sitemaps report 14 urls in our category listings not indexed. However, I have had trouble identifying which urls it is
-
It looks like that page and the category pages have been indexed:-
site:towelsrus.co.uk/Towels/Hand-Towels/prodlist_ct472.htm
site:towelsrus.co.uk/Towels/Face-Cloths-And-Flannels/prodlist_ct471.htm
site:towelsrus.co.uk/Towels/catlist_fnct561.htmThe cache view of the above pages is the same as the current versions of the pages on your site.
Are you confusing pages not being indexed with pages not ranking?
-
Ok, I think the fatal mistake made is that these category pages are identical to those which it replaced and those origional pages I guess have not been removed from Googles Index.
How do I get out of this hole and get these critcal pages indexed? Would fetching as google bot do anything realistically?
-
You cant entice them.....you can make sure they get indexed properly.
Make sure they are being crawled and their are no errors on the page. (no duplicate title tags, etc.) You can do this with the campaign tool in SEOMOZ.
Make sure you build your site with a logical link structure as each page should be reachable from at least one static text link.
Make sure that your sitemap has them listed correctly.
Make sure they are original content and not duplicated somewhere else on the internet or on another of your sites.
This should get you in good shape. Hope this helps.
Mark
-
Fraser, one thing you can try (if you haven't already) is to use the "Fetch as Google" feature in webmaster tools.
Once you've entered the url of your page, and Google retrieves the data, you have the option to then submit that url to the index.
I've done this a couple of times and it seems to work - of course, Google might have been ready to index the pages anyway, but who knows!
-
Yes, there is 12 pages within this category. All category pages
-
Hi Fraser,
Do you have a link to one of the pages?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Client wants to remove mobile URLs from their sitemap to avoid indexing issues. However this will require SEVERAL billing hours. Is having both mobile/desktop URLs in a sitemap really that detrimental to search indexing?
We had an enterprise client ask to remove mobile URLs from their sitemaps. For their website both desktop & mobile URLs are combined into one sitemap. Their website has a mobile template (not a responsive website) and is configured properly via Google's "separate URL" guidelines. Our client is referencing a statement made from John Mueller that having both mobile & desktop sitemaps can be problematic for indexing. Here is the article https://www.seroundtable.com/google-mobile-sitemaps-20137.html
Intermediate & Advanced SEO | | RosemaryB
We would be happy to remove the mobile URLs from their sitemap. However this will unfortunately take several billing hours for our development team to implement and QA. This will end up costing our client a great deal of money when the task is completed. Is it worth it to remove the mobile URLs from their main website to be in adherence to John Mueller's advice? We don't believe these extra mobile URLs are harming their search indexing. However we can't find any sources to explain otherwise. Any advice would be appreciated. Thx.0 -
Robots.txt Disallowed Pages and Still Indexed
Alright, I am pretty sure I know the answer is "Nothing more I can do here." but I just wanted to double check. It relates to the robots.txt file and that pesky "A description for this result is not available because of this site's robots.txt". Typically people want the URL indexed and the normal Meta Description to be displayed but I don't want the link there at all. I purposefully am trying to robots that stuff outta there.
Intermediate & Advanced SEO | | DRSearchEngOpt
My question is, has anybody tried to get a page taken out of the Index and had this happen; URL still there but pesky robots.txt message for meta description? Were you able to get the URL to no longer show up or did you just live with this? Thanks folks, you are always great!0 -
How can a Page indexed without crawled?
Hey moz fans,
Intermediate & Advanced SEO | | atakala
In the google getting started guide it says **"
Note: **Pages may be indexed despite never having been crawled: the two processes are independent of each other. If enough information is available about a page, and the page is deemed relevant to users, search engine algorithms may decide to include it in the search results despite never having had access to the content directly. That said, there are simple mechanisms such as robots meta tags to make sure that pages are not indexed.
" How can it happen, I dont really get the point.
Thank you0 -
How do I know what pages of my site is not inedexed by google ?
Hi I my Google webmaster tools under Crawl->sitemaps it shows 1117 pages submitted but 619 has been indexed. Is there any way I can fined which pages are not indexed and why? it has been like this for a while. I also have a manual action (partial) message. "Unnatural links to your site--impacts links" and under affects says "Some incoming links" is that the reason Google does not index some of my pages? Thank you Sina
Intermediate & Advanced SEO | | SinaKashani0 -
Why my own page is not indexed for that keyword?
hi, I recently recreated the page www.zenucchi.it /ITA/poltrona-frau-brescia.html on the third level domain poltronafraubrescia.zenucchi.it by putting it on the home page. The first page is still indexed for the keyword poltrona frau brescia . But the new page is no indexed for that keyword and i don't know why ( even if the page is indexed in google ) .. I state that the new domain has the same autorithy and that i put a 301 redirect to pass his authority to the new one that has many more incoming links that did not have previous .. i hope you'll help me thanks a lot
Intermediate & Advanced SEO | | guidoboem0 -
It Doesn’t Matter Where You Point Links, Google Will Pick The Page
Hi Guys, I have a site that ranks quite well in a very competitive vertical and the company is now planning to do a site relaunch. SEO is very important to them and all of the sites within in the top 10 have the primary keyword in the urls example search: key1 key2 site.com/key1-key2/
Intermediate & Advanced SEO | | VividLime
site.com/ key1key2/
site.com/key1key2.php Our site is the only one that is positioned within the top 10 without the keyword in the url and homepage only listing so the top 10 result looks like search: key1 key2 site.com/key1-key2/ site.com/ key1key2/ site.com/key1key2.php oursite.com sitekey2.com/key1-key2/
key1site.com/key1key2.html Currently we do not have a separate landing page for the target keyword hence why link building is focused on the homepage. As part of the consultation, I recommended we create a landing page for our primary keyword so we get **oursite.com/key1-key2/ **and shift the on-page keyword balance towards this page. the hope is, we get search: key1 key2 site.com/key1-key2/ site.com/ key1key2/ site.com/key1key2.php oursite.com/key1-key2 sitekey2.com/key1-key2/
key1site.com/key1key2.html Would Google simply replace my current domain only list for the most relevant url for a term? Does anyone have any experience with this? Or would i need to build links into the new url for the change to take place. what i'm hoping for and expecting, is for somthing like this to happen http://www.seowizz.net/2011/04/it-doesnt-matter-where-you-point-links-google-will-pick-the-page.html0 -
My page has fallen off the face of the earth on Google. What happened?
I have checked all of the usual things. My page has not lost any links or authority. It is not black listed or any other obvious sign. What's going on? This has just happened within the past 3 days.
Intermediate & Advanced SEO | | Tormz0 -
We are changing ?page= dynamic url's to /page/ static urls. Will this hurt the progress we have made with the pages using dynamic addresses?
Question about changing url from dynamic to static to improve SEO but concern about hurting progress made so far.
Intermediate & Advanced SEO | | h3counsel0