350 (Out the 750) Internal Links Listed by Webmaster Tools Dynamically Generated-Best to Remove?
-
Greetings MOZ Community:
When visitors enter real estate search parameters in our commercial real estate web site, the parameters are somehow getting indexed as internal links in Google Webmaster Tools. About half are 700 internal links are derived from these dynamic URLs.
It seems to me that these dynamic alphanumeric URL links would dilute the value of the remaining static links.
Are the dynamic URLs a major issue? Are they high priority to remove?
The dynamic URLs look like this:
These URLs do not show up when a SITE: URL search is done on Google!
-
I believe your problem is in your robots.txt file. You're attempting a wildcard blocking of the search results pages with this line:
Disallow: /listings/search**?***
However, the asterisk ought to precede the question mark. If you want to block all URLs that include a question mark (?), do this:
Disallow: /listings/search***?**
Try that and see what happens. I've also found Aaron Wall's article on robots.txt to be helpful. Good luck!
Also, adding "noindex, nofollow" to the section does not necessarily keep a web page out of Google's index. When you think about it, you realize Google has to crawl the page the see that meta tag in the first place. Robots.txt is much stronger.
-
Hi Dennis:
The pages that display these search results are set to no-index, no-follow. They do not get indexed by Google in search results, just somehow register as about 200 links in internal links in Google Webmaster Tools.
How would I get these removed as links if they are no getting indexed by Google as pages? If I did get them removed is there a way of getting these links from being re-indexed?
I have attached an image of what these internal links look like in Google Webmaster Tools.
Thanks, Alan
-
I have seen both sides of the coin, some get affected, most don't.
I prefer to clean it up though and make sure those can't get indexed. I do this as part of our onpage SEO standards. We dont proceed until it's dealt with so it's a high priority.
It's cleaner, gets crawled easily and more efficient. Doesn't hurt
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
URL Errors in webmaster tools to pages that don't exist?
Hello, for sometime now we have URLs showing up in Google webmaster saying these are 404 errors but don't exist on our website.......but also never have? Heres an example cosmetic-dentistry/28yearold-southport-dentist-wins-best-young-dentist-award/801530293 The root being this goo.gl/vi4N4F Really confused about this? We have recently made our website wordpress? Thanks Ade
Intermediate & Advanced SEO | | popcreativeltd0 -
Internal links to preferential pages
Hi all, I have question about internal linking and canonical tags. I'm working on an ecommerce website which has migrated platform (shopify to magento) and the website design has been updated to a whole new look. Due to the switch to magento, the developers have managed to change the internal linking structure to product pages. The old set up was that category pages (on urls domain.com/collections/brand-name) for each brand would link to products via the following url format: domain.com/products/product-name . This product url was the preferential version that duplicate product pages generated by shopify would have their canonical tags pointing to. This set up was working fine. Now what's happened is that the category pages have been changed to link to products via dynamically generated urls based on the user journey. So products are now linked to via the following urls: domain.com/collection/brand-name/product-name . These new product pages have canonical tags pointing back to the original preferential urls (domain.com/products/product-name). But this means that the preferential URLs for products are now NOT linked to anywhere on the website apart from within canonical tags and within the website's sitemap. I'm correct in thinking that this definitely isn't a good thing, right? I've actually noticed Google starting to index the non-preferential versions of the product pages in addition to the preferential versions, so it looks like Google perhaps is ignoring the canonical tags as there are so many internal links pointing to non-preferential pages, and no on-site links to the actual preferential pages? I've recommended to the developers that they change this back to how it was, where the preferential product pages (domain.com/products/product-name) were linked to from collection pages. I just would like clarification from the Moz community that this is the right call to make? Since the migration to the new website & platform we've seen a decrease in search traffic, despite all redirects being set up. So I feel that technical issues like this can't be doing the website any favours at all. If anyone could help out and let me know if what I suggested is correct then that would be excellent. Thank you!
Intermediate & Advanced SEO | | Guy_OTS0 -
Value in .EDU Link When Listed on Internship Offered Page
My company is looking to hire an Intern and a university - ".edu" - has including the job description on a page with list of "Available Internship", which includes a list of 100 other companies looking for an Intern. Our profile includes a link to our homepage like all other listings. Question: do we know search engines will give zero value to such link as they can tell it is an Internship posting page or is there a good chance it will actually be quite a valuable link?
Intermediate & Advanced SEO | | khi50 -
Link-building best SEO practice (one-off VS periodic blogging)
Hi all, Generally, what would be best when building a website's ranking through link building? Having the same links from the same bloggers or receiving new links from different bloggers every time? A lot of the SEO services offer 4-8 blog backlinks per month. Would it be best if these links came from different sources every time or most from the same sources each month? I know there's a lot of factors but I hope this question is clear. Happy holidays and thank you for your insightful feedback. Carlos
Intermediate & Advanced SEO | | 90miLLA0 -
Help needed for a 53 Page Internal Website Structure & Internal Linking
Hey all... I'm designing the structure for a website that has 53 pages. Can you take a look at the attached diagram and see if the website structure is ok? On the attached diagram I have numbered the pages from 1 to 53, with 1 being the most important home page - 2,3,4,5, being the next 4 important pages - 6,7,8... 15,16,17 being the 3rd set of important pages, and 18,19,20..... 51,52,53 being the last set of pages which are the easiest to rank. I have two questions: Is the website structure for this correct? I have made sure that all pages on the website are reachable. Considering the home page, and page number 2,3,4,5 are the most important pages - I am linking out to these pages from the the last set of pages (18,29,20...51,52,53). There are 36 pages in the last set - and out of this 36, from 24 of them I am linking back to home page and page number 2,3,4,5. The remaining 8 pages of the 36 will link back to pages 6,7,8...15,16,17. In total the most importnat page will have the following number of internal incoming links: Home Page : 25 Pages 2,3,4,5 : 25 Pages 6,7,8...15,16,17 : 4 Pages 18,19,20...51,52,53 : 1 Is this ok considering home page, and pages 2,3,4,5 are the most important? Or do you think I should divide and give more internal links to the other pages also? If you can share any inputs or suggestions to how I can improve this it will greatly help me. Also if you know any references for good guides to internal linking of websites greater that 50 pages please share them in the answers. Thank you all! Regards, P.S - The URL for the image is at http://imgur.com/XqaK4
Intermediate & Advanced SEO | | arjun.rajkumar810 -
Internal linking between categories
Is it necessary to do internal links between the same categories of a website ( Let's say Ihave a category about shoes and in the category I have a page about boots and one about sandals ( should the page boots be accessible from the page sandals and the other way round or is the back button going back to the section shoes enough ) ? If internal links between the same category ( sandals to boots ) are needed/recommended is it also a good practice to do site wide links between categories ( shoes and and bags for example ) Because by reading google recommendations "Make a site with a clear hierarchy and text links. Every page should be reachable from at least one static text link" I am not sure if they are talking about breadcrumbs or text links i am kind of lost ... Thank you,
Intermediate & Advanced SEO | | seoanalytics0 -
Best linking practice for international domains
SEOMoz team, I am wondering that in the days of Panda and Penguin SEOs have an opinion on how to best link between international domains for a web page property. Let's say you have brandname.DE (German site) brandname.FR (French site) brandname.CO.UK (British site) Right now we are linking form each site on the page to the other two language sites to make users aware of the translated version of the site which obviously make it a site wide link which seems to be lately disencouraged by Google. Did anyone out there have any ideas how to strategically interlink between international domains that represent language versions of a web site? /PP
Intermediate & Advanced SEO | | tomypro0
