How to detect where Google gets indexed URL's
-
Google index some kind of way some links that create duplicate content. We doesn't understand how these are created so we would like detect where Google robots find these links.
We tried:
- Moz Crawl Diagnostics but it shows 0 as Internal Link Count for these kind of links.
- Find some information from Google Analytics, that maybe there is trace (site content - all content) from visitors side. There wan't.
- We tried to find some information in Webmaster Tools under Internal link and HTML Improvements but didn't find any trace.
- Tried some search commands. Is there maybe some good one to search.
- TO search URL's form code with https://search.nerdydata.com.
-
It really isn't possible for an outsider to know why your website is generating those URLs in error; you would have to talk to your developer about that.
As far as canonicals, if your problem is page.com is getting duplicated by added parameters: page.com/?id=1, page.com/?id=2, page.com/?id=3, etc. as long as you have the canonical on page.com, all of the parameter pages will have the correct canonical on them as well. (But you are right, you should track down the source; your developer will know.)
-
Thanks you for your answer but yes I know that these are generated by our site. But problem is that I can use canonical tag for these that are indexed right now but later new ones will be created someway. Problem root isn't that we doesn't know how to use canonical, it's how to get to know where these URL's are find/indexed/detected by Google.
These kind of URL's have been there for months so we can't just hope that somehow these will be droped. We need to find some kind of solution and detect real problem.
-
If you found those URLs by doing a site: search, then those parameters are being generated by your site. (I am surprised that Google is even indexing them; I assume that pretty soon all but one will be dropped.) Here is an article that explains more about those types of duplicate pages: http://moz.com/blog/which-page-is-canonical
You can fix this by using a canonical tag on your homepage with the version that doesn't have the parameter.
-
Our front page has almost 50 duplicate versions. These are shown when we do site:oursite.com, there are /et?id=xx, /et?productId=xx, etc. In URL xx are different numbers.
-
Where are you seeing these duplicate content links? Does Webmaster Tools say that they are duplicate content? Or does this show up in your Moz crawl? What do these URLs look like?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Newer iteration of Avinash Kaushik's Web 2.0
Greetings all! Does anyone know if there is a more recent, but comparable, book that covers the topic of analytics like Avinash Kaushik's Web Analytics 2.0: The Art of Online Accountability and Science of Customer Centricity or Brian Clifton's Advanced Web Metrics with Google Analytics, 2nd Edition? These were published in 2009 & 2010. I know the core concepts remain the same, but the technology has improved greatly.
Reporting & Analytics | | AfroSEO0 -
Google analytcics sub domain dot or not?
Buongiorno from 16 degrees C wetherby UK famous for the Wetherby Whaler Chippy 😉 OK... on this site http://www.philpotts.co.uk/ I've set up sub domain tracking as so:
Reporting & Analytics | | Nightwing
Parent site:
http://www.philpotts.co.uk/ Sub domain
http://shop.philpotts.co.uk/ So my question is please: should a dot be placed in the sub domain line as in : _gaq.push(['_setDomainName', '.philpotts.co.uk']); Some advice places a dot in setDomainName other advice doesnt 😞
Any insights welcome, Grazie,David0 -
Google not reading my canonical links
Hi All, New to SEOmoz but so far love it. My reports list tons of duplicate links and webmaster tools does as well. In fact it just updated last night and added several hundred more. I have the canonical tag on my products. Here is a product example page: http://www.stonehousecollection.com/card/funny-christmas-cards/KX296a.html Thank you for the help. Matt
Reporting & Analytics | | mker0 -
Did I get penalized by Panda 3.9?
Hey guys, So I have been on Google analytics and I looked at Traffic Sources > Search Engine Optimization > Queries & Landing Pages From Tuesday until today I am showing 0 impressions for top queries when we usually average around 9000 impressions daily, I am seeing the same for landing pages. When I go into google webmaster tools I am seeing 0 data from tues-today. It doesnt say that I have 0 impressions, it is just not showing me those dates, almost like I am unable to see data that is so close to today. The weird thing is that traffic to the sites in question is higher or normal to what it has been the whole month which makes me think that this is some sort of glitch. If we are being penalized and indeed have 0 impressions via search then our traffic would drop tremendously. When I sign out of google and search for our search terms, I am seeing our site pop up right where they should be. When I use the Page Rank tool I am also seeing us in the SERPS where we should be. Wed morning when I came into work after SEOmoz had an updated keyword rank report, I saw some great gains for a lot of our keywords. I am super confused and hoping that I was not part of the 1% affected. There is no reason for our sites to be penalized, they have great authority, healthy traffic, and go by SEO best practices. We have great content! Has anybody ever ran into this problem? Could use some guidance!
Reporting & Analytics | | PatBausemer0 -
Advanced segements Google Analytics
Hi guys, I was to hasty last time marking the given question as answered. So i would like to ask another question on the subject. My original question was how to get a pdf report of 10 specific keywords with information about visits,pages per view. avg, visit time, new visitors and bounce rate. The answer was to create an advanced segment with "or operators" and adding all keywords on an exact match basis. I did this but it still gives me a list of more then 500 keywords in traffic sources organic view. Next to that i get different visitor numbers for some keywords where it says 40 at the normal segments (all visits) but gives me 0 when i turn on the advanced segment. I've been clicking and changing things for a long time until i got almost dizzy. Could someone plz help?
Reporting & Analytics | | 5MMedia0 -
Not ranking in Google.com
I put up my last site on the web since a month. So far I have been optimizing mainly to Hungary and I got used to that my content was indexed in a day and if content was good it sometimes appeared in the first two pages in a couple of days. Now with my new site I am targeting google.com. I put it up since a week, sent the sitemap to google, it was intresting for mee te see that even the pages to get into the web index needed two days. Seomoz says my site is all right besides some duplicate content issue i will solve soon. So it is past a week and even if I copy a complete sentence from the beginning of my home page and paste it into google my site does not appear. I also purchased couple of backlins but they have not appeared so far as well. Is that really this slow? Am I to impatient? Or should there be something else problem I should be looking for? Thanks for any feedback
Reporting & Analytics | | sesertin0 -
Google Analytice for Shopping Results
We are trying to optimise for Google Shopping and therefore would like to be able to monitor traffic to site from this source? How can this be done in Google Analytics? Thanks
Reporting & Analytics | | seanmccauley0
