How to find an internal link that is generating a duplicate
-
Hello Mozers
Can anybody help me. It's a bit OCD, but, I really want to find the internal links within a clients site that are generating duplicate urls.
I did start looking page by page using search, but got a bit stir crazy!
I'm sure one of you smart SEO's will have a simple, clever solution:)
Thanks
Catherine
-
My problem is that I do have the referrer, it's an internal page, often the page that is creating the duplicate content. I keep searching for links that are generating the discrepancies and can't find them.
I've run a report using xenu, but now I've got even more wood (can't see the wood for the trees).
Can you recommend any good resources for using xenu?
That would be a big help!
Thanks Catherine
-
I've just submitted one.
Thank you Brian
Catherine
-
Thanks Alex
Two very sensible suggestions, thanks. I just got myself in a loop!
Ta
-
It's not OCD, it's good practice!
If the duplicate has been indexed, you could try using the link: operator with the URL in Google search.
Do you have Xenu Link Sleuth? If not it's free, and don't worry if it looks dodgy, it is kosher. You could crawl the whole site with Xenu. Once the crawl is complete right-click on the URLs you have as duplicate content and it'll show the pages that link to it.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Malicious Link
Hello all, We're doing an adwords campaign, and Google has said that there is a malicious link on the website we're looking to advertise - so cannot launch the campaign. I've tried to go through Search Console (I am a novice BTW). And it says that "Domain properties are not supported at this time". Which I don't understand. Any advice please?!
Technical SEO | | PartisanMCR0 -
ViewState and Duplicate Content
Our site keeps getting duplicated content flagged as an issue... however, the pages being grouped together have very little in common on-page. One area which does seem to recur across them is the ViewState. There's a minimum of 150 lines across the ones we've investigated. Could this be causing the reports?
Technical SEO | | RobLev0 -
Internal Link Rank Flow
I've read in many articles that pages can "pass" rank to other pages internally. Is anyone aware of any well done internal linking case studies which confirm this? If my homepage has the strongest Page Authority, would linking to another page deeper into my website from my homepage boost my rank for the deeper page in Google (more so than linking to the deep page from a page with lower page authority)?
Technical SEO | | poke10 -
Correct linking to the /index of a site and subfolders: what's the best practice? link to: domain.com/ or domain.com/index.html ?
Dear all, starting with my .htaccess file: RewriteEngine On
Technical SEO | | inlinear
RewriteCond %{HTTP_HOST} ^www.inlinear.com$ [NC]
RewriteRule ^(.*)$ http://inlinear.com/$1 [R=301,L] RewriteCond %{THE_REQUEST} ^./index.html
RewriteRule ^(.)index.html$ http://inlinear.com/ [R=301,L] 1. I redirect all URL-requests with www. to the non www-version...
2. all requests with "index.html" will be redirected to "domain.com/" My questions are: A) When linking from a page to my frontpage (home) the best practice is?: "http://domain.com/" the best and NOT: "http://domain.com/index.php" B) When linking to the index of a subfolder "http://domain.com/products/index.php" I should link also to: "http://domain.com/products/" and not put also the index.php..., right? C) When I define the canonical ULR, should I also define it just: "http://domain.com/products/" or in this case I should link to the definite file: "http://domain.com/products**/index.php**" Is A) B) the best practice? and C) ? Thanks for all replies! 🙂
Holger0 -
Ratio of linking C-blocks to Linking domains
Hi, Our linkbuilding efforts have resulted in acquiring a high number of backlinks from domains within a C-block. We all know Google issues penalties whenever someone's link profile looks unnatural. A high number of backlinks but a low number of linking C-blocks would seem to be one of reasons to get penalized. Example: we have 6,000 links from 200 linking root domains coming in from 100 C-blocks. At what point should we start to worry about being penalized/giving off an unnatural look to mr G?
Technical SEO | | waidohuy0 -
Dealing with duplicate content
Manufacturer product website (product.com) has an associated direct online store (buyproduct.com). the online store has much duplicate content such as product detail pages and key article pages such as technical/scientific data is duplicated on both sites. What are some ways to lessen the duplicate content here? product.com ranks #1 for several key keywords so penalties can't be too bad and buyproduct.com is moving its way up the SERPS for similar terms. Ideally I'd like to combine the sites into one, but not in the budget right away. Any thoughts?
Technical SEO | | Timmmmy0 -
Duplicate page error
SEO Moz gives me an duplicate page error as my homepage www.monteverdetours.com is the same as www.monteverdetours.com/index is this actually en error? And is google penalizing me for this?
Technical SEO | | Llanero0 -
No inbound links. Should I link-build or create new content?
I have a PR4 site with good traffic but the blog is not very popular--the posts do not generate any backlinks and hardly get any traffic. Yet, I continue to kick out a new post every week. Site: http://www.stadriemblems.com/
Technical SEO | | UnderRugSwept
Blog: http://www.stadriemblems.com/blog/ I keep posting content so that Google keeps crawling the site and viewing it as fresh (and yes, I'm posting for my human visitors' benefit too!), but I'm wondering if eventually this will hurt more than help if Google detects all these new pages are not being linked to, and therefore starts viewing the site as low quality and devalues it. So should I: Keep posting Stop posting and build links to the posts Try to promote my blog to get more traffic and hope people link to it Something else or some combination of the above0