Best Way to check for duplicate pages
-
With Google's updates we know they want to clean out duplicate content. i have been seeing the same crap spit out even word for word on different sites. Anyway how do you experienced SEO people test for dups on your own site as well as other sites. The only thing i can come up with is paying copyscape 5 cts a test. There has to be other ways. Advise/
-
Well there's the rub. Close key words...
avoid an audit
avoid a tax audit
avoid audit
all get hits from the rankings data. they bring up different pages as top ranking because different sites and pages rank differently based on the key word optimization.
Now I have the experience to know that in the past a good well developed linking structure will overcome this and you actually can rank for several variations by having a good topical silo structure. I am sometimes surprised what my main page ranks for just because a term is on the page! Content dominating the page does get hits.
BUT...competition is getting crazy in my industry. Sales companies are ranking and then selling the leads.I'm not just competing with similar businesses anymore. It seems like as long as I can vary the content, and i really can, because I have over 30 years in the business and more experience than anyone i know , so i can write varied content all day long!
As for the page, we don't use flash or anything. Had over 100 links on many pages so some changes had to be made.
Tell me more about an easier path to trend instead of doing pages for slight variations. Long term phrases don't seem to get many hits in my business. At least I don't think it's worth doing pages for till we knock off the shorter ones we have a chance of ranking for, which includes the three listed above.
-
Thanks, so then 5ct a test will add up but then it will be worth it. That's the feedback i was looking for, just wanted to make sure i wasn't missing another cheaper service that was as good.
-
Hey Joe
I think you have likely answered your own question to some extent - there are lots of manual ways to check for duplicate content by searching for it. You could even automate this against new sites by setting up Google Alerts to check for various random search strings in double quotes from all the pages across your site but why do this when there are professional solutions like copyscape?
Sure, there is a charge involved with copyscape and such tools but it is a fairly low. Alteratively, you will have to spend more time (money) coming up with a manual solution that will likely be less comprehensive.
A client of mine recently got hit quite badly by duplicate problems, some internal repetition (chunks on multiple pages) & loads of other sites had taken chunks of text from multiple pages, some entire pages had been copied with small edits. The offshoot of this was nearly 3 months without rankings whilst we identified and resolved the issue and being an internet company this was nearly three months without any new orders coming in.
If your have concerns about being caught up in a duplicate filter & this could have a series impact on your business then copyscape is a solid investment.
Hope it helps
Marcus
-
Does your situation benefit from having higher content pages that rank for your target keyword plus variables and long term additions? If so that might be an easier path to tread than something like page 1: kitten, page 2: kittens, page 3: young kittens...
If you're really looking into cranking out the content you're more along the lines of a eHow or other Demand Media property and then yes, you'd need a program to prevent duplication of both content created and keywords targeted. Still, even they get variable content by avoiding overly similar topics.
Finally, if header, footer, and side bar info is complicating things too drastically you could take steps on some pages to keep it unindexed via flash, image map, or by minimizing where applicable.
-
Thanks, I am aware of those things. I still don't want to worry about duplicate content. i have many pages that have similar key words that i can rank for, and I have to write them. I also have a lot of header and side bar info and need my content long enough to overcome that. Writing many pages that focus on similar key words can cause me to inadvertantly write similar info that i need to watch out for. that's why i need a copyscape type program.
-
You can search for long quote, supposedly unique phrases in Google. If you find multiple pages from other domains you'll have located duplicate content. Duplicate content isn't a death knell though as Google understands that there are many sites out there which scrape and farm content. With enough authority you should outrank those sorts of sites and also be able to highlight your original content status in Google Webmaster tools.
If you have copyright status to your content you can always pursue DMCA removal requests.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Keyword ranking for different page than the page optimized
I have optimized "equipment trailer for rent" on this page: http://www.bigtrailerrentals.com/flatbed-trailer-rentals/equipment-deckover. I'm wondering if anyone can tell me why Google has chosen to rank the keyword phrase for this page: http://www.bigtrailerrentals.com/flatbed-trailer-rentals/equipment-24 This is just one example. It has happened on several of my pages / keywords.
On-Page Optimization | | BigTrailerRentals0 -
Press Page Best Practices?
Hey Mozzers! I have a question that I haven't found a perfect answer to yet. The company I work for has built a press/awards/news article page and I'm trying to determine the best format to showcase the information in. (You can take a look at the page here: https://www.webpt.com/about/press Should I have our team copy and paste the press releases onto our site and rel canonical that post to the original article? Or would it be better to just have a short intro paragraph and then have a read full story link at the bottom of that paragraph. Final question--should I make these pages noindex, nofollow? Looking forward to hearing everyone's answers!
On-Page Optimization | | WebPT0 -
Numerous duplicate destination URLs from within one menu - potential impact for on-page SEO?
Hello all What is your evaluation in regards to a number of links (different anchors) targeting the same destination URL from within one and the same menu (on the same website)? Keeping it brief: Think of a top menu drop down entry, that needs to feature the alphabet (each letter has it's own sub-entries). However, the actual letter itself is not represented by a page (it has no URL either). So far so good. However, when testing the menu on a mobile device, the letter entries are still treated, as if they were non-existent pages - thus throwing a 404 when clicked. In order to avoid people getting a 404 when clicking on any letter, it would be ideal, if they were directed to any main page (the same destination URL though). However, that would mean 26 times the same destination URL from within that menu. Is this approach potentially bad for SEO, hence there would be numerous duplicate destination URLs in place? Please mind, I am not inquiring for help on how to arrange the actual menu. I am concerned about the impact, identical destination URLs could have on the on-page SEO. Many thanks in advance for your help and input!
On-Page Optimization | | Hermski0 -
On page links
Hi I am really intrigued by Bloomberg strategy. if you look at their article pages they are full with internal links done with what I assume to be an automated process (too many pages to be done manually). it seems to work for them. I would love to hear your opinions.
On-Page Optimization | | ciznerguy
http://www.bloomberg.com/news/2014-11-26/uber-said-close-to-raising-funding-at-up-to-40b-value.html0 -
Does having landing page text beneath the products at the base of the page hinder SEO?
I have a site that is capable of hosting the landing page description either above the products under the H1 or below them at the bottom of the page before the footer. I have always chosen to keep the text "above the fold" as presumably this would be crawled sooner in relation to the rest of the page content than had it been at the bottom. However, this means that I can only really write just a few sentences for each landing page - otherwise the products would shift further down the page - and I don't think this is good from a UX POV. Question: If I move the bulk of my landing page descriptions to the text snippet located underneath the products, could this negatively affect my SEO? Text at the bottom of the page is obviously not significant for users, so is there a chance this could be seen as spam?
On-Page Optimization | | Silkstream0 -
Duplicate Content
Hi I am new to SEO and at the moment looking at warnings from the crawl diagnostics report. When I have looked at the content from the urls given I cant see anything obvious that relates to duplicate content. Whats the best way to find out the problem please?
On-Page Optimization | | Pauline080 -
Imiges on own page???
Can somebody help me to explain why when I click on an image in a post it goes to its own page?? And why if I click on other image it does not go anywhere?? this is one of the posts: http://villasdiani.com/beach-wedding-at-a-luxury-boutique-hotel/ what is good or bad?? On most of the images SEOmoz is reporting that I am missing meta description!
On-Page Optimization | | VillasDiani0 -
Checking Duplicate Content
Hi there, We are migrating to a new website, which we are writing lots of new content for the new website. The new website is hosted on a development site which is password protected and so on so that it cannot be indexed. What i would like to know is, how do i check for duplicate content issues out there on the world wide web with the dev site being password protected? Hope this makes sense. Kind Regards,
On-Page Optimization | | Paul780