Best Way to check for duplicate pages
-
With Google's updates we know they want to clean out duplicate content. i have been seeing the same crap spit out even word for word on different sites. Anyway how do you experienced SEO people test for dups on your own site as well as other sites. The only thing i can come up with is paying copyscape 5 cts a test. There has to be other ways. Advise/
-
Well there's the rub. Close key words...
avoid an audit
avoid a tax audit
avoid audit
all get hits from the rankings data. they bring up different pages as top ranking because different sites and pages rank differently based on the key word optimization.
Now I have the experience to know that in the past a good well developed linking structure will overcome this and you actually can rank for several variations by having a good topical silo structure. I am sometimes surprised what my main page ranks for just because a term is on the page! Content dominating the page does get hits.
BUT...competition is getting crazy in my industry. Sales companies are ranking and then selling the leads.I'm not just competing with similar businesses anymore. It seems like as long as I can vary the content, and i really can, because I have over 30 years in the business and more experience than anyone i know , so i can write varied content all day long!
As for the page, we don't use flash or anything. Had over 100 links on many pages so some changes had to be made.
Tell me more about an easier path to trend instead of doing pages for slight variations. Long term phrases don't seem to get many hits in my business. At least I don't think it's worth doing pages for till we knock off the shorter ones we have a chance of ranking for, which includes the three listed above.
-
Thanks, so then 5ct a test will add up but then it will be worth it. That's the feedback i was looking for, just wanted to make sure i wasn't missing another cheaper service that was as good.
-
Hey Joe
I think you have likely answered your own question to some extent - there are lots of manual ways to check for duplicate content by searching for it. You could even automate this against new sites by setting up Google Alerts to check for various random search strings in double quotes from all the pages across your site but why do this when there are professional solutions like copyscape?
Sure, there is a charge involved with copyscape and such tools but it is a fairly low. Alteratively, you will have to spend more time (money) coming up with a manual solution that will likely be less comprehensive.
A client of mine recently got hit quite badly by duplicate problems, some internal repetition (chunks on multiple pages) & loads of other sites had taken chunks of text from multiple pages, some entire pages had been copied with small edits. The offshoot of this was nearly 3 months without rankings whilst we identified and resolved the issue and being an internet company this was nearly three months without any new orders coming in.
If your have concerns about being caught up in a duplicate filter & this could have a series impact on your business then copyscape is a solid investment.
Hope it helps
Marcus
-
Does your situation benefit from having higher content pages that rank for your target keyword plus variables and long term additions? If so that might be an easier path to tread than something like page 1: kitten, page 2: kittens, page 3: young kittens...
If you're really looking into cranking out the content you're more along the lines of a eHow or other Demand Media property and then yes, you'd need a program to prevent duplication of both content created and keywords targeted. Still, even they get variable content by avoiding overly similar topics.
Finally, if header, footer, and side bar info is complicating things too drastically you could take steps on some pages to keep it unindexed via flash, image map, or by minimizing where applicable.
-
Thanks, I am aware of those things. I still don't want to worry about duplicate content. i have many pages that have similar key words that i can rank for, and I have to write them. I also have a lot of header and side bar info and need my content long enough to overcome that. Writing many pages that focus on similar key words can cause me to inadvertantly write similar info that i need to watch out for. that's why i need a copyscape type program.
-
You can search for long quote, supposedly unique phrases in Google. If you find multiple pages from other domains you'll have located duplicate content. Duplicate content isn't a death knell though as Google understands that there are many sites out there which scrape and farm content. With enough authority you should outrank those sorts of sites and also be able to highlight your original content status in Google Webmaster tools.
If you have copyright status to your content you can always pursue DMCA removal requests.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Best practices for marking up product pages on eccomerce site (SEO noob)
After analyzing the code on various competitors eccomerce sites I wanted to seek advice on best practices for marking up individual product pages for keywords and descriptions. My competition is all over the map as far as utilizing keywords and descriptions, some have few keywords while others have many and vice versa for descriptions. What is the best method for marking up product pages on an eccomerce site for keywords and descriptions? In addition, is it okay to utilize the same keywords for multiple products that may be under the same category? or is this considered duplicate content? Thanks for the help, if you have any resources for SEO and eccomerce sites I would greatly appreciate the guidance best,Michelle & Blake
On-Page Optimization | | LeapOfBelief0 -
Duplicate Content
Part of a site I am working on, features many different bags in all thicknesses colors and sizes. I'm getting an error when some pages have different content like different thicknesses. The only differences between the pages are a single digit - but in trash bags that makes it a whole different product! I can't do a canonical because it's not the same. For example: http://www.plasticplace.net/index.php?file=productdetail&iprod_id=274 and http://www.plasticplace.net/index.php?file=productdetail&iprod_id=268 Any ideas?
On-Page Optimization | | EcomLkwd0 -
How to fix joomla duplicate page titles??
Hello, I have been using seomoz and sh404sef for almost a month now and can't seem to figure out my duplicate page title issue on my joomla site. I have changed everything I thought necessary but no luck. I have one page that I am trying to make dissapear from duplicate page title error and if I can figure it out i'm sure I can use same fix for the other 1,000 duplicate page titles being reported in my seomoz crawl report I have one link that I am working with sef url: http://www.mysite.com/contactus.html I have used sh404sef url manager and added page title, description and keywords to this link and for 3 weeks straight now it still shows that it is duplicate page title in my seomoz crawl report Is there something that I am missing somewhere or did i setup a bad campaign that is looking at wrong things on site? I 've attached image of my sh404sef settings for this link Thanks in advance screenshot1.jpg
On-Page Optimization | | 41global0 -
Opinions please on Duplicate page titles & too many on-page links warnings.-
Hello folks, I'm a total SEO newbe but totally enjoying
On-Page Optimization | | CSC
using SEOmoz to learn more. We have ecommerce sites and the 1st crawl flags – as appears typical too many on-page links. We display up to 20 products (each with three links!)
and I’m trying to push to have fewer but meeting resistance from colleagues.
We have links duplicated all over the site believing it eases navigation. My question is just how critical is the number of products displayed
and the resulting volume of links to SEO results? Also we currently have collections of products displayed
across several pages which of course have the same page title and this is flagged
as a duplication error. I wonder if product auto-scrolling help as this means only a certain number of products are displayed at one time on one page thus reducing links and the need for duplicate page titles? My superiors are resisting change (perhaps nervous of spoiling
what already works) and I need to know where to direct my persuasive powers! Many thanks in anticipation, Spence0 -
Meta Data definition for multiple pages. Potential duplicate content risk?
Hi all, One of our clients needs to redefine their meta title and description tags. They publish very similar information almost every day, so the structure they propose is the following: Structure 1: Type of Analysis + periodicity + data + brand name Examples 1: Monthly Market Analysis, 1/5/2012 - Brand Name Weekly Technical Analysis, 7/5/2012 - Brand Name Structure 2: Company Name + investment recommendation + periodicity Example 2: Iberdrola + investment recommendation (this text doesn't vary) + 2T12 (wich means 2012, 2nd trimestrer) Regarding meta description they want to follow a similar approach, replicating every time the same info with a slight variation for each publication. I'm afraid this may cause a duplicate content problem because of the resemblance of every "Market Analysis" done or every "Investment recommendation" done in the future. My initial suggestion for them is to define specific and unique meta data for each page, but this is not possible for them given the time it takes to do it for every page. Finally, I ask them to specify the data in each meta title of content published, in order to add something different each time and avoid duplicate content penalty. Will this be enough to avoid duplicate content issues? Thanks in advance for your help folks! Alex
On-Page Optimization | | elisainteractive0 -
My website is saying I have duplicate page content and page title. How do I fix it?
Hi, I created a website on webstarts.com. After I launched it then ran a scan through SEO it says I have duplicate page content and page title. The 2 pages it is reading are technically the same page. www.mobilemowermedicsinc.com and www.mobilemowermedicsinc.com/index . I am unsure how to get rid of on of these as it keeps saying this is an error in the SEO scan. Could someone please advise me of what to do from here. Thanks!
On-Page Optimization | | bcarp880 -
Page Rank
I had just made a 301 re-direct on one of our product pages which had a PR of 4, now that Google has indexed the new page, it's now got a PR of 0, i'm struggling to understand why this could be, i know that you may see a drop of 1, which has happened in the past, but this drop just does not make sense. Any ideas of why this could be? Kind Regards
On-Page Optimization | | Paul780