Best Way to check for duplicate pages
-
With Google's updates we know they want to clean out duplicate content. i have been seeing the same crap spit out even word for word on different sites. Anyway how do you experienced SEO people test for dups on your own site as well as other sites. The only thing i can come up with is paying copyscape 5 cts a test. There has to be other ways. Advise/
-
Well there's the rub. Close key words...
avoid an audit
avoid a tax audit
avoid audit
all get hits from the rankings data. they bring up different pages as top ranking because different sites and pages rank differently based on the key word optimization.
Now I have the experience to know that in the past a good well developed linking structure will overcome this and you actually can rank for several variations by having a good topical silo structure. I am sometimes surprised what my main page ranks for just because a term is on the page! Content dominating the page does get hits.
BUT...competition is getting crazy in my industry. Sales companies are ranking and then selling the leads.I'm not just competing with similar businesses anymore. It seems like as long as I can vary the content, and i really can, because I have over 30 years in the business and more experience than anyone i know , so i can write varied content all day long!
As for the page, we don't use flash or anything. Had over 100 links on many pages so some changes had to be made.
Tell me more about an easier path to trend instead of doing pages for slight variations. Long term phrases don't seem to get many hits in my business. At least I don't think it's worth doing pages for till we knock off the shorter ones we have a chance of ranking for, which includes the three listed above.
-
Thanks, so then 5ct a test will add up but then it will be worth it. That's the feedback i was looking for, just wanted to make sure i wasn't missing another cheaper service that was as good.
-
Hey Joe
I think you have likely answered your own question to some extent - there are lots of manual ways to check for duplicate content by searching for it. You could even automate this against new sites by setting up Google Alerts to check for various random search strings in double quotes from all the pages across your site but why do this when there are professional solutions like copyscape?
Sure, there is a charge involved with copyscape and such tools but it is a fairly low. Alteratively, you will have to spend more time (money) coming up with a manual solution that will likely be less comprehensive.
A client of mine recently got hit quite badly by duplicate problems, some internal repetition (chunks on multiple pages) & loads of other sites had taken chunks of text from multiple pages, some entire pages had been copied with small edits. The offshoot of this was nearly 3 months without rankings whilst we identified and resolved the issue and being an internet company this was nearly three months without any new orders coming in.
If your have concerns about being caught up in a duplicate filter & this could have a series impact on your business then copyscape is a solid investment.
Hope it helps
Marcus
-
Does your situation benefit from having higher content pages that rank for your target keyword plus variables and long term additions? If so that might be an easier path to tread than something like page 1: kitten, page 2: kittens, page 3: young kittens...
If you're really looking into cranking out the content you're more along the lines of a eHow or other Demand Media property and then yes, you'd need a program to prevent duplication of both content created and keywords targeted. Still, even they get variable content by avoiding overly similar topics.
Finally, if header, footer, and side bar info is complicating things too drastically you could take steps on some pages to keep it unindexed via flash, image map, or by minimizing where applicable.
-
Thanks, I am aware of those things. I still don't want to worry about duplicate content. i have many pages that have similar key words that i can rank for, and I have to write them. I also have a lot of header and side bar info and need my content long enough to overcome that. Writing many pages that focus on similar key words can cause me to inadvertantly write similar info that i need to watch out for. that's why i need a copyscape type program.
-
You can search for long quote, supposedly unique phrases in Google. If you find multiple pages from other domains you'll have located duplicate content. Duplicate content isn't a death knell though as Google understands that there are many sites out there which scrape and farm content. With enough authority you should outrank those sorts of sites and also be able to highlight your original content status in Google Webmaster tools.
If you have copyright status to your content you can always pursue DMCA removal requests.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicating words in the page title OK?
Im finding a site with lots of duplicated words in the title tags, I have always avoided doing this in the past, Is there any penalty for having a word repeated twice in the title, indeed is there a benefit from having it twice, IM assuming not
On-Page Optimization | | Donsimong
For example: Marketing Services in Milton Keynes | Our Services | TFA
https://www.t-f-a.co.uk/services the word service is repeated twice, in my opinion this is of no benefit at all and is better rewritten to remove the duplication1 -
Duplicate Content
When I say duplicate content, I don't mean that the content on a clients site is displaying on another site on the web or taken from a site on the web. A client has a few product pages and each product page has content on the bottom of the page (4-5 paragraphs) describing the product. Now, this content is also displaying on other pages, but re-worded so it's not 100% duplicate. Some pages show a duplicate content % ranging from 12% to 35% and maybe 40%. Just curious if I should suggest having each product page less than 10% duplicated. Thanks for your help.
On-Page Optimization | | Kdruckenbrod0 -
Will it upset Google if I aggregate product page reviews up into a product category page?
We have reviews on our product pages and we are considering averaging those reviews out and putting them on specific category pages in order for the average product ratings to be displayed in search results. Each averaged category review would be only for the products within it's category, and all reviews are from users of the site, no 3rd party reviews. For example, averaging the reviews from all of our boxes products pages, and listing that average review on the boxes category page. My question is, will this be doing anything wrong in the eyes of Google, and if so how so? -Derick
On-Page Optimization | | Deluxe0 -
Does a / at the end of a URL create a duplicate page?
Hello, I have just used (the amazing) Screaming Frog to check my site and it is listing the two following pages as having duplicate titles, making me think it is seeing them as duplicate pages. http://zenplugs.com/zenplugs-molded-earphones/ http://zenplugs.com/zenplugs-molded-earphones Do I need to redirect one of these? Thanks in advance! Toby
On-Page Optimization | | T0BY0 -
Duplicate content issue
Hello, I got duplicate content issue on my home page : examplesite.com
On-Page Optimization | | digitalkiddie
examplesite.com/index.html Those page urls are with duplicate content. If in index.html i use 301 redirect like that : Header( "HTTP/1.1 301 Moved Permanently" );
Header( "Location: http://examplesite.com" );
?> would i loose any page authority ? sorry for the newbie question0 -
Are these considered duplicates?
http://www.domain.com/blog/sample-blog-post/#more-0001 http://www.domain.com/blog/sample-blog-post/ The first URL is coming from a "click here" hyperlink from the excerpt of the 2nd URL in my homepage. Thanks in advance!
On-Page Optimization | | esiow20130 -
Does Too Many On-Page Links on a Page Really Matters?
Does Too Many On-Page Links on a Page Really Matters? Especially if they are pointing to internal page?
On-Page Optimization | | AppleCapitalGroup1 -
Web Page Refresh
Hi there, we redesign our Website, changing it for a jquery based version. This new design is much more usable and nice for our users, however the average page views for user decreased a lot. Basically this is due to the fact that once the user is logged in, it spends most of the time in the same Web form which is updated through jquery without refreshing it. We were thinking about adding a meta refresh tag, or ad some javascript for getting this task done in order to get the relation page views/visitor increased. Do you think refreshing the page every 4 minutes could be penalized by Google (or other Search engines) ? Which should be the interval between refresh ? Would it be better to make it very explicit (i.e. adding a meta refresh tag) or using a kind of hide javascript ? We want to increase the pageviews but of course, we don't want to get penalized
On-Page Optimization | | martincad0