Help finding website content scraping
-
Hi,
I need a tool to help me review sites that are plagiarising / directly copying content from my site. But tools that I'm aware, such as Copyscape, appear to work with individual URLs and not a root domain. That's great if you have a particular post or page you want to check. But in this case, some sites are scraping 1000s of product pages. So I need to submit the root domain rather than an individual URL.
In some cases, other sites are being listed in SERPs above or even instead of our site for product search terms. But so far I have stumbled across this, rather than proactively researched offending sites.
So I want to insert my root domain & then for the tool to review all my internal site pages before providing information on other domains where an individual page has a certain amount of duplicated copy. Working in the same way as Moz crawls the site for internal duplicate pages - I need a list of duplicate content by domain & URL, externally that I can then contact the offending sites to request they remove the content and send to Google as evidence, if they don't.
Any help would be gratefully appreciated.
Terry
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Multiple Websites Under Single Brand
My company has many websites having similar content . They are into the retail business and sell manufactured homes. Since they sell different manufacturer homes products having different specification in different states that's why they have created many websites. Will duplicate design and similar content on some of the pages across multiple website will cause issues in Google ranking.
White Hat / Black Hat SEO | | christmaslaserlights0 -
How to find trustful seo specialist?
How to find trustful seo specialist if you don't know about SEO a lot?
White Hat / Black Hat SEO | | DigiVital1 -
How do you check if a website has a link network (From the same C Class)
Hello Mozzers, I'm conducting a link audit and I see a red flag for one of my guest blogs i did in 2012. let's say the IP of the website was 62.658.62.9 Little did I know that the blogging website is a link network with the same content on each IP via it's specific C class: 62.658.62.9 62.658.62.10 62.658.62.11 ETC... How does one find a website to blog on and check to see if they have a blog network or better yet, see if there is a similar distinction of duplicate sites based on its C-class?
White Hat / Black Hat SEO | | Shawn1240 -
Website starts ranking on Google then always drops - Targeted for Australia but most traffic from U.S - Bounce Rate at 94.49% - HELP!
Hi everyone, Thank you for your time. During the past 8 months I have been working on this website which is a .com.au . I have fully optimised the website which is targeting Brisbane in Australia and I have setup everything (Sitemaps, Geo location on WMT, Fetched as Google etc..) However the website just does not want to rank at all. I know that the previous SEO company were not too good but since then I have disavowed all unnatural links, we have moved the hosting to a new company and the website content has been updated. Only recently the Website has started ranking for it's brand name (not even in top of Google) and whenever a keyword starts ranking above the Top 50 of Google it suddenly drops again. The other issues is that even if I have setup the website to target Australia the majority of traffic comes from the U.S. Last month out of the 127 Session - 85 from United States - 29 from Australia - 3 Brazil - 2 India - 2 Italy - 1 Canada etc... Because of this the website has a Bounce rate of 95%. If you would have any advice, tips or recommendations that I could do to try and fix this it would be much appreciated. I suppose we can consider this as some kind of penalisation - potentially due to the past work and issues that occurred before the business became our client but I am not sure what more I can do to stop the wrong traffic and improve the rankings. Thanks for your help. Lyam
White Hat / Black Hat SEO | | AlphaDigital20 -
Rel author and duplicate content
I have a question if a page who a im the only author, my web will duplicate content with the blog posts and the author post as they are the same. ¿what is your suggestion in that case? thanks
White Hat / Black Hat SEO | | maestrosonrisas0 -
NEED HELP, Figuring Out Ranking Drop!
Hello, I need help from somebody, anybody, in trying to figure out why my site dropped so much for the keyword “wildblue” and “wild blue”. On the week of Feb. 13, 2012, my website jumped from middle of the first page to the fourth page, and then a week or two later jumped completely out of the index (or at least off the top 5 pages). We do not engage in any deceptive practices. Our entire website is centered around this keyword, and we are very relevant, and have informative and continually updated content for visitors. I thought at first we got hit by Panda, but our overall organic traffic has not decreased, it has actually been steadily increasing compared to same time last year. I have tried over the past several months to get us back up, or at least figure out what happened, with no luck. If anyone could advise me on what might have happened, how to correct it, or even has any ideas of how I could figure out what happened I would greatly appreciate it. Website is: http://www.mybluedish.com
White Hat / Black Hat SEO | | MyNet0 -
My Google PR is Decreasing HELP!
We have just started in on an SEO campaign after a year or so break from engaging in active SEO efforts. Our rankings and organic traffic seems to be increasing but we just dropped from a PR 5 to a PR 4 after being a PR 5 for probably a couple years. We are not doing anything black hat or sketchy and try hard to make sure all of our links are relevant and quality links. Does anyone know why this might have happened or if it is an indication of anything?
White Hat / Black Hat SEO | | MyNet0 -
When to give up on a website with a Google penalty?
I recently had a Google 60 penalty hit my website. The main two issues were that I had a person helping me with SEO and they bought some links. The second issue is that I own about 90 URL's in the my vertical. I created about 60 one page sites for these keyword targeted domains. I then linked these sites to main site. Big mistake! I kept these URL's all on the same server as my main site. In October 2010 I noticed my site hits dropped dramatically. I started looking for the issue. I didn't know which issue caused the penalty. I fixed both issues in November 2010 and asked Google for reconsideration in early December 2010. I kept link building for my site by finding quality links.I was extremely honest with Google. I gave them all of the domains I own and I told them the name of the person that bought links for me and the websites where those links were placed. As of late February 2011 a Google search for my domain still showed up in approximately the 64th position. I recently asked Google again to lift the penalty. I basically told them that I fixed all of my issues that led to the penalty and let them know I have been waiting for almost 3 months. I told them I have put the past 2 years of my life into this website and begged them to forgive me. I also asked them to let me know if my site was never going to be forgiven? I got the typical canned response from the Google team. As of today the penalty is still in effect. I just want to know when you should give up on a site. I have spent about $20,000 on this site and about 2 years of hard work. I don't want to give up, but I don't want to keep putting my hard work and time into the site if it will never escape the dreaded Google penalty. Do you think I should continue to wait and if so how long? Anything else I can do to persuade Google to release me from this penalty hell? If I do abandon the site and start from scratch what steps should I take? Do I need a new server? What if any content can I take from my current site and transfer to the new site? If I can how do I do this without getting another penalty or lose the credit for the original content. I created about 2,000 pages of original content for this site. I'd love to be able to transfer this content if I have to start from scratch. Any ideas or detailed help plans would be greatly appreciated.
White Hat / Black Hat SEO | | tadden0