Scraper Advice
-
Hi all,
I know we all deal with scraped content issues. I have one I could use advice on. I found a site that is posting our blog content on their site verbatim, including the links I added to the posts (which is good) and mention our blog home page in a right sidebar beside the content (also good). However, they aren't linking to the specific posts from their copied versions anywhere and their pages canonical back to their versions, not mine.
It's not a very spammy site and has a decent domain authority (though significantly lower than our own). I did a long tail search related to one of posts after discovering it, however, and found their version was outranking the original. I know I can report this one via Webmaster Tools.
I wanted to get your opinion on whether asking them to add a link back to the original post on our site might be sufficient, or do I need to ask for that plus a canonical tag update? I know getting both is ideal, but the links and relationship could be valuable, so I want to leave this particular bridge in tact if I can.
Just trying to decide if I take an "either/or" approach to my request when I mention those two action items, or if I need be a little firmer and ask them to do both and potentially risk losing a potential outlet for future content?
Thanks,
Andrew
-
Don't second-guess on that myth that scrapers can't hurt you. These guys are outranking you right now with your own content. Proof enough to me that Kissmetrics needs to take notice and pull down false information. Also, this is another clear example of Google not knowing how poorly their systsem is working and they know not that they know not.
Google would not be getting millions of DMCAs per week if they were right about this. I've sent them hundreds.
-
Normally, I'd take that harder approach as well. If this was a spammy site that was doing nothing but scraping, I'd definitely be going that route. I still might. I'm trying to see the best way to walk a fine line.
I think #2 on Kissmetrics' 3 Myths About Duplicate Content has me second-guessing myself. If it wasn't a somewhat decent site that has potential to help in terms of referral traffic, it would be a no-brainer.
For the outranking issue, it's weird. For the main term we target, we are top 3 in the SERPs. Change it a little bit and they're ranking, which is the only instance of that I found when testing all posts (5 total).
Thanks for the feedback. I really appreciate it.
-
What you do on your first step will set the tone for how they treat you in the future. So, if you are too liberal now, it will be hard to reign them in and they could start grabbing everything that you own.
If this was my site being grabbed, I would be contacting them to take the content down and be prepared to follow up with an attorney who is already in place for this type of situation, being ready to submit DMCA to Google, Adsense, hosting and more.
If you feel that the relationship could be valuable and have a different philosophy than mine, then I would at minimum insist on the rel=canonical pointing back to the source of the content on my website - and I would require them to ask before they use anything in the future. The fact that they are outranking you with your own content should have you shaking in your boots over this potential relationship. You are making deals with Goliath.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Redirects Advice
We have many redirects in place - and sometimes 2 in a chain. Is there a recommended time you should have a redirect in place?
Technical SEO | | Caroline_Ardmoor0 -
noindex, follow for thin content advice
Hello there We struggle with a number of none indexed pages. I want to ask your professional opinion. The robots tag is set up as follows, <meta name='robots' content='noindex, follow' /> those pages haven`t got any value but contain valuable pages.
Technical SEO | | Kingagogomarketing
Is setting up robots name="robots" content="noindex, nofollow" / would be a good solution? Here is the page https://www.lrbconsulting.co.uk/tag/enforcement/page/2/
with noindex robot tag. Please let me know what you think. #noindex, follow for thin content
#noindex, follow
#meta robots set up0 -
Deleting Tags Properly - Advice Needed
I have over 18,000 tags. Needless to say, most of them are relatively useless to the user and generate no traffic, while cluttering the site. (I use Wordpress.) My plan is to delete tags, but I want to do so safely as to not accumulate website errors. (Tags pages are noindexed.) What process should I take here? Here was my basic plan (any help is appreciated). 1. Find irrelevant tags that are connected with hardly any posts. 2. Go into the post, and remove said tag. 3. Now, with a tag having a 'count' of 0, I go into Tags, and delete it. Safe, right? But now it seems those tag pages just turned into 404s "Uh-oh...Page not found!" Where do I go from here? Create 410's? Thanks Mike
Technical SEO | | naturalsociety0 -
Removing images from site and Image Sitemap SEO advice
Hello again, I have received an update request where they want me to remove images from this site (as of now its a bunch of thumbnails) current page design: http://1stimpressions.com/portfolio/car-wraps/ and turn it into a new design which utilized a slider (such as this): http://1stimpressions.com/portfolio/ They don't want the thumbnails on the page anymore. My question is since my site has a image sitemap that has been indexed will removing all the images hurt my SEO greatly? What would the recommended steps to take to reduce any SEO damage be, if so? Thank you again for your help, always great and very helpful feedback! 🙂 cheers!
Technical SEO | | allstatetransmission0 -
CMS on autopilot is happily creating duplicate pages - advice?
Hi, our ecommerce CMS (Magento) is creating a bunch of pages with very little content and no user value like this: http://goo.gl/UU2vl This particular example is the by product of a product filtering page, which has the format www.mywebsite/explore/index/loaddata/id/10/. These pages have no content other than images - also the pages don't have page titles and are therefore being flagged in webmaster tools as requiring HTML improvements We also have CMS auto generated pages like this: www.mysite.comhttp/review/product/list/id/7 where the page is effectively a duplicate of the product page, and this is giving us pages being flagged by webmastertools as having duplicate title tags. Should we exclude these two type of page via robots.txt or take another approach, like not worry about them 🙂 many thanks, any help gratefully received.
Technical SEO | | w1ll1am0 -
Need advice on having customer stores running on my subdomain
We have an online store product and we're working on the SEO for our new domain (foo.com in this example.) Our customers have the ability to change the domain of their store but many of them will likely stick with the subdomains we give them (store1.foo.com) We could potentially have thousands of stores soon using our subdomain. Each of these stores will have a very small link at the bottom to our own domain but other than this, the content is completely user-generated and not under our control. Are there risks/problems associated with this type of strategy? If so, could we perhaps avoid them by using robots.txt to block entire site until they change to their own domain? TIA, Sean
Technical SEO | | schof0 -
Advice on promoting a blog
Hi i am working on a new blog and would like to know if there are any sites where i can publish part of the new blog to gain traffic to my main blog. What i am looking at is, to publish part of a news story and then have people come to my main site after reading some of the new story. I have come across accidentally a couple over a year ago but cannot locate them now. I want people to be able to come to my site and read the whole story and then hopefully tell their friends. Also can anyone recommend decent social bookmarking sites that have a do follow on them to promote my blog please.
Technical SEO | | ClaireH-1848860 -
SEO advice when making a mobile site
Hi there, I'm current working on a site that is optimized for SEO and doing quite well in the rankings. We have noticed a big increase in mobile users to the site (mainly iOS and Android), so we have no started planning a mobile site as well. Do you guys have any recommendations we should keep in mind before we get started? One thing I'm still not sure of is whether we should aim to preserve all urls and cloak the pages (show mobile version to iOS and Android, and desktop version to everyone else) OR make a separate site for the mobile version (mobile.domain.com)? Would either solution affect the other? Regards,
Technical SEO | | KennethDreyer
Kenneth0