How to change URL of RSS Feed?
-
Hi,
There are some websites that keeps on scraping my content. I have blocked them already from accessing my website using .htaccess but they still get my content via RSS feed.
I have tried delaying the RSS feed but I think this affected google rankings. My question is, is there a way to change the URL of my RSS Feed?
From: http://www.mysite.com/feed to http://www.mysite.com/feed2
-
I think than you had better consider legal steps. If they have acces to your content from a third domain or ip they can also do that from a furth or fifth one. So no metter how many ips you will block, if they do know you feed address they can subscribe with a completely new one. In my opinion if this is the case than legal solution should be the best for you.Copyright your articles.
-
Hi Zsolt,
Unfortunately, the scrapers are smart enough to remove the links in the content that they copy. I don't know how they do it but even though my post has links and the h1 title is also a link, the are able to strip the url off.
-
Maybe one of the simplest solution is not blocking those sites to access your content. Make your h1 tag a link to the actual post. So if you have a post title post1 on the url domain.com/post1, the post1 heading on the top of the page should point to domain.com/post1. So if anybody steals your content than they will point back to the original content on your site, so of all copies your site will be he strongest one with the most links.
I would also place links in the content body pointing to my other pages, so anybody copying my content would be appriciated as they are giving handful of backlinks in return. I would also write a little info panel in the bottom: this atrticle was originaly posted on: www.domain.com and written by xy.com. Find similar articles here: domain.com/relatedposts.
In the mean time I would place a leagl statement that copying my content is all right, but just with the links included.
-
Hi Zsolt,
What might be the best solution to prevent the scrapers from stealing my content? Some examples of scrapers of my site are
and many more... I have tried blocking these sites in htaccess using both ip and domain name by the following code format:
Block by IP and Domain
order allow,deny
deny from 208.43.239.80
deny from hownews.infoBut though such code is already in the htaccess, they can still scrape my content. I know they are getting it from my RSS feed because when I put some code to delay my RSS Feed, they are not able to get my latest posts.
I hope you can help me find out on how to put a stop on this scrapers as they are really hurting my rankings. They even rank higher than my site which is the source of the original content.
Thanks in advance....
-
You have to cotact with your programmer to change the url for you, or in some cms systems you can do it in the backend.
What do you exactly mean by scraping? IF they steasl your content, than using a new url is not the best solution fo you.
Rss and rankings: rss usually contains the same information that is already available on your site on some url (not in all cases of course but usually). If that is the case than the feed only has negative affects on your rankings as it duplicates the content: the exact same text that you can find on domain.com/xy can be found on domain.com/feed/xy. So if that is the case you should not worry about your rankings.
If you change your url you should also redirect teh old one at the same time, if you do not do this than all of those who are yet subscribed will lose your feed, you do not want that. If you redirect, than anybody who knew the old url will get to the new one. I think it is pointless.
I would block the ip adresses i do not want to access my content. You could also try to apply legal stuff: say nobody is allowed to use your copys on their own sites. It is easy to find out if anybody does.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Doubts about the technical URL structure
Hello, first we had this structure Categorie: https://www.stoneart-design.de/armaturen/ Subcategory: https://www.stoneart-design.de/armaturen/waschtischarmaturen/ Oft i see this https://www.xxxxxxxx.de/badewelt/badmoebel/ But i have heard it has something to do with layers so google can index it better, is that true ? "Badewelt" is an extra layer ? So i thought maybe we can better change this to: https://www.stoneart-design.de/badewelt/armaturen/ https://www.stoneart-design.de/badewelt/armaturen/waschtischarmaturen/ and after seeing that i thought we can do it also like this so the keyword is on the left, and make instead "badewelt" just a "c" and put it on the back https://www.stoneart-design.de/armaturen/c/ https://www.stoneart-design.de/armaturen/waschtischarmaturen/c/ I dont understand it anymomre which is the best one, to me its seems to be the last one The reason was about this: this looks to me keyword stuffing: Attached picture Google indexed not the same time the same url, so i thougt with this we can solve it Also we can use only the word "whirlpools" in de main category and the subs only the type without "whirlpools" in text thanks Regards, Marcel SC9vi60
Technical SEO | | HolgerL0 -
Changing site URL structure
Hey everybody, I'm looking for a bit of advice. A few weeks ago Google sent me an email saying all pages with any text input on them need to switch to https for those pages. This is no problem, I was slowly switching the site to https anyway using a 301 redirect. However, my site also has a language subfolder in the url, mysite.com/en/ mysite.com/ru/ etc. Due to poor work on my part the translations of the site haven't been updated in a long time and lots of the pages are in english even on the russian version etc. So I'm thinking of just removing this url structure and just having mysite.com My plan is to 301 all requests to https and remove the language subfolder in the url at the same time. So far the https switching hasn't changed my rankings. Am I more at risk of losing my rankings by doing this? Thanks!
Technical SEO | | Ruhol0 -
Tool to Generate All the URLs on a Domain
Hi all, I've been using xml-sitemaps.com for a while to generate a list of all the URLs that exist on a domain. However, this tool only works for websites with under 500 URLs on a domain. The paid tool doesn't offer what we are looking for either. I'm hoping someone can help with a recommendation. We're looking for a tool that can: Crawl, and list, all the indexed URLs on a domain, including .pdf and .doc files (ideally in a .xls or .txt file) Crawl multiple domains with unlimited URLs (we have 5 websites with 500+ URLs on them) Seems pretty simple, but we haven't been able to find something that isn't tailored toward management of a single domain or that can crawl a huge volume of content.
Technical SEO | | timfrick0 -
Duplicate blog URLs in Magenton
On one my sites Moz is picking up 4483 duplicate content pages. The majority of these are from our blog and video sections on our site. We're using a URL shortener and it appears that some of the pages are the full version of the URL then the shortened version. However if you go to the full version you get redirected to the shorter one. So I would assume that the Moz crawler should get the same redirect? We're also getting pagination being shown as duplicate pages, which I would half expect, but the URLs Magento is creating are truly bizarre: e.g http://www.xxx.com/uk/blog/cat/view/identifier/news/page/news/index.php/alarms-doorbells/?p=2 Alarms and doorbells is one of our product categories, which is displayed in the LHN on the blog page but has nothing to do with the blog itself. On another site on the same Magento instance, with the same content (they're for two different regions) we're show as having 248 duplicate pages, again in the video and news section, but this is a completely different scale of issue. Has anyone else encountered issues like these? I'm probably going to put a noindex in place on these two sections until we can get a solution in place as we're completely unranked in google on this site. Thanks
Technical SEO | | ahyde0 -
Changing all titles
A new client of mine has a terrible Wordpress site with many issues and one of these is keyword stuffing, especially in the title. We all know how bad it is, but then what's the best way to remove the keywords in excess? They stuffed 4 keywords (average 3 terms per keyword) in the wordpress General Settings "Site Title", so all of them are included in the title, and there are 200 pages basically with the same, stuffed, title. I am pretty sure if I remove them, and put a unique keyword per page I would have a huge rank drop, but is there any way to minimize it? 2nd question: should I improove the on-page factors and wait for the rank drop/resume before starting a linkbuilding campaign? Thank you. DoMiSol
Technical SEO | | DoMiSoL0 -
Affiliate urls and duplicate content
Hi, What is the best way to get around having an affiliate program, and the affiliate links on your site showing as duplicate content?
Technical SEO | | Memoz0 -
Duplicate Content and URL Capitalization
I have multiple URLs that SEOMoz is reporting as duplicate content. The reason is that there are characters in the URL that may, or may not, be capitalized depending on user input. A couple examples are: www.househitz.com/Pennsylvania/Houses-for-sale www.househitz.com/Pennsylvania/houses-for-sale www.househitz.com/Pennsylvania/Houses-for-rent www.househitz.com/Pennsylvania/houses-for-rent There are currently thousands of instances of this on the site. Is this something I should spend effort to try and resolve (may not be minor effort), or should I just ignore it and move on?
Technical SEO | | Jom0 -
Are RSS Feeds deemed duplicate content?
If a website content management system includes built-in feeds of different categories that the client can choose from, does that endanger them of having duplicate content if their categories are the same as another client's feed? These feeds appear on templated home page designs by default. Just trying to figure out how big of an issue these feeds are in terms of duplicate content across clients' sites. Should I be concerned? Obviously, there's other content on the home page besides the feed and have not really seen negative effects, but could it be impacting results?
Technical SEO | | KyleNeuberger0