Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Best way to block spambots in htaccess

Reporting & Analytics

962

ijb last edited by

I would like to block Russian Federation, China and Ukraine spam as well as semalt and buttonsforwebsite. I have come up with the following code, what do you think?

For the countries:

BLOCK COUNTRY DOMAINS

RewriteCond %{HTTP_REFERER} .(ru|cn|ua)(/|$) [NC]
RewriteRule .* - [F]

And for buttons-for-website.com and semalt-semalt.com:

BLOCK REFERERS

RewriteCond %{HTTP_REFERER} (semalt|buttons) [NC]
RewriteRule .* - [F]

or should it be:

BLOCK USER AGENTS

RewriteCond %{HTTP_USER_AGENT} (semalt|buttons) [NC]
RewriteRule .* - [F]

Could I add (semalt|buttons|o-o-6-o-o|bestwebsitesawards|humanorightswatch) or is that too many?
1 Reply Last reply
Reply Quote 0
donford last edited by

Hi

I think you're on the right track.

A very good blog post by Jared Gardner has recently addressed this question on the Moz Blog.

Hope it helps,

Don
1 Reply Last reply
Reply Quote 1

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

Need advice on setting up primary domain and shopify site analytics to work best together

Hello, I have a client that I have been working on their primary site for the last year or so. In the last month they decided to have one of their internal employees setup a small shopify store. Now they are asking for the analytics tracking codes for it. My question for you is what would be the best way for me to set that up? variables: primary domain and shopify domain, google and bing analytics Have been looking at how cross domain tracking works (https://support.google.com/tagmanager/answer/6106951), and the instructions for setting up ecommerce in analytics for shopify (https://help.shopify.com/manual/reports-and-analytics/google-analytics/google-analytics-setup). But am still not 100% which route would be the best, any input would be greatly appreciated! thank you, Dustin
Reporting & Analytics | | pastedtoast

1
Best to Leave Toxic Links or Remove/Disovow on Site with Low Number of Linking Domains

Our site has only 87 referring domains (with at least 7,100 incoming links). LinkDetox has identified 29% of our back links as being toxic and 14% as being questionable. Virtually all of these links derive from spammy sites. We never received a manual penalty, but ever since the first Penguin penalty in 2012 our search volume and ranking has dropped with some uneven recover in the last 3 years. By removing/disavowing toxic links are we risking that over optimized link text will be removed and that ranking will suffer as a result? Are we potentially shooting ourselves in the foot? Would we be better to spend a few months building quality links from reputable domains before removing disavowing bad links? Or toxic links (as defined by LinkDetox) so bad that it should be a priority to remove them immediately before taking any other step? Thanks, Alan
Reporting & Analytics | | Kingalan1

0
Is there a way to find out who the admin of a Google Analytics account is?

We have a client who has been searching high and low to gain access to the GA account that is tied to their website, but previous agencies keep stating they don't have access. Is there a way to find out who the admins are on a GA account with the tracking number so we can reach out to that person and ask them to admin the client?
Reporting & Analytics | | marketingmediamanagement

0
Block IP from analytics

How can I block an ip from analytics? basically so I do not see test orders from a certain ip in the sales performance section? Thanks for any help.
Reporting & Analytics | | tdigital

0
Duplicate Title Errors on Product Category Pages - The best practice?

I'm getting quite a few 'Duplicate Title Error' on category pages which span over 2 - 3 pages. E.g. http://www.partwell.com/cutting-punches http://www.partwell.com/cutting-punches?page=1 http://www.partwell.com/cutting-punches?page=2 http://www.partwell.com/cutting-punches?page=3 All 4 pages currently have the same title... <title>Steel Cutting Punches</title> I was thinking of adding Page Numbers to the title of each corresponding page, thus making them all unique and clearing the Duplicate Page Title errors. E.g. <title>Steel Cutting Punches</title> <title>Steel Cutting Punches | Page 1 of 3</title> <title>Steel Cutting Punches | Page 2 of 3</title> <title>Steel Cutting Punches | Page 3 of 3</title> Is this the best way to go around it? Or is there another way that I'm not thinking of? Would I need to use the rel=canonical tag to show that the original page is the one I want to be found? Thanks
Reporting & Analytics | | bricktech

0
Get a list of robots.txt blocked URL and tell Google to crawl and index it.

Some of my key pages got blocked by robots.txt file and I have made required changes in robots.txt file but how can I get the blocked URL's list. My webmaster page Health>blocked URL's shows only number not the blocked URL's.My first question is from where can I fetch these blocked URL's and how can I get them back in searches, One other interesting point I see is that blocked pages are still showing up in searches.Title is appearing fine but Description shows blocked by robots.txt file. I need urgent recommendation as I do not want to see drop in my traffic any more.
Reporting & Analytics | | csfarnsworth

0
Is there a way to do this sort of keyword research?

I'd like to be able to do some keyword research as follows: Let's say I have two (or maybe more) separate keyword phrases I want to rank, is there a way to find out what combination and/or additional keyword phrases/descriptors are searched for the most? For example, let's say I want to rank well for the following terms. "Green widgets" and "boxes" Is there a tool I can use that will give me ideas/suggestions on how to use those two keywords the best way? Especially showing me long tell keyword suggestions I may not even know about. The tool may show me things people search for like "best boxes for your green widgets" gets more serach results than "best boxes for my green widgets." (Helping me figure out which combo of words in a long tail phrase is better. Or it may tell me a suggestion I didn't think about like "how to build boxes for your green widgets," or "how to put your green widgets into boxes," or "where to find boxes for your green widgets" or other combinations of things people search for using those two phrases? This may be possable using google keyword tools, but if it is, I'm not sure how to do it. Looking forward for any feedback. Thanks!
Reporting & Analytics | | NoahsDad

0
Is there any way to find out how many people blocked our site in Google?

With it being a factor in Panda, I would like to know what the number is and whether it's high / low compared to other sites etc. I kind of doubt a lot of people would have blocked us, but I'd like to at least be aware of whether that's a problem for us.
Reporting & Analytics | | rango

0