Filters for referral bots ineffective
-
I'm not sure what I'm doing wrong here. I've been trying to block spam from my client's analytics for over a month and I just can't seem to get it right. I am beyond frustrated.
Here is a list of the filters I have:
And here is referral traffic from them regardless:
Specifically this is what the filter looks like. Am I doing something wrong here?
I have also put a filter in place to block traffic from Russia, and it doesn't seem to be working 100% either.
On top of that, it seems anytime I do manage to block something, another site just pops up in its place. Is it endless?
My clients are very small local business and this is absolutely ruining their analytics. I can't even show them their traffic reports since it's absolutely meaningless with all this spam. Any help would be greatly appreciated.
-
Thank you for the quick response. Made the changes you suggested and hopefully over the next few days I'll see the effect.
-
The filter verification takes a small sample of data and sometimes in that sample there won't be any change.
Another reason for what you may get this error is because the filter was saved before the verification, so you will have to delete the filter and create it again for the verification to work. Better yet you can use the filter expression in a segment it will give you a better idea of how the filter will work since the segment is not limited to a few days.
If you try to exclude by the offender don't use referral as a filter field use Campaign Source.
For the filter based on valid hostnames, there is no need to put the domain with and without "www" clientsite.com will match both.
Hope that helps,
-
I've tried the method you suggested for one of my client's sites. I created a new filter, did "Include" -> "Hostname" and added the following:
translate.googleusercontent.com|www.clientsite.com|clientsite.com
It said that it wouldn't change any of the data when I went to verify the filter, which should not be the case. Most of the traffic is from hostnames that are not set. I tried this input as well after reading a different article on the subject:
translate.googleusercontent.com|www.clientsite.com|clientsite.com
Once again to no effect.
So I tried to tackle the referral spam itself (although for this particular site, direct traffic seems to be getting a fair amount of spam as well). I created two filters ( http://imgur.com/ShhAYqv ) that included every spam referral I've ever gotten:
adviceforum.com|social-buttons.com|semalt/.com|free-share-buttons.com|buttons-for-website.com|best-seo.com|darodar.com|semalt.com
dailyrank.net|sitevaluation.org|trafficmonetize.org|4webmasters.org|100dollars-seo.com|webmonetizer.com|event-tracking.com|.*(social-buttons.com)
And, as you can see in the picture, it says there would be no effect.
Aghhhhhh! What am I doing wrong here?
-
I have recently followed Carlos' blog posts and have to say the steps worked a treat. Hopefully the Google Analytics team are working on a way to transfer filters across different analytics accounts to make it easier to keep all sites referral traffic free.
-
Hi Kat,
If you want to exclude the spammer you should use Campaign Source as a field type, instead of predefined filter use:
- Filter type Custom > Exclude
- Filter Field > Campaign Source
- File Pattern Box enter the spammer you want to exclude. You don't need to create a different filter for each one; you can create an expression like this:
4webmasters.com|free-share-buttons.com|trafficmonetize.org|morespammers
The backslashes before the dots "." and the dashes "-" are needed because custom filters use Regular Expressions. You can keep adding up to 255 characters after that you have to create another filter
If you want to try a better solution, I recommend you to try a filter based on your hostnames.
This solution requires a little more time to set up, but it has three huge advantages over the Campaign Source solution- You will stop the spam before it hits you, adding a filter for the referral after you see it will stop it, but by the time you apply it you will have already hits of the spam.
- You will need only ONE filter to stop all ghost spam, instead of creating various sets of filters.
- Lately, some of the spammers(e.g. free-social-buttons) have been hitting GA accounts with fake direct visits along with the referral, the filter for the referral won’t stop the direct visit, on the other hand. The Valid hostname filter will stop ghost spam in any form whether it shows as a referral, keyword or direct visit.
This is what I've been using on my accounts for, the last moths and I haven't received a single hit of ghost spam the vast majority.
Here are a detailed guide and more information about all these solutions and spam in Google Analytics.
http://www.ohow.co/what-is-referrer-spam-how-stop-it-guide/
Hope it helps,
-
I've tried setting up filters in the manner you explain on your site, and yet when I go to verify it, it says that it wouldn't affect my data. I most certainly have spam data from the last seven days so I'm uncertain why it's not working.
I entered in names just as you did in your article, excluding from a campaign source:
dailyrank|sitevaluation|trafficmonetize|4webmasters|100dollars-seo|webmonetizer|event-tracking|free-social-buttons
-
You need to set the exclusion for campaign source, and not the ISP domain.
I highly recommend setting an include only filter for your own hostname.
https://www.marceldigital.com/blog/2015/06/stop-ghost-spam-in-google-analytics
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is Google doing anything about the spam referrer plague in Google Analytics?
My client manages 15+ websites and we have observed the spam referrer issue has gotten steadily worse and worse in the last few months. I took the time to weed out the worst offenders via traffic filters but our referral traffic source garden was quickly full of weeds again a few weeks later. Does anybody know what the Google Analytics development team is doing to combat the spam referrer issue? I find it quite amazing that Google goes through the asinine effort to block out organic keyword data ("not found" & "not provided) but they don't seem to care about blacklisting/filtering spam referrers. RHnE6Wx
Reporting & Analytics | | RosemaryB3 -
Why doesn't Google seem to care about referral spam?
In researching the issue of referral spam, there is no shortage if info, both on MOZ and beyond. But, neither the Google Analytics Blog or Help Forums seem to mention the issue at all. I'd think it is something that they would want to get rid of, yet it seems like they don't even acknowledge that it exists. Anyone have insights into this? Am I missing something, or is Google strangely silent on an issue that is becoming more and more annoying for anyone trying to use GA data?
Reporting & Analytics | | irapasternack1 -
Filter the Spam traffic
Hello everyone, We have to filter traffic from spam website like webcrawler.com semalt.com social-button.com etc. So we created custom filter with Filter field: referral Filter Pattern: Webcrawler.com|semalt.com|in-g61.mail.yahoo.com|d47c5f40.linkbucks.com|buttons-for-website.com|semalt.semalt.com|forum.topic34157145.darodar.com|social-buttons.com While verification of filter there is error displaying i.e. This filter would not have changed your data. Either the filter configuration is incorrect, or the set of sampled data is too small. Please help in resolving issue..
Reporting & Analytics | | Obbserv0 -
Google referral traffic drop around 14th July 2014 (UK). Anyone else seeing it?
We've seen around a 25% drop in Google referral traffic from the 14th July 2014 onwards and having real trouble identifying why and from what search terms we're being effected. WMT and Moz Pro don't show any movement. Is anyone else seeing the same thing on UK search terms? Seems a bit late to be the effect of Panda 4.0? Any help would be amazing. Thanks.
Reporting & Analytics | | whis1 -
How to filter many cities from Google analytics
I need to filter hundreds of cities from my traffic reports. I've been told that adding them all in this format: |Knutsford|Ripon|Cheadle Hulme|Congleton| and using the 'matching reg/exp from the drop down should do it... Unfortunately that doesn't seem to be working as I can still see cities like London in the results.... Any ideas?
Reporting & Analytics | | david.smith.segarra0 -
Will 301 redirects (Same Domain) show as referral traffic in Analytics?
For an eCommerce site we have 301'd legacy product pages to new product pages. Is all that traffic going to show up as referral traffic from our own domain in Google Analytics? If so, is there any way to preserve original source/medium info or will all the source/medium info be our own domain since there is a 301 redirect?
Reporting & Analytics | | bozzie3111 -
Google referral drop after setting preferred domain
Hey all, After doing a lot of research, and verifying here in the forum, I set our site's preferred domain on monday. We had no preferred domain set for years, but we were already redirecting the non www site to the www one. So, it was evidently an oversight. The day after I set the preferred domain (Jan 29) our google referral traffic hit an all time low. Any other thoughts on the cause? Any ideas on why setting a preferred domain would be a bad idea? Our site is www.mnn.com. Thanks!! Lisa
Reporting & Analytics | | Aggie0 -
Dramatic Increase in referrals from own website
The past few weeks I've been wracking my brain to figure out why on earth my branded searches could be dropping off at 30-40%. Well today, I realize I've had a dramatic increase in referrals from my own site (the non www verison). I'm talking 150 in March of last year to 5k in March of this year drastic. My 301 redirects haven't changed as far as I know -- I've had them set to redirect from the non www. to the www. for at least a year or two. I'm assuming visitors from search engines are somehow getting the non www version and the redirect is attributing the traffic to referrals instead of search. The drop in search traffic and the increase in referral traffic fall on the same day. Does that sound right/possible? If so, how do I fix this? My traffic stats for two clients are all screwy because of this. I want to make sure whatever solution I implement won't hurt my search traffic numbers any more 🙂 Has anyone else seen this happen recently? I could imagine an anomaly with one site but I find it odd that it could be two client sites. I still have some others to check. Thanks in advance! Leslie
Reporting & Analytics | | LeslieVS0