Filters for referral bots ineffective
-
I'm not sure what I'm doing wrong here. I've been trying to block spam from my client's analytics for over a month and I just can't seem to get it right. I am beyond frustrated.
Here is a list of the filters I have:
And here is referral traffic from them regardless:
Specifically this is what the filter looks like. Am I doing something wrong here?
I have also put a filter in place to block traffic from Russia, and it doesn't seem to be working 100% either.
On top of that, it seems anytime I do manage to block something, another site just pops up in its place. Is it endless?
My clients are very small local business and this is absolutely ruining their analytics. I can't even show them their traffic reports since it's absolutely meaningless with all this spam. Any help would be greatly appreciated.
-
Thank you for the quick response. Made the changes you suggested and hopefully over the next few days I'll see the effect.
-
The filter verification takes a small sample of data and sometimes in that sample there won't be any change.
Another reason for what you may get this error is because the filter was saved before the verification, so you will have to delete the filter and create it again for the verification to work. Better yet you can use the filter expression in a segment it will give you a better idea of how the filter will work since the segment is not limited to a few days.
If you try to exclude by the offender don't use referral as a filter field use Campaign Source.
For the filter based on valid hostnames, there is no need to put the domain with and without "www" clientsite.com will match both.
Hope that helps,
-
I've tried the method you suggested for one of my client's sites. I created a new filter, did "Include" -> "Hostname" and added the following:
translate.googleusercontent.com|www.clientsite.com|clientsite.com
It said that it wouldn't change any of the data when I went to verify the filter, which should not be the case. Most of the traffic is from hostnames that are not set. I tried this input as well after reading a different article on the subject:
translate.googleusercontent.com|www.clientsite.com|clientsite.com
Once again to no effect.
So I tried to tackle the referral spam itself (although for this particular site, direct traffic seems to be getting a fair amount of spam as well). I created two filters ( http://imgur.com/ShhAYqv ) that included every spam referral I've ever gotten:
adviceforum.com|social-buttons.com|semalt/.com|free-share-buttons.com|buttons-for-website.com|best-seo.com|darodar.com|semalt.com
dailyrank.net|sitevaluation.org|trafficmonetize.org|4webmasters.org|100dollars-seo.com|webmonetizer.com|event-tracking.com|.*(social-buttons.com)
And, as you can see in the picture, it says there would be no effect.
Aghhhhhh! What am I doing wrong here?
-
I have recently followed Carlos' blog posts and have to say the steps worked a treat. Hopefully the Google Analytics team are working on a way to transfer filters across different analytics accounts to make it easier to keep all sites referral traffic free.
-
Hi Kat,
If you want to exclude the spammer you should use Campaign Source as a field type, instead of predefined filter use:
- Filter type Custom > Exclude
- Filter Field > Campaign Source
- File Pattern Box enter the spammer you want to exclude. You don't need to create a different filter for each one; you can create an expression like this:
4webmasters.com|free-share-buttons.com|trafficmonetize.org|morespammers
The backslashes before the dots "." and the dashes "-" are needed because custom filters use Regular Expressions. You can keep adding up to 255 characters after that you have to create another filter
If you want to try a better solution, I recommend you to try a filter based on your hostnames.
This solution requires a little more time to set up, but it has three huge advantages over the Campaign Source solution- You will stop the spam before it hits you, adding a filter for the referral after you see it will stop it, but by the time you apply it you will have already hits of the spam.
- You will need only ONE filter to stop all ghost spam, instead of creating various sets of filters.
- Lately, some of the spammers(e.g. free-social-buttons) have been hitting GA accounts with fake direct visits along with the referral, the filter for the referral won’t stop the direct visit, on the other hand. The Valid hostname filter will stop ghost spam in any form whether it shows as a referral, keyword or direct visit.
This is what I've been using on my accounts for, the last moths and I haven't received a single hit of ghost spam the vast majority.
Here are a detailed guide and more information about all these solutions and spam in Google Analytics.
http://www.ohow.co/what-is-referrer-spam-how-stop-it-guide/
Hope it helps,
-
I've tried setting up filters in the manner you explain on your site, and yet when I go to verify it, it says that it wouldn't affect my data. I most certainly have spam data from the last seven days so I'm uncertain why it's not working.
I entered in names just as you did in your article, excluding from a campaign source:
dailyrank|sitevaluation|trafficmonetize|4webmasters|100dollars-seo|webmonetizer|event-tracking|free-social-buttons
-
You need to set the exclusion for campaign source, and not the ISP domain.
I highly recommend setting an include only filter for your own hostname.
https://www.marceldigital.com/blog/2015/06/stop-ghost-spam-in-google-analytics
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Filter Tracking works fine at staging site but not on LIVE site why?
Hello Expert, For my ecommerce site I want to track filter url's like price range, size, width, color etc and fully filter url should display in google analytic. I have implemented filter tracking at staging server and it works perfectly but on LIVE site it not show me full filter url. Do you guys think any parameter which i have configured in search console affect this? Note - I have configured in this way - http://webmasters.stackexchange.com/questions/93008/how-to-track-a-product-filter-in-the-product-list-view-with-google-analytics My filter url's are given below. And in search console I have configure two parameters. 1) effect - Sort, Crawl - No urls 2) FT - effect- ( - ) , crawl - Let google bot decide. But as per me this parameter is for crawling should not affect tracking right? mysite.com?FP=0&filtSeq=Price&Sort=BS
Reporting & Analytics | | adamjack
mysite.com?FT=7581&filtSeq=Type&Sort=BS
mysite.com?FT=1042&filtSeq=Colour&Sort=BS In robot file nothing is block. In analytic it showing me url till mysite.com only where as in staging it shows me full filter url. Thanks!0 -
Search and Replace filter on Google Analytics?
Hello! On our GA account for one of our clients, we'd like to add a search and replace filter to the Views section of the account. The URL is www.askergoworks.com (it redirects to askergoworks.com), and Google has flagged us to have redundant hostnames. This is why we'd like to add the filter. Would the regular expression be askergoworks.com|www.askergoworks.com ? Any help would be great - I'm not a regex expert, so I really don't how to go about this. Thanks!
Reporting & Analytics | | AGILITY0 -
Referral Traffic from Google
Hello, I have a question about my company's new website. I've worked in SEO and studied Google Analytics results for a few years now but have never really come across something like this. I started in this position in January of this year and when I started breaking down the traffic sources in Google Analytics, I noticed most of the traffic was coming from Google.com as a referral source. I had never seen Google.com as a referral source before so I looked into options for what it could be. It was not a paid ad and our organic traffic was coming through in Analytics, Before I could get any further, our new website was launched (we switched CRM's to WordPress) and the referral traffic from google went from 2,966 in January of 2015 to 22 in February 2015. for more comparison, in February of 2014, the referral traffic from Google was 2,496. I expected a drop when we switched CRM's but we correctly re-directed all pages and created a new sitemap and our organic traffic is up since the switch (not enough to cover drop in referral). I thought at first this had to do with our Google sellers account being de-activated when we made the switch, but I quickly fixed this over a month ago and no change. I'm wondering if anyone has ever seen Google.com come through as a referral source in Google Analytics and if they we're able to figure out what it actually was. This would be a great help! Thank you, Alex
Reporting & Analytics | | RASEO1 -
Google Ad referral
I was wondering if someone could decode the jumble of a referral - this is supposedly the referal that led to a click through to my site via a product listing ad. I am trying to figure out how www.nextag.com comes in to the picture as we do not have refurbexperts even listed there? Thanks to anyone who tries/does work it out. http://www.googleadservices.com/pagead/aclk?sa=L&ai=CGXud6DmDU_qeL5THygHpuICwCaTZwMYD_Nvvv0bEwMS50wEIBhAEIOn5-gEoBVCl7P7f-v____8BYMnu8omYpPQSoAHAhIv9A8gBB8gDG6oEJ0_QwcNc5zNun_d7S5KNcMT6uPjjH_mMDkKFFgBCQ6aKICRPJVVa7MAFBYgGAaAGJoAHqPv0ApAHAeASupqdo-ypit0m&ohost=www.google.com&cid=5GhZEzUCSC6x9n2wxOdz3-mrAfSUkvHKPN3wD5yLInnlNil_&sig=AOD64_1D1z1JPYbFP0UnUglJVOfvd25RfA&adurl=http://refurbexperts.com/product/527/HP-LaserJet-P2015-Laser-Printer-RECONDITIONED%3Futm_source%3Dproductlistingads%26utm_medium%3Dadwords%26utm_campaign%3Dadwords&ctype=5&nb=0&res_url=http%3A%2F%2Fwww.nextag.com%2Fhp-p2015-laserjet%2Fproducts-html%3Fnxtg%3D116d0a1c0504-9FFEB16DE52A7E2A&rurl=http%3A%2F%2Fwww.nextag.com%2Fgoto.jsp%3Fp%3D3652%26search%3Dhp%2520p2015%2520laserjet%26t%3Dag%253D1384181795%26crid%3D48271786%26gg_aid%3D20169721025%26gg_site%3D%26gclid%3DCjgKEAjwzIucBRDzjIz9qMOB3TASJABBIwL1LHK7GcAPS6yHGpd9Kq3wsZrcPORAWD8QCWivr4W75PD_BwE&nm=11&nx=43&ny=12&is=700x181&clkt=187
Reporting & Analytics | | henya0 -
Loss of Google referral traffic after server move / CMS move
I have a client that changed from MoveableType to Wordpress. He also changed from a dedicated server to WP Engine. He may have blocked search engines for a week or two, so his organic traffic is down but only by 25%. He's 301 redirecting all of the old pages. The mystery is that his referral traffic from Google is down 90%. It's a popular blog, so that's thousands. It's been going on a month now. Anyone seen this before?
Reporting & Analytics | | Hyper-Dog0 -
Facebook referral
Olympic athletes in track & field and BMX use our product in their training. When they discuss how they use our product on Facebook, we get a boost in traffic. However, all I see in programs like Woopra is facebook.com in the URL, but not the actual page. How do I determine which FB post with a link to our site is causing the increase in traffic? Best,
Reporting & Analytics | | ChristopherGlaeser
Christopher0 -
Google Custom Report Filters are a pain in the arse
Greetings from high weed pollen count Wetherby UK 🙂 Ok ive been having extreme custom reporting filter frustration with Google analytics. My objective was to set up a "custom" google analytics report that detailed: 1. Referral traffic from external sights in one reporting tab
Reporting & Analytics | | Nightwing
2. Visitor generic traffic report including direct, search & referral traffic e.g: http://i216.photobucket.com/albums/cc53/zymurgy_bucket/reporting-tabscopy.jpg But Ive hit the provebial buffers 😞 Initailly i added an advanced filter as shown here: http://i216.photobucket.com/albums/cc53/zymurgy_bucket/custom-reporting-with-filtercopy.jpg but the advanced filters do not stick / save. As soon as you exit the custom report the advanced filter is cleared as shown here: http://i216.photobucket.com/albums/cc53/zymurgy_bucket/custom-reporting-filter-removedcopy.jpg I then added a filter under a specific custom tab but the filter cascades into all the reporting tabs see below: http://i216.photobucket.com/albums/cc53/zymurgy_bucket/custom-reporting-cascading-filterscopy.jpg So my question is please... "How do can you set up filters that effect the data in one reporting tab and does not cascade into the others" Any insights welcome 🙂0 -
Drop in google referral traffic
Hi guys, As we know, GA shows google as traffic source in two ways: google / organic for organic searches and google.TLD / referral for everything else: google groups, base.google.com, static pages, google reader, google image search, google search appliance/mini. What we noticed is that around Oct 20th there's a huge drop of google.TLD / referral traffic to our site. Do you experience something similar? I couldn't find anything Google-related that happened around this specific date. We use GSA for our site search and I'm wondering if this could be the reason - maybe someone from our development team made changes to GSA settings that affected this traffic source. Looking forward to hearing from you! Thanks.
Reporting & Analytics | | lgrozeva0