Stripping Out Referral Spam From Past Reports
-
Hi,
I'm looking to confirm the best approach for retroactively stripping away referral spam (free buttons, SEMalt, etc.). Now to be clear, I already have filters in place to ignore them from current stats, so moving forward I'm fine. However, I'd love to go back and check untainted stats.
I've setup segments using a regex to strip the root words away and it seems to be working. I have a regex setup to strip out things like: social-buttons|seoanalyses|copyrightclaims|classifiedads|jobsense|free-share-buttons|e-buyeasy|acrobats.hol|cheap-online|amezon|search-help|qut-smoking and so forth.
I've been going through my referral data, noticing obvious spam, and adding their domains to my segment. Is this the optimal way for me to get a clear, untainted view of my past stats?
-
Sweet, glad to hear our filters will suffice. Thanks for the input, Daniel.
-
Hey, no worries and you're right that your filters should block them as well. Using .htaccess would be just an additional defense mechanism but may not be necessary.
-
Hi Daniel,
Thanks again for the response. What would be the difference in Analytics data between my filters and going straight to .htaccess? If the data is the same, is there an additional benefit to .htaccess?
For regular users, I'd suspect less bandwidth since they can't load my domain, but I don't think these bots actually load the page or visit.
-
I would use your .htaccess file to block them with the following code (this would for example block referrals from semalt.com and semalt.com subdomains):
RewriteEngine On
Options +FollowSymlinks
RewriteCond %{HTTP_REFERER} ^https?://([^.]+.)*semalt.com\ [NC,OR]
RewriteRule .* – [F]
You can also use .htaccess to block IP addresses associated with the spammy sources.
edit: just saw your edit but hope this helps nevertheless!
-
Hi Daniel,
Thanks for the additional tips. I do have the bot filtering feature enabled as another point of protection. I checked my referral exclusion list and apparently set this up about a year ago for the initial wave of referral bots I noticed. I didn't know it added them to direct.
The majority of my spam referral hosts have been added to regular filters. I think with the combination of my retroactive approach and new filters, I should have reliable data going forward.
-
Hi there,
You’re on the right track and the best way to retroactively remove spammy sources is through report filters and advanced segments.
A couple other notes:
- A good way to spot spammy referrers is to sort by bounce rate and eliminate any with 100% bounce and over 10 sessions.
- Avoid using the “referral exclusion list” since this will just count spam traffic as direct traffic instead.
- You should also enable the GA ‘bot filtering’ feature under ‘Reporting view settings’ as seen here
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Visits from Google with ccTLD are showing as referrals
Hi!I was seeing on of my clients Analytics report and it shows that some of the main sites that send visits and get tagged as referral traffic are google.com.br, google.cl, google.com.ar, among others. Do you know why is this happening? Shouldn't they get tagged by default as organic?
Reporting & Analytics | | arielbortz0 -
Google webmaster links vs Moz Reporte do follow links
A bit confused about my seo reports for a site I am tracking in Moz. Google webmaster reports i have 1836 links to my domain.
Reporting & Analytics | | KenW
Moz reports 273 external followed links.
Website Auditor reports 449 dofollow and 338 no follow.> total 787
What is important factor that I should be reporting to my client that really matters?0 -
GA: How can non related kws show up in the organic report?
Hi mozzers, I have a site A: www.example.com (with its own branded kws) SiteB: subdomain.example.com Site A and B are related and belong to the same company. Site B was released a couple months ago. ISSUE: I have noticed branded kws from Site A showing up on Site B's GA which doesn't make any sense. I try to make searches in the SE with those kws and not a single search showed the Site B(subdomain). What is weird is that 2 months ago had a an issue with bounce rate on site B showing a 0% bounce rate, then I discovered that we had 2 GATC on site, removed the extra code and bounce was back to normal. Since then I have seen a rise of branded kws from Site A to Site B. Can someone help me here figuring out what is wrong? Thanks
Reporting & Analytics | | Ideas-Money-Art0 -
Best way to generate analytics reports for listing style website
I'm working on a website that includes dedicated pages for ~40 local businesses, and I need to be able to generate and export some basic reports I can send to each business. The data I need for each report is split between general sitewide data: total number of visitors to the site for month. number of visitors to each main category page what country they are from (main countries) - top 5 traffic source / keywords avg time on site As well as specific data for each individual page: how many people viewed specific total pages Time spent on individual page. Would this be possible with custom reports in analytics? I can see the number of different reports being difficult to maintain, especially as site grows. Anyone had expereince on a similar site of ideas on the best way to do this? Thanks
Reporting & Analytics | | zeald0 -
Google Custom Report Filters are a pain in the arse
Greetings from high weed pollen count Wetherby UK 🙂 Ok ive been having extreme custom reporting filter frustration with Google analytics. My objective was to set up a "custom" google analytics report that detailed: 1. Referral traffic from external sights in one reporting tab
Reporting & Analytics | | Nightwing
2. Visitor generic traffic report including direct, search & referral traffic e.g: http://i216.photobucket.com/albums/cc53/zymurgy_bucket/reporting-tabscopy.jpg But Ive hit the provebial buffers 😞 Initailly i added an advanced filter as shown here: http://i216.photobucket.com/albums/cc53/zymurgy_bucket/custom-reporting-with-filtercopy.jpg but the advanced filters do not stick / save. As soon as you exit the custom report the advanced filter is cleared as shown here: http://i216.photobucket.com/albums/cc53/zymurgy_bucket/custom-reporting-filter-removedcopy.jpg I then added a filter under a specific custom tab but the filter cascades into all the reporting tabs see below: http://i216.photobucket.com/albums/cc53/zymurgy_bucket/custom-reporting-cascading-filterscopy.jpg So my question is please... "How do can you set up filters that effect the data in one reporting tab and does not cascade into the others" Any insights welcome 🙂0 -
Google Analytics - Referral Traffic Question
How Google Analytics determine that some particular web site referred traffic if there is no back link on that site?
Reporting & Analytics | | DiamondJewelryEmpire1 -
Drop in google referral traffic
Hi guys, As we know, GA shows google as traffic source in two ways: google / organic for organic searches and google.TLD / referral for everything else: google groups, base.google.com, static pages, google reader, google image search, google search appliance/mini. What we noticed is that around Oct 20th there's a huge drop of google.TLD / referral traffic to our site. Do you experience something similar? I couldn't find anything Google-related that happened around this specific date. We use GSA for our site search and I'm wondering if this could be the reason - maybe someone from our development team made changes to GSA settings that affected this traffic source. Looking forward to hearing from you! Thanks.
Reporting & Analytics | | lgrozeva0 -
Track Google/Bing Shopping as Referrer
Is there a way to track Google & Bing Shopping referrals independent of standard Google/Bing tracking? It would be nice if we could see the difference between Google PPC, Google Organic & Google Shopping. I notice in analytics that we get some traffic from google/ppc, some from google/organic, some from google.com/referral (not sure what this is), and some from googlebase/cse (I know this is Google shopping, but I don't think it's tracking all shopping referral visits as this).
Reporting & Analytics | | JerDoggMckoy0