GOOGLE ANALYTIC SKEWED DATA BECAUSE OF GHOST REFERRAL SPAM ND CRAWL BOTS
-
Hi Guys,
We are having some major problems with our Google Analytics and MOz account. Due to the large number of ghost/referral spam and crawler bots we have added some heavy filtering to GA. This seems to be working protecting the data from all these problems but also filtering out much needed data that is not coming through. In example, we used to get a hundred visitors a day at the least and now we are down to under ten.
ANYBODY PLEASE HELP. HAVE READ THROUGH MANY ARTICLES WITH NO FIND TO PERMANENT SOLID SOLUTION (even willing to go with paid service instead of GA)
Thank You so Much,
S.M.
-
As I understand, you get referral traffic from websites like; traffic-cash and those with .xyz extension.
There is a great article on how to filter those: https://www.ohow.co/what-is-referrer-spam-how-stop-it-guide/
-
I wonder what kind of bots or crawlers you were seeing before because we have millions of visitors in our analytics set-ups, no filters to filter them out and we barely see any traffic coming from browsers or hostnames that may be identified as such.
-
You may have already tried this (https://megalytic.com/blog/how-to-filter-out-fake-referrals-and-other-google-analytics-spam) as I believe it is one of the more common articles, but it suggests setting up a filter to use hostnames and testing it with a segment. This has worked well for us. You have to be careful and make sure you use ALL the relevant hostnames and that your expression doesn't contain errors.
-
What filters do you have setup?
Generally, I prefer to set up two views on an Analytics property, one containing all of the data, and one with filters. This way if the filtered data is looking lower than expected, there's still the complete view to compare against. It also makes it easy to test the efficacy of the filters that were created.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Listing of all Google Indexed Pages
I started managing a site that has about 391,000 indexed pages. I want to get to the bottom of why there are so many in preparation for a ecommerce Migration and improving SEO. Anyone know of a tool? Many tools I have came across can only take 100 at a time. I would love to get them in excel or a database. I look forward to the suggestions.
Moz Pro | | dhands170 -
On Moz and Google analytics are showing high numbers of unknown searches.
Its getting to be 40% to 60%. Clients ask what that is and why Data Not Provided Best answers please and any advice welcome
Moz Pro | | BraveThinking0 -
Site Explorer - No Data Available for this URL
Hi All I have just joined on the trial offer, im not sure if i can afford the monthly payments, but im hoping SEOmoz will show me that i also cannot afford to be without it! In my proses of learning this site and flicking through each section to see what things do. However when i enter my URL into Site Explorer i get the following message "No Data Available for this URL" My site should be crawl-able, so how do i get to see data for my site/s. I wont post my URL here, as the site has a slightly adult theme.
Moz Pro | | jonny512379
If anyone could confirm if i can post "slightly adult" sites. Best Regards
Jon0 -
Issue in number of pages crawled
i wanted to figure out how our friend Roger Bot works. On the first crawl of one of my large sites, the number of pages crawled stopped at 10000 (due to the restriction on the pro account). However after a few weeks, the number of pages crawled went down to about 5500. This number seemed to be a more accurate count of the pages on our site. Today, it seems that Roger Bot has completed another crawl and the number is up to 10000 again. I know there has been no downtime on our site, and the items that we fixed on our site did not reduce or increase the number of pages we had. Just making sure there are no known issues with Roger Bot before I look deeper into our site to see if there is an issue. Thanks!
Moz Pro | | cchhita0 -
Crawl went from a few errors to thousands when I added Blog
I am new here. I recently got the errors from SEOmoz crawl on my site down to just a handful from a couple hundred. So I took the leap and moved my blog to www.mysitename.com/blog (which I see recommended here) and now my errors are in the thousands. My blog which was a separate url has pages back to 2007. I am not sure if it is appropriate to post my site url in a question here? One error that really stands out is this: Description <dd>Using rel=canonical suggests to search engines which URL should be seen as canonical.</dd> On my root page I have: rel="canonical" href="http://www.mysitename.com"/> Thanks for any help...
Moz Pro | | CMCD0 -
Excluding parameters from seomoz crawl?
I'm getting a ton of duplicate content errors because almost all of my pages feature a "print this page" link that adds the parameter "printable=Y" to the URL and displays a plain text version of the same page. Is there any way to exclude these pages from the crawl results?
Moz Pro | | AmericanOutlets0 -
How long does a crawl take?
A crawl of my site started on the 8th July & is still going on - is there something wrong???
Moz Pro | | Brian_Worger1 -
Akamai Ghost.
I just started a new contract with a Fortune 50 client that is using Akamai Ghost. Makes sense because they are truly a global presence. The problem is I am having a hard time using anything to crawl the site, even Seomoz only comes up with one page when pointed to the home page. It really worries me that Gbot is having the same problem. We are indexed really well but I fear its only because of internal deep linking and the bot is getting stuck in different places and not crawling the whole site or passing “Link Juice” like it should. At first I thought it was a cookie issue due to language selection but that was ruled out and Google Webmaster tools is throwing up an intermittent Akamai error when a crawl test is done. (sometime it stops at the first page and wont crawl) Has anyone here worked with Akamai had the same problem or found a solution? I want to get a handle on this before I write up a business case and call Akamai in for a meeting.
Moz Pro | | SEMSEOManager1