Whatstuffwherebot user agent messing up Google Analytics
-
Starting yesterday, Aug 26, 2020, I noticed a new bot crawling our site with user agent whatstuffwherebot.
Google Analytics is counting these hits as human traffic, completely throwing off my numbers - yesterday, Analytics reported nearly triple my typical number of visitors.
As of now, Search Console only shows data through Aug 25 so I don't know if Search Console is also affected.
Is anybody else seeing something similar?
Does anybody know what the whatstuffwherebot bot is? I don't get any results when I search on Google or Bing.
For what it's worth, the traffic is coming from Columbus, OH, running over Amazon AWS via 278 different IP addresses so far. Also, WordFence (my WordPress security plugin) correctly identifies these hits as bot traffic.
-
Hi Martijn,
Thanks for the reply.
Yes, I've enabled bot filtering on all views except my unfiltered view. My site gets so much bot traffic that the data would be unusable without it.
As for filtering the traffic, I'm not aware of any way to retroactively filter out User-Agent unless I use GTM to create a custom dimension as described here: https://www.addsearch.com/docs/analytics/addsearch-bot-google-analytics/
Perhaps this is something I should do in case something like this ever happens again in the future.
I'm still hoping for other suggestions - particularly ways to ask the Google Analytics team to include "whatstuffwherebot" as part of their bot filtering.Best,
Akira -
Hi Akira,
Have you enabled bot filtering as a setting in Google Analytics on a view level? If not, you could always add a filter on the property or account level to filter out the traffic if it has very common patterns as you're describing. Usually, I would just stay away, from filtering out this type of traffic though if you have large amounts of traffic as otherwise you might be doing more harm to your data long-term than helping it.
Martijn.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How can I overwrite previously imported cost data in Google Analytics?
I choose the overwrite option but it keeps adding the costs to the existing costs. When i select that radio button and click done, that option does not appear on the summary screen. That section next to Import Behavior is blank.
Reporting & Analytics | | JGB5550 -
Is there a way to apply the same google analytics filter to multiple properties?
I manage WordPress multiple sites for my clients. Some of these clients are SEO customers. One issue I have with the analytics reports is the occurrence of spam and ghost spam. I know how to create filters to block however there are always more and more. Is there away to export the filter and import it to all the other properties i manage? Or do they just have to be done manually every time i need to block spam?
Reporting & Analytics | | donsilvernail1 -
Google Analytics: Okay to change domain?
So, we are a long time user of GA and we're planning a domain change.
Reporting & Analytics | | jmueller0823
Does anyone know if I can 'change the domain' in GA so we don't lose our past data?
Thanks!0 -
Determining Exact Reverse Path in Google Analytics
Within Google Analytics does anyone have suggestions for how to determine the exact reverse path for a product purchased? The goal funnel does not provide in a detailed way, especially if a step is taken out of the exact funnel provided. If this information cannot be obtained through Analytics is there another tool we can use to get the exact path?
Reporting & Analytics | | bozzie3110 -
Google Direct Traffic Reporting for Mobile on Analytics
We noticed a significant drop in our direct traffic in Google Analytics for mobile on July 30th but all our other traffic remains the same. What is the possible cause of this?
Reporting & Analytics | | COEDMediaGroup0 -
Google Analytics for example.com and www.example.com
Hello. I have had a Google Analytics account set up to track the property www.example.com for several years. In Google Webmaster Tools, I recently set the preferred domain to example.com (without the www), and we put in a rewrite from www to no-www in the .htaccess file. Should I now change the url of the property in Google Analytics to example.com (without the www), or does Google Analytics see the two urls as the same? Thank you!
Reporting & Analytics | | nyc-seo0 -
Google Analytics & Omniture Discrepancies
I am seeing a significant difference between my traffic numbers in Google Analytics and Omniture (Omniture has significantly more). I do not expect them to report exactly the same numbers but these are just too far off. Any idea why that is, or which one I should trust more? Thanks!
Reporting & Analytics | | emediaSEO0 -
Individual or Separate Google Analytics Accounts for Each Country Location?
We have 3 websites. USA, Germany and UK. Currently our analytics account is set up with 1 account with each domain as a Profile. I am wondering if I would see more accurate results if I have them set up individually, under the same Google account, but different Analytic accounts. The reason I wonder is because I noticed when I was going through setting this up, it asked for each Country Time Zone for each domain. I was not sure if this was for me to see the times, or if this was to provide more accurate data. Maybe this is just a personal preference topic?
Reporting & Analytics | | hfranz0