Whatstuffwherebot user agent messing up Google Analytics
-
Starting yesterday, Aug 26, 2020, I noticed a new bot crawling our site with user agent whatstuffwherebot.
Google Analytics is counting these hits as human traffic, completely throwing off my numbers - yesterday, Analytics reported nearly triple my typical number of visitors.
As of now, Search Console only shows data through Aug 25 so I don't know if Search Console is also affected.
Is anybody else seeing something similar?
Does anybody know what the whatstuffwherebot bot is? I don't get any results when I search on Google or Bing.
For what it's worth, the traffic is coming from Columbus, OH, running over Amazon AWS via 278 different IP addresses so far. Also, WordFence (my WordPress security plugin) correctly identifies these hits as bot traffic.
-
Hi Martijn,
Thanks for the reply.
Yes, I've enabled bot filtering on all views except my unfiltered view. My site gets so much bot traffic that the data would be unusable without it.
As for filtering the traffic, I'm not aware of any way to retroactively filter out User-Agent unless I use GTM to create a custom dimension as described here: https://www.addsearch.com/docs/analytics/addsearch-bot-google-analytics/
Perhaps this is something I should do in case something like this ever happens again in the future.
I'm still hoping for other suggestions - particularly ways to ask the Google Analytics team to include "whatstuffwherebot" as part of their bot filtering.Best,
Akira -
Hi Akira,
Have you enabled bot filtering as a setting in Google Analytics on a view level? If not, you could always add a filter on the property or account level to filter out the traffic if it has very common patterns as you're describing. Usually, I would just stay away, from filtering out this type of traffic though if you have large amounts of traffic as otherwise you might be doing more harm to your data long-term than helping it.
Martijn.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moving wordpress themes, any best practices on setting up Google Analytics for the change?
We currently have a mess of filters and views in our Google Analytics instance. We have a chance to make a clean start. Wondering if creating a whole new property is a good idea? Or just some additional views? Any other pointers would be greatly appreciated. Thanks!
Reporting & Analytics | | jill.myers0 -
How can I overwrite previously imported cost data in Google Analytics?
I choose the overwrite option but it keeps adding the costs to the existing costs. When i select that radio button and click done, that option does not appear on the summary screen. That section next to Import Behavior is blank.
Reporting & Analytics | | JGB5550 -
How to Analysis which category gives me more revenue from google analytic?
Hello Experts, For Ecommerce site we do have navigation path like Main Category - Subcategory - Products. That means Men as Main Category and then subcategory Cloths, shoes, bags then product in each subcategory. After implementing enhance ecommerce https://developers.google.com/tag-manager/enhanced-ecommerce#product-clicks I am getting this report - "Product Category (Enhanced E-commerce)" in Product Performance section. Now my query is my all products are linked with sub category i.e. cloths, shoes, bags etc so in Product Category (Enhanced E-commerce) I can see Revenue, transaction related to Cloths, shoes, bags etc but how to judge performance of Main categories like Men, Women, Children etc? Because google works with this method i think - name': productObj.name, // Name or ID is required.
Reporting & Analytics | | dsouzac
'id': productObj.id,
'price': productObj.price,
'brand': productObj.brand,
'category': productObj.cat,
'variant': productObj.variant,
'position': productObj.position0 -
% Change - Google analytics - how to calculate?
Hi All,
Reporting & Analytics | | JohnPalmer
I have two dates with two different numbers I want to calculate the "% Change" like google analytics, The numbers of June 2015 - 127,931 sessions
The numbers of June 2014 - 90914 sessions please tell me what is the %Change. Best. J0 -
Most of the goal conversion in Google analytics showing under referral
Hi All, I have already asked this question twice here but issue is not resolved yet. http://moz.com/community/q/all-goal-conversion-in-google-analytics-showing-under-referral http://moz.com/community/q/some-goal-conversion-in-google-analytics-showing-under-referral In Google analytics most of the goal conversion in Google analytics showing under referral from payment gateway sites (Paypal.com & epdq.co.uk). I have applied all the possible solution that suggested by Moz community experts & Google Adwords support team but it is not resolved yet and it is really weird answer to give client that I have applied all possible solution and issue is still not solved. Lastly I am sharing Cross domain tracking code here that I have used on my site. Please check once and let me know if code is correct and If not correct please help me out to correct the code or suggest any other way to fix the issue Cross domain tracking code ======================= <script type="text/javascript">(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
Reporting & Analytics | | Alick300
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','//www.google-analytics.com/analytics.js','ga');
ga('require', 'linker');
ga('linker:autoLink', ['paypal.com', 'payments.epdq.co.uk'], false, true);
ga('create', 'UA-xxxxxx', 'auto', { 'allowLinker': true});
ga('require', 'displayfeatures');
ga('send', 'pageview');</script > I have hide the UID in above code. Thanks0 -
Discrepancy between FB PPC and Google Analytics
This question was answered in 2011 here: http://moz.com/community/q/facebook-ppc-number-of-clicks-according-to-fb-different-than-visits-in-analytics. Wanted to post it to the community to see if anyone had any new thoughts in the last 3 years. I have been running campaigns on Facebook and seeing dramatic discrepancies between Facebook and GA's numbers. For example, I ran a Facebook ad campaign for a chiropractor where FB shows 35 clicks to the website, but GA only shows 2! An attorney ran a Facbook promotion, got 4 clients who actually filled out a questionnaire online, but GA only showed 2 visitors exiting off the form completion page. Is this because the users did not have JS/cookies enabled? Something else? What is the recommended work around? Tracking URL?
Reporting & Analytics | | aj6130 -
Google Analytics complexe solution?
Hello, We have Google Analytics on our website and we have started to track the conversions.
Reporting & Analytics | | lunacloud
Basically we have a goal with 3 steps: Account Details (Personal Information) Confirmation (Mobile Confirmation Code) Email ( confirmation link) On the last step (Destination Goal) we send an email to the customer with the account confirmation link, the tracking works perfectly. Our problem is with the Goal Completions on "Traffic Sources" >> "AdWords" >> "Campaigns", Analytics doesn't add the conversions. This problem is related to the email confirmation? There is any solution to overcome this problem? Thank you! yzujFZU.png f4fay1G.png0 -
Google Analytics: Multi channel funnel
Hi 🙂 I have a little problem. In Multi-channel Funnel Overview I see 50 conversions from Paid Search (screenshot 1). But when I click on Assisted Conversion and then choose Paid Search, I see 31 Assisted Conversions and 32 Last Interaction Conversion. (screenshot 2) So my question is - why the number of converstions in overview (50) is different than number in Assisted Conversions (assisted or last interaction conversion, or both together)? Probably, the answer is so simply, but I can found out it! 🙂 thanks a lot. X6UihL7.png lCNsw4T.png
Reporting & Analytics | | visibilitysk0