Identifying Bots in Google Analytics
-
Hi there,
While you can now filter out bots and spiders in Google Analytics, I'm interested in how you identify a bots and spiders in the first place. For example, it used to be thought that Googlebot wouldn't appear in GA as it 'couldn't process Javascript' but now Google has announced new developments for its crawler with regards to interpreting javascript and CSS, this argument isn't as cut and dry.
I'm not suggesting Googlebot appears in Google Analytics, but I am saying that you can't make the case that it won't appear only because it can't interpret JavaScript.
So, I'm interested to see what metrics you use to identify a bot? For me, the mix of Users > Browser, Users > Operating System Version is still quite handy, but is it possible to identify individual bots and spiders within Google Analytics? And would Googlebot appear?
-
Hi there,
That's great - thanks. I'm aware that GA can block bots data from appearing within the settings (I think I kind of flagged this in the first sentence of my question, but probably could have been clearer), but I was a bit more interested in identifying potential bots and spiders within GA; e.g are there any noticeable tells within the browser version/operating system data that can suggest bot behaviour.
For example, if you segment a browser version, operating system and then filter only for pageviews where time on page ≤ 00:10 or less (for example) can you start to isolate bot behaviour in GA?
Edit: or are the numbers so small (due to the amount of bots that can execute javascript) that there wouldn't be much data?
-
Hi,
By default Google Analytics blocks all the well know bots and spiders that are out there and I would say the do a pretty good job. As enabling the feature to disable even more bots and spiders made less than 1% of visitors disappear with over millions of visitors.
They're able to identify bots and spiders based on the user agents so that's why they can also easily block them.
-
Hello.
I recommend reading the following articles:
http://www.lunametrics.com/blog/2014/08/07/bot-spider-filtering-google-analytics/
In short, there is a checkbox under Admin settings. > _View _panel>"View Settings." But eitherway read about it to see if it is worth it for you.
They are very recent and give a lot of insight on the subject.
Adidtionaly, is your site using wordpress or a similar CMS? If so, there are a couple of pligins that ell you when a bot has visited your site.
Thanks and hope it helps
Ricardo
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Splitting Google analytics data
Hi Everyone I'm not sure if this can be done but thought i would ask anyway. One of our clients has a website which is a 3 tiered website, basically this means different access levels for different users depending on their ip address. The split is as follows (business 1, business 2 and the general public all see different things and areas within the website) Now what we are wanting to do is essentially split our analytics data for each of the 3 different users on the site, Can this be done through Google analytics? Thanks in advance. ps If im not clear enough let me know and ill try clear it up
Reporting & Analytics | | TheZenAgency0 -
Weird Google Analytics tracking question
I have a client that has a market place site, where people list goods and sell them, think something like Etsy. Instead of developing a system to show the users page views and things like that, does it sound reasonable to let them enter a Google Analytics property on the pages they list on, then let them monitor through GA? Does anyone see any fatal flaws in this thinking?
Reporting & Analytics | | LesleyPaone0 -
Google Analytics Goals - Different Domain
Hi, We currently need to setup a goal that involves a different domain. Any guidance would be greatly appreciated. more info: the checkout process is redirected to a secure.domain Just let me know if I can provide any additional info that may helpful.
Reporting & Analytics | | opusvo0 -
Google Analytics Organic Accuracy?
Hi, On a cool summers day, I was quenching my thirst for SEO Knowledge in the depths of Google analytics, When I stumbled upon a most troublesome sight. I was Browsing the data inside Acquisition->Keywords->Organic and comparing them to Acquisition->Search Engine Optimization->Landing Pages, to find the results quite questionable.. Since Keywords->Organic measure the visits from the organic results, and Search Engine Optimization->Landing Pages measures the clicks onto one of my landing pages from Google, I assumed they should be the same or very close, (besides Keywords->Organic having visits from other search engines) but they were not the same, as a matter of fact it was telling me that Keywords->Organic visits = 1,474, 27.19% of total(5,422) and Search Engine Optimization->Landing Pages, clicks = 1,548 154.80% of total (1000). Even worst the Search Engine Optimization -> Queries clicks = 1,123, 160.43% of total(700). I have been searching, and come up empty handed in the answer so does anyone know why Google is showing me different results and strange numbers that don't make sense? Any information is greatly appreciated?
Reporting & Analytics | | KBB_Digital0 -
Google Analytics is not showing me eCommerce Section Details for My Online eCommerce Website!
From Last few days we are not able to find any details from eCommerce section at Good Analytics account for our eCommerce website i.e order detail, Price e.t.c. Please any one can suggest proper solution for this query?
Reporting & Analytics | | yuvastyle0 -
Google Analytic - Is it possible to see which organic keyword triggered goals?
Hi, I am trying to see which of my Google organic keywords triggered my goals? In GA I click > Conversion > Goals > Overview > Source Medium (This then says where my goals came from but when I click Google / Organic it just brings me to the overview page of my organic traffic). Is it possible to see which organic keywords trigger goals?
Reporting & Analytics | | AdvanceSystems0 -
Google analytics advanced segments
Ok, I need help with a simple (although, for some reason, I'm having trouble with it) advanced segment. Dilemma**:** All of our techs have a backend cookie that they use to log into our website. I want a way toexclude all visites where the landing page contained this in the url:/backend/cookie.php?username= Advanced Segment: We have a lot of techs and each one of them has a different "username=example". So how can I set up an advanced segment where it will exclude any visit where the visitor came in one a landing page containing /backend/cookie.php?username=
Reporting & Analytics | | NerdsOnCall0 -
Google Analytics Options
A couple of months ago, I read about a new web stats application that is real time but more importantly let's you track user actions on a page (i.e. which buttons were clicked for example). This information would obviously be very helpful in continuing to improve site performance. Anyone have suggestions or know the name of this application? I do not mind paying but am not looking for an enterprise class application.
Reporting & Analytics | | Mont0