Identifying Bots in Google Analytics
-
Hi there,
While you can now filter out bots and spiders in Google Analytics, I'm interested in how you identify a bots and spiders in the first place. For example, it used to be thought that Googlebot wouldn't appear in GA as it 'couldn't process Javascript' but now Google has announced new developments for its crawler with regards to interpreting javascript and CSS, this argument isn't as cut and dry.
I'm not suggesting Googlebot appears in Google Analytics, but I am saying that you can't make the case that it won't appear only because it can't interpret JavaScript.
So, I'm interested to see what metrics you use to identify a bot? For me, the mix of Users > Browser, Users > Operating System Version is still quite handy, but is it possible to identify individual bots and spiders within Google Analytics? And would Googlebot appear?
-
Hi there,
That's great - thanks. I'm aware that GA can block bots data from appearing within the settings (I think I kind of flagged this in the first sentence of my question, but probably could have been clearer), but I was a bit more interested in identifying potential bots and spiders within GA; e.g are there any noticeable tells within the browser version/operating system data that can suggest bot behaviour.
For example, if you segment a browser version, operating system and then filter only for pageviews where time on page ≤ 00:10 or less (for example) can you start to isolate bot behaviour in GA?
Edit: or are the numbers so small (due to the amount of bots that can execute javascript) that there wouldn't be much data?
-
Hi,
By default Google Analytics blocks all the well know bots and spiders that are out there and I would say the do a pretty good job. As enabling the feature to disable even more bots and spiders made less than 1% of visitors disappear with over millions of visitors.
They're able to identify bots and spiders based on the user agents so that's why they can also easily block them.
-
Hello.
I recommend reading the following articles:
http://www.lunametrics.com/blog/2014/08/07/bot-spider-filtering-google-analytics/
In short, there is a checkbox under Admin settings. > _View _panel>"View Settings." But eitherway read about it to see if it is worth it for you.
They are very recent and give a lot of insight on the subject.
Adidtionaly, is your site using wordpress or a similar CMS? If so, there are a couple of pligins that ell you when a bot has visited your site.
Thanks and hope it helps
Ricardo
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How can I overwrite previously imported cost data in Google Analytics?
I choose the overwrite option but it keeps adding the costs to the existing costs. When i select that radio button and click done, that option does not appear on the summary screen. That section next to Import Behavior is blank.
Reporting & Analytics | | JGB5550 -
Google Analytics Events that lead to Goals (conversions)
Hello! I'm in the process of setting up Events in Google Analytics to track the performance of banner ads on our site. While that will take care of the action performed by the visitor (i.e. the click on the banner), it doesn't tell me if the visitor ultimately completed the form where the banner ad directs them (which is set up as one of out site's Goals). Once the Event is in place, will I be able to track the Goal conversions that it leads to? It's nice that Events will tell me which banner drove someone to the form, but if I'm not able to see if that Event led to a Goal conversion it seems like something will be missing. So, is this something that's already available within Goals or Events reporting, or is there an additional step I need to take? Thanks in advance for your feedback! Erik
Reporting & Analytics | | SmileMoreSEO0 -
How do I cancel a scheduled Dashboard report in Google Analytics?
I created a few Dashboards in Google Analytics and scheduled them to be emailed for the next 6 months. Now I want to cancel those scheduled emails and am not finding those Dashboard reports/emails anywhere so I can cancel them. Do you know how to stop these emails from being sent?
Reporting & Analytics | | cindyt-170380 -
Referral Traffic vs. Campaign Traffic in Google Analytics
I have two sites: a blog and an ecommerce site. The blog funnels people to the ecommerce site. In Analytics I'm seeing declines in referral traffic from the blog to the ecommerce site. During the same time I'm seeing an increase in campaign traffic to the ecommerce site, with most campaign traffic coming from the blog. I believe the increase in campaign traffic is largely a result of simply having installed more tracking links. This leads me to believe that the declines I'm seeing in referral traffic is simply a result of the increase in campaign traffic. In other words, what was once counted and reported as being referral traffic is now being counted and reported as campaign traffic. So my question is this: In Google Analytics is campaign traffic ALSO reported as referral traffic, or is campaign traffic reported separately and not duplicated in referral traffic reports? I'll provide a concrete example to make this more clear in case it isn't: Say site X sends 1000 visits each month to site Y. Say 50 of those visits come from a single link on X. If that link is changed so that campaign Z data info added (via the Google URL Builder), would you expect to then see 950 referral visits each month from site X to site Y plus 50 campaign visits to site Y via new campaign Z, or would you continue to see 1000 referral visits plus the new 50 campaign visits? Many thanks in advance to anyone that can shed some light on this.
Reporting & Analytics | | aaronprimal0 -
Google Analytics & AdWords Conversion Tracking
I have Google Analytics implemented on my site and have goals/funnels set up to track the conversion process. I have just started an AdWords campaign but can't see/track conversions from it. Do I need to implement both Google Analytics AND AdWords scripits on the page?
Reporting & Analytics | | mj7750 -
Comparing % Change, Google Analytics
Hey Mozzers, Is there a simple way to compare the "% Change" in traffic when comparing two separate time periods in a single Google Analytics report? When comparing data from two separate time periods, an exported CSV doesn't include the % Change (booo!), and there's no option to sort by % Change within the GA report, essentially forcing you to scroll through all the results to pinpoint the major movers and shakers. I'm not averse to using spreadsheets to sort this data, but I'm thinking that I'd likely need a macro to make this work, something like this. However, none of the macros on that page are working (possibly because they were designed for a previous version of Analytics). All suggestions are appreciated. Thanks!
Reporting & Analytics | | dangaul0 -
Google Analytics bug?
Hi, I'm getting hits to this page, it's screwing up my Google Analytics stats. I know it's related with Google Website Optimizer, cuz it correlates with the tests I ran at the same dates. I'm just wondering if you've seen this before and what I should do to clean my stats? And is this affecting my SEO? Because it's still registering hits to these pages but I already stopped the tests a while go. Should I disallow this in my robots.txt file? Thanks! ga_bug3.jpg
Reporting & Analytics | | rhenster990 -
Tracking Required Form Fields in Google Analytics
I tried searching for this elsewhere but am having a hard time finding a good answer. Is it possible to track the effect of required form fields on conversions in Google Analytics? In other words, how do I track whether or not more/less people fill out a form if I make "Last Name" a required field? Thanks 🙂
Reporting & Analytics | | kylesuss0