Direct traffic is up 2100% (due to a bot/crawler I believe)
-
Hi,
The direct traffic to website www.webgain.dk has increased by over 2100% recently. I can see that most of it is from US (my target audience is in Denmark and the website is in danish).
What can I do about this? All this traffic gives my website a bounce rate of 99.91% for direct traffic. I believe it is some sort of bot/crawler. -
Already done. They also included the tip in their newsletter for beta-testers.
-
You might want to let them know about this, so they can add in documentation so future users know what is up before panicking.
-
Follow up: I have fixed this now. It was a monitoring tool by Digicure, where I have signed up to be a beta tester. Their platform checks the website like a normal visitor from servers around the world (in my test case it is Denmark and California) and thereby it looked like normal direct traffic in my data. I excluded their stated server IP-addresses in my Google Analytics filters and that helped. Thanks again guys for the help.
-
Thank you for all your great advice. I will follow them and see how it works.
-
If you are running Wordpress also check what page / pages are being accessed. I have had bots nail my wp-login like that before. If that is the case harden your installation, one thing I have found that stopped it was setting a deny in the htaccess on wp-login / wp-admin.
-
I was having the same problem ( for me it seemed to be Bings ads bot) . I used this guide below and it seems to filter out most of the bot visits.
-
I would check the service providers first just to know for sure they're all coming from the same provider. You can check this by visiting your Audience > Technology > Network report on the left side of your Google Analytics. If you see the same network and browsers being used I would use a filter (only if you're really determined/ 100% sure that it's bot traffic) to get them completely out of your Google Analytics view.
-
It's weird that the bot is accepting cookies, but with a bounce rate that high, I agree it's probably something automated (though it could be people who were looking for something else or were directed there by an email or an app accidentally). You can look through your logs to see IP addresses and then do as Atakala says and block the traffic if you're worried about bandwidth. You can also just filter it out in GA by excluding US traffic (if your'e worried about analytics being messed up).
-
It's probably AWS, which is amazon buyable crawl service.
If ıt costs you too much then try to ban it.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I am based in the UK. I want to appeal to a UK and US market. One of my keywords is 'generalised' which gets way more traffic in my keyword phrase when spelt with a z and not an s. What do I do?
Hi folks. I am based in the UK. I am about to launch a new blog, and I want to appeal to the UK and US markets. One of my primary keywords is 'generalised', which gets way more traffic (as seen using Moz's keyword tool) in my keyword phrase when spelt with a z and not an s. What do I do? Any guidance would be great. I note this has been discussed before, but seemingly without a conclusion. I would really appreciate any help you can provide.
International SEO | | Nobody16165422281340 -
How do you optimise a website for European traffic?
I have a design portfolio website here https://www.nicholsoncreative.com/ which uses a .com but is currently configured through the Search Console to appear in results for Google.co.uk. I am going to be restructuring the website and optimisation and I want to bring in more traffic/enquiries/business from around Europe. As there's no Google.eu, and as Google also serves results based on the searchers geographic location it would seem difficult to structure and optimise content so that results can be found across all of Europe. I assume simply switching to a .eu domain extension for my own website wouldn't solve the problem? I also assume that creating content in different languages would be a logical (if time consuming) option? Are there any other tried and trusted techniques that can be used to target traffic throughout Europe? I'd appreciate any advice.
International SEO | | JCN-SBWD0 -
Multiregional / Multilingual SEO - Subfolders Question
Hello all, I wonder if you can help me... I have a question about subfolders in multi-regional / multi-lingual SEO - more specifically in reference to targeting the UK and the US. Having looked at some global websites these are the types of implementations I've most commonly seen: UK subfolders .com/uk .com/gb .com/gb/en-gb | .com/en-GB .com/gb-en .com/en-gb .com/uk/en US subfolders .com/us .com/us/en-us | .com/en-US .com/us-en .com/en-us .com/us/en Are any of these approaches better than others or is it all a matter of personal preference? What's the reason for using .com/gb over .com/uk (or vice versa) for example? Secondly, my assumption is that the examples above which include language subfolders do so because these companies are targeting different speaking users within these countries. Would I be right to think that since the organisation I work for is only targeting the American speakers in the US, we wouldn't need to go so far as to have language subfolders in addition to location subfolders? Would be great to get some feedback / suggestions! Thanks!
International SEO | | SEOCT0 -
Redirected traffic and SEO problem
Hi all, I have a bit of a search engine predicament and I can't find the answer anywhere. It's a bit of a complicated one so please bear with me 🙂 ... I'm a Freelance Copywriter, I recently started the business, I've also recently moved to New Zealand. As such I'm looking for business back in the U.K. (As that's where my network is), but also locally, in NZ. I've purchased both the .co.uk and .co.nz domain names (http://www.inspirecontent.co.uk and http://www.inspirecontent.co.nz) The way that the domain provider / host has set these up is for one to redirect to another. Currently if someone visits www.inspirecontent.co.nz it redirects to the U.K. Site. That's less than ideal for me, because I dont want NZ traffic (i.e potential leads) to think I'm a U.K. Based business. my questions are as follows: 1. Will the redirect to the U.K. domain prevent me from appearing in NZ search (I.e if someone searches via google.co.nz) I'm really struggling to rank at the moment, I'm working on more content but if the redirect is a problem then I need to know about it so that I can find a work around. 2. Any suggestions on the best approach to the work around? It would be great if the URLs didn't change! So that you wind up from the U.K. on the U.K site, and if you're from NZ, you land on and stay on the NZ domain, but I'm not sure how to achieve that. One option, I think, would be to have two different websites, hosted separately, but I hear that duplicated content is bad for SEO? Thanks all in advance Kind regards
International SEO | | Andrea_howey0 -
Using a top level domain name and directing it to a subfolder
Hi, we have a large international network. Our main website sits on .com domain and is used by the UK market. We have an international site in a subdirectory .com/dk/ for Denmark for example. We have also purchased the domain name www.ourcompany.dk/. Should we be forwarding the domain name (www.ourcompany.dk/) to point to the subdirectory www.ourcomany.com.dk/ so in the browser it shows up as www.ourcompany.dk or should we be displaying it as www.ourcompany.com/dk/? Are there any pros and cons to this method? Which one is best and are there any benefits in SEO. Ideally we want the .com domain name to have the best domain authority so would this impact it in any way? Any tips would be great.
International SEO | | Easigrass0 -
What does it involve when creating subfolders, I believe I may have been given false info
Hi, Please can you help, I believe I may have been given false information about the way sub folders are added to a site. My company are a global company and we would like to start targeting individual country's more effectively with the use of sub folders using our existing domain. However, I have been told by our external web development company that in order to do this we need to create separate websites (eg, www.mycompany.de, www.mycompany.en etc) and then re-direct them to folders within the .com site. Is this the correct way to produce sub folders? If not how is it done? I'm sure that this would be an incredibly expensive venture for us, but yet an incredible profitable one for them.
International SEO | | CoGri0 -
SEO international - ccTLD or Subdirectories / Hosting on 1 server (IP) in Netherlands
Hi All, I do mingle me in discussion if it's better to have an Ecommerce site of a Brand X on seperate ccTLD's (Brand.nl / Brand.de / Brand.com or use subdirectories (brand.com/nl, brand.com/de, brand.com/fr etc. I see a lot of comments on this, but i am missing one (maybe) essential part. We are using Magento with multi ccTLD support. BUT the environment is hosted in the Netherlands. Will we be "penalized" on hosting in NL when using www.brand.DE or other countries? Or is it MUCH better to host those ccTLD in country of Origin? Because if it is, maybe we can better use subdirs because then we can use our builded authority of the root domain. Hope someone have an answer on this one! Thanks! Jeroen
International SEO | | RetailClicks0 -
Geotargeting two locations using root and /country
Hello, I am in the process of turning my UK targeted website into a global website in multiple languages. I will be using the new HREFLANG tag but I'm wondering about geotargeting. I've set this up in Webmaster Tools as: example.com = UK content
International SEO | | Seaward-Group
example.com/us = US content
example.com/de = German content
example.com/es = Spanish content
example.com/fr = French content
example.com/it = Italian content
example.com/nl = Dutch content Will the root UK content override the following sub directories that are set as a different location because its not /uk? Thank you.0