Direct traffic is up 2100% (due to a bot/crawler I believe)
-
Hi,
The direct traffic to website www.webgain.dk has increased by over 2100% recently. I can see that most of it is from US (my target audience is in Denmark and the website is in danish).
What can I do about this? All this traffic gives my website a bounce rate of 99.91% for direct traffic. I believe it is some sort of bot/crawler. -
Already done. They also included the tip in their newsletter for beta-testers.
-
You might want to let them know about this, so they can add in documentation so future users know what is up before panicking.
-
Follow up: I have fixed this now. It was a monitoring tool by Digicure, where I have signed up to be a beta tester. Their platform checks the website like a normal visitor from servers around the world (in my test case it is Denmark and California) and thereby it looked like normal direct traffic in my data. I excluded their stated server IP-addresses in my Google Analytics filters and that helped. Thanks again guys for the help.
-
Thank you for all your great advice. I will follow them and see how it works.
-
If you are running Wordpress also check what page / pages are being accessed. I have had bots nail my wp-login like that before. If that is the case harden your installation, one thing I have found that stopped it was setting a deny in the htaccess on wp-login / wp-admin.
-
I was having the same problem ( for me it seemed to be Bings ads bot) . I used this guide below and it seems to filter out most of the bot visits.
-
I would check the service providers first just to know for sure they're all coming from the same provider. You can check this by visiting your Audience > Technology > Network report on the left side of your Google Analytics. If you see the same network and browsers being used I would use a filter (only if you're really determined/ 100% sure that it's bot traffic) to get them completely out of your Google Analytics view.
-
It's weird that the bot is accepting cookies, but with a bounce rate that high, I agree it's probably something automated (though it could be people who were looking for something else or were directed there by an email or an app accidentally). You can look through your logs to see IP addresses and then do as Atakala says and block the traffic if you're worried about bandwidth. You can also just filter it out in GA by excluding US traffic (if your'e worried about analytics being messed up).
-
It's probably AWS, which is amazon buyable crawl service.
If ıt costs you too much then try to ban it.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Traffic drop after hreflang tags added
We operate one company with two websites each serving a different location, one targeting EU customers and the other targeting US customers. thespacecollective.com (EU customers) thespacecollective.com/us/ (US customers) We have always had canonical tags in place, but we added the following hreflang tags two weeks ago (apparently this is best practice); EU site (thespacecollective.com) US site (thespacecollective.com/us/) Literally the same day we added the above hreflang tags our traffic dropped off a cliff (we have lost around 70-80% on the EU site, and after a minor recovery, 50% on the US site). Now, my first instinct is to remove the tags entirely and go back to just using canonical, but if this is truly best practice, that could do more damage than good. This is the only change that has been made in recent weeks regarding SEO. Is there something obvious that I am missing because it looks correct to me?
International SEO | | moon-boots0 -
International SEO - Alternatives to Automatic IP re-direct
Hello, When doing international SEO I've read that it's not good practice to automatically re-direct users to the correct part of the website based on their IP address. But what alternatives are there to this? Let's say you're targeting the US and the UK through multiregional SEO. What can you do to ensure that users from the US go to the US sub-directory and that users from the UK go to the UK sub-directory? In Moz's international SEO guide it says that: "If you choose to try to guess at the user’s language preference when they enter your site, you can use the browser’s language setting or the IP address and ask the user to confirm the choice. Using JavaScript to do this will ensure that Googlebot does not get confused. Pair this with a good XML sitemap and the user can have a great interaction. Plus, the search engines will be able to crawl and index all of your translated content." Can anyone explain this further? Any help would be much appreciated! Thanks in advance
International SEO | | SEOCT0 -
Why are some regions/countries not indexing correctly?
Hi All, Recently I've added different regions (website.com/se/ etc) to Google search console and pointed them to their relevant countries, but only half are working when I search from a regions IP with a VPN and use the correct Google search ( Google.se etc ). Will this correct over time? or is something else causing them not to be indexed up correctly? Thanks in advance <colgroup><col width="81"><col width="104"></colgroup>
International SEO | | WattbikeSEO
| Country | Appear in SERP 17/12/2018 |
| AU | TRUE |
| CZ | TRUE |
| DK | TRUE |
| HK | TRUE |
| IE | TRUE |
| IT | TRUE |
| KR | TRUE |
| NL | TRUE |
| NZ | TRUE |
| SE | TRUE |
| SG | TRUE |
| US | TRUE |
| ZA | TRUE |
| AE | FALSE |
| AT | FALSE |
| CH | FALSE |
| CN | N/A |
| DE | FALSE |
| EE | FALSE |
| ES | FALSE |
| FI | FALSE |
| FR | FALSE |
| GB | FALSE |
| GR | FALSE |
| JP | FALSE |
| NO | FALSE |
| PL | FALSE |
| RU | FALSE |
| SI | FALSE |
| TR | FALSE |0 -
.cn domain vs. .com/cn/ folder structure
Hey Moz Community, I'd love to hear your response based on some real world data around leveraging a .cn domain vs. porting the site over to a sub-folder structure (ie. com/cn/ structure). Currently, the site lives on a .cn and is fully translated/localized in simplified chinese - which is the ideal state. As part of a website redesign + cost analysis there is a discussion around moving all global content under a sub-folder structure using href lang, GWT combination to define country content. My question is around China specifically - does a .cn have a signficant impact on ranking? I've read conflicing reports. Secondly, how do Chinese users react to a non-.cn domain? I would imaging the click-through rate performance from SERPs is much lower. Thoughts? Comments?
International SEO | | JonClark150 -
Why has there been Massive increase in traffic to my clients .eu site after redirects were initiated?
Hi guys, This is a strange one thats really bugging me. I have a client that redirected their domain to a brand new domain that was already live for the previous two months. I have been trying analyse the data however I can't quite understand why there is a massive increase in visitors from the United States when the old site was redirected. The redirection took place at the beginning of July. It was badly managed in terms of the mapping of 301 redirects however thats not the issue here. The level of traffic is gradually decreasing I imagine due to the high level of bounces. The site in question is an EU funded website for education. The old site in the first 2 weeks of June received around 500 visits from the USA while the new site in the first 2 weeks of July (2 weeks into the redirects) received around 3,000 visits from the USA. The new site had previously received only 300 visits for the same period as the old site in the 1st 2 weeks of June. Any idea why this might be? Thanks Rob
International SEO | | daracreative0 -
Is .in domain affecting international traffic inflow to my site?
My holiday website http://seekandhide.in/ was completed and went live in Feb 2012. Last month I got 83% traffic from India and 3-5% each from USA and UK. The rest is a mixed bag from other countries. This is largely the trend since the last 3-4 months. I want to attract more organic traffic from UK and rest of Europe. My SEO consultant says that with a .in domain that will be difficult. My website currently features unique holiday properties in India that typically attract European tourists so I don't think it is a product issue. But both website visits and sales enquiries remain primarily Indian even though total number of visitors have increased gradually over the last 6 months.. My queries are 1. Is it only the .in domain that's affecting inflow of international traffic? 2. Is there anything that I can do to offset it? 3. I own seekandhide.co.uk too. Is there something I can do with that site without building a whole different website there? If I shift completely to .co.uk, I will have the same issue of being geographically limited and end up losing Indian traffic. 4. Is there something else that is not ok on the site that I am missing? 5. Advice that I get from a lot of consultants is to buy seekandhideindia.com but I plan to add international properties in a couple of years so that name would limit my appeal. Thanks in advance! Sudha
International SEO | | Sudha_Mathew0 -
SEO international - ccTLD or Subdirectories / Hosting on 1 server (IP) in Netherlands
Hi All, I do mingle me in discussion if it's better to have an Ecommerce site of a Brand X on seperate ccTLD's (Brand.nl / Brand.de / Brand.com or use subdirectories (brand.com/nl, brand.com/de, brand.com/fr etc. I see a lot of comments on this, but i am missing one (maybe) essential part. We are using Magento with multi ccTLD support. BUT the environment is hosted in the Netherlands. Will we be "penalized" on hosting in NL when using www.brand.DE or other countries? Or is it MUCH better to host those ccTLD in country of Origin? Because if it is, maybe we can better use subdirs because then we can use our builded authority of the root domain. Hope someone have an answer on this one! Thanks! Jeroen
International SEO | | RetailClicks0 -
How well does Google's crawlers understand foreign websites?
I speak 5 languages and therefore have the opportunity to do on-page SEO and content writing for 5 different cultures. This question to me has much to do with the way Google translator works. It doesn't, trust me! Which then makes me wonder how the web crawlers, which are designed with English in mind, can fairly and equally attribute the same ranking points to a foreign website. Since Google seems to use sematic search technology I'm wondering if foreign sites have it easier or not. Any ideas?
International SEO | | MassivePrime0