Direct traffic is up 2100% (due to a bot/crawler I believe)
-
Hi,
The direct traffic to website www.webgain.dk has increased by over 2100% recently. I can see that most of it is from US (my target audience is in Denmark and the website is in danish).
What can I do about this? All this traffic gives my website a bounce rate of 99.91% for direct traffic. I believe it is some sort of bot/crawler. -
Already done. They also included the tip in their newsletter for beta-testers.
-
You might want to let them know about this, so they can add in documentation so future users know what is up before panicking.
-
Follow up: I have fixed this now. It was a monitoring tool by Digicure, where I have signed up to be a beta tester. Their platform checks the website like a normal visitor from servers around the world (in my test case it is Denmark and California) and thereby it looked like normal direct traffic in my data. I excluded their stated server IP-addresses in my Google Analytics filters and that helped. Thanks again guys for the help.
-
Thank you for all your great advice. I will follow them and see how it works.
-
If you are running Wordpress also check what page / pages are being accessed. I have had bots nail my wp-login like that before. If that is the case harden your installation, one thing I have found that stopped it was setting a deny in the htaccess on wp-login / wp-admin.
-
I was having the same problem ( for me it seemed to be Bings ads bot) . I used this guide below and it seems to filter out most of the bot visits.
-
I would check the service providers first just to know for sure they're all coming from the same provider. You can check this by visiting your Audience > Technology > Network report on the left side of your Google Analytics. If you see the same network and browsers being used I would use a filter (only if you're really determined/ 100% sure that it's bot traffic) to get them completely out of your Google Analytics view.
-
It's weird that the bot is accepting cookies, but with a bounce rate that high, I agree it's probably something automated (though it could be people who were looking for something else or were directed there by an email or an app accidentally). You can look through your logs to see IP addresses and then do as Atakala says and block the traffic if you're worried about bandwidth. You can also just filter it out in GA by excluding US traffic (if your'e worried about analytics being messed up).
-
It's probably AWS, which is amazon buyable crawl service.
If ıt costs you too much then try to ban it.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Redirected traffic and SEO problem
Hi all, I have a bit of a search engine predicament and I can't find the answer anywhere. It's a bit of a complicated one so please bear with me 🙂 ... I'm a Freelance Copywriter, I recently started the business, I've also recently moved to New Zealand. As such I'm looking for business back in the U.K. (As that's where my network is), but also locally, in NZ. I've purchased both the .co.uk and .co.nz domain names (http://www.inspirecontent.co.uk and http://www.inspirecontent.co.nz) The way that the domain provider / host has set these up is for one to redirect to another. Currently if someone visits www.inspirecontent.co.nz it redirects to the U.K. Site. That's less than ideal for me, because I dont want NZ traffic (i.e potential leads) to think I'm a U.K. Based business. my questions are as follows: 1. Will the redirect to the U.K. domain prevent me from appearing in NZ search (I.e if someone searches via google.co.nz) I'm really struggling to rank at the moment, I'm working on more content but if the redirect is a problem then I need to know about it so that I can find a work around. 2. Any suggestions on the best approach to the work around? It would be great if the URLs didn't change! So that you wind up from the U.K. on the U.K site, and if you're from NZ, you land on and stay on the NZ domain, but I'm not sure how to achieve that. One option, I think, would be to have two different websites, hosted separately, but I hear that duplicated content is bad for SEO? Thanks all in advance Kind regards
International SEO | | Andrea_howey0 -
Duplicate Page Content due to Language and Currency
Hi Folks, hoping someone can help me out please I have a site that I'd like to rank in France and the UK but I'm getting a stack of duplicate content errors due to English and French pages and GBP and EUR prices. Below is an example of how the home page is duplicated: http://www.site.com/?sl=en?sl=fr
International SEO | | Marketing_Today
http://www.site.com/?sl=fr?sl=fr
http://www.site.com
http://www.site.com/?currency=GBP?sl=fr
http://www.site.com/?currency=GBP?sl=en
http://www.site.com/?sl=fr?sl=en
http://www.site.com/?currency=EUR?sl=fr
http://www.site.com/?currency=EUR?sl=en
http://www.site.com/?currency=EUR
http://www.site.com/?sl=en¤cy=EUR
http://www.site.com/?sl=en¤cy=GBP
http://www.site.com/?sl=en
http://www.site.com/?currency=GBP
http://www.site.com/?sl=en?sl=en Each page has the following code in the that updates according to the page you are on: How do I simplify this and what's the correct approach?0 -
How do you get the "real" organic traffic from direct traffic?
Please check the following article: http://www.searchenginejournal.com/study-shows-organic-search-responsible-64-web-traffic/111791/ I hope you guys have some ideas on how to extract the "real" organic traffic from direct. Thanks in advance!
International SEO | | zpm20140 -
.cn domain vs. .com/cn/ folder structure
Hey Moz Community, I'd love to hear your response based on some real world data around leveraging a .cn domain vs. porting the site over to a sub-folder structure (ie. com/cn/ structure). Currently, the site lives on a .cn and is fully translated/localized in simplified chinese - which is the ideal state. As part of a website redesign + cost analysis there is a discussion around moving all global content under a sub-folder structure using href lang, GWT combination to define country content. My question is around China specifically - does a .cn have a signficant impact on ranking? I've read conflicing reports. Secondly, how do Chinese users react to a non-.cn domain? I would imaging the click-through rate performance from SERPs is much lower. Thoughts? Comments?
International SEO | | JonClark150 -
3 month old site lost almost complete traffic overnight
Hi All, I started a Indian coupon and deal site http://www.couponspy.in/ around 3 month ago and traffic increased almost daily. But yesterday my site lost almost all of its traffic. Keywords which ranked 1-5 lost around 4-15 places and keywords which ranked 6-20 lost ca. 20-50 places. The Moz Crawl Diagnostics doesn't indicate any mayor issues. Has there been a Google Panda update in India? Reasons why my site has been affected? Please help!!!! 😉 I have seen the same traffic decrease on other coupon start ups, eg https://www.cuponation.in/ and https://www.cuponation.in/ Did we all make the same mistake? Any guesses?
International SEO | | ParvatiSingh0 -
How to fix the duplicate content problem on different domains (.nl /.be) of your brand's websites in multiple countries?
Dear all, what is the best way to fix the duplicate content problem on different domains (.nl /.be) of your brand's websites in multiple countries? What must I add to my code of websites my .nl domain to avoid duplicate content and to keep the .nl website out of google.be, but still well-indexed in google.nl? What must I add to my code of websites my .be domain to avoid duplicate content and to keep the .nl website out of google.be, but still well-indexed in google.nl? Thanks in advance!
International SEO | | HMK-NL3 -
SEO international - ccTLD or Subdirectories / Hosting on 1 server (IP) in Netherlands
Hi All, I do mingle me in discussion if it's better to have an Ecommerce site of a Brand X on seperate ccTLD's (Brand.nl / Brand.de / Brand.com or use subdirectories (brand.com/nl, brand.com/de, brand.com/fr etc. I see a lot of comments on this, but i am missing one (maybe) essential part. We are using Magento with multi ccTLD support. BUT the environment is hosted in the Netherlands. Will we be "penalized" on hosting in NL when using www.brand.DE or other countries? Or is it MUCH better to host those ccTLD in country of Origin? Because if it is, maybe we can better use subdirs because then we can use our builded authority of the root domain. Hope someone have an answer on this one! Thanks! Jeroen
International SEO | | RetailClicks0 -
Http://us.burberry.com/: Big traffic change for top URL (error 593f1ceb2d67)
Please forgive duplicating this question on the SEOMoz & Webmaster Tools forum but I'm hoping to hit both audiences with this question... A few days ago I noticed that our US homepage (us.burberry.com) had dropped from PR5 to PR0, and the page has been deindexed by Google. After checking Webmaster Tools I also received the following message: http://us.burberry.com/: Big traffic change for top URL April 2, 2012Search results clicks for http://us.burberry.com/ have decreased significantly.Message ID: 593f1ceb2d67.We're not doing any link building at all (we've enough on-site issues to deal with). The only changes I have made are adding Google Analytics to the website, uploading sitemaps via Webmaster Tools (it's not linked to from robots.txt yet), and setting the burberry.com and www.burberry.com geo-location settings to 'unlisted' (we want uk.burberry.com appearing in the UK results, us.burberry.com appearing in the US results etc rather than www.burberry.com).I've reversed the geo-location settings but I doubt this would have caused this. We've duplicate copies of our homepage (such as us.burberry.com/store//) from typos in inbound links (and bad programming that allows them to work rather than 404'ing) but I don't think any of this is new. What I don't understand is (a) why this is happening now and (b) why is this just affecting our US homepage? We've ~40 different duplicates of the homepage (us, uk, ca, pt, ro, sk etc etc) so why is the US site being affected and not the others? Does anyone know if this is due to an algorithm change by Google or something else all together? Background:Our website www.burberry.com has 46 subdomains such as uk.burberry.com, ca.burberry.com and us.burberry.com. There is a lot of duplicate content on each subdomain (including basic things like tracking parameters in URLs) and across subdomains (uk.burberry.com/store & us.burberry.com/store are exactly the same), there's very little text on the site (its nearly all images), as well as poor redirects, inaccessible content (AJAX/Flash) and a whole host of basic SEO things that aren't being done correctly. I've joined the company in the last few months and have started addressing these issues but I've got a LOT of work to do yet.One thing that we have in our favour is a link profile that is as clean and natural as they come - there was only ever one link building campaign performed (which was before my time) and I had all of those links removed as soon as I joined the company.Any help would be greatly appreciated! Thanks for your timeDean RoweEdit: us.burberry.com 301 redirects to us.burberry.com/store/ as explained on the webmaster tools forum, but I don't believe this is the cause as its the same across all subdomains.
International SEO | | FashionLux0