Site under attack from Android SEO bots - expert help needed
-
For last 25 days, we are facing a weird attack on our site.
We are getting 10x the normal mobile traffic - all from Android, searching for our name specifically. We are sure that this is not authentic traffic as the traffic is coming from Organic searches and bouncing off. Initially, we thought this was a DDoS attack, but that does not seem to be the case.
It looks like someone is trying to damage our Google reputation by performing too many searches and bouncing off.
Has any one else faced a similar issue before? What can be done to mitigate the impact on site.
(FYI - we get ~2M visits month on month, 80% from Google organic searches). Any help would be highly appreciated.
-
Just as EGOL describe it.
If you're on Amazon AWS then you can use their CloudFront as CDN. But also you can observe source of traffic. Could coming from one country, one IP range or one user-agent. There should be some kind of pattern and you should investigate it.
Then just need to make rule to block that traffic or just redirect them to one static "hello world" page.
I was also victim of such traffic, but was from humans trying to depleting an AdWords daily budget. Once budget it over ads was stopped showing, after few hours they recalculate clicks, some funds was returned, ads are shown again, they click it, budget is over... and so on.
-
By resetting your DNS to CF, your server is no longer used. All traffic is routed to one of CF's data centers and there are over 100 of them distributed throughout the world.
Also, in the CF settings, you want to "challenge" the visitors from problem countries. This will give them a captcha to complete. When they complete that captcha one time, you can then give them long term access without the challenge. CF will progressively become better at filtering the bots and allowing more trusted visitors in without a challenge.
-
Thanks for your help - this works to a large degree.
Have hit a new challenge though, our AWS servers are in one of these countries which are sending traffic. And we have multiple servers talking to each other enabling Login / other actions on the site.
While I have blocked all the other countries, blocking country with AWS servers is creating problem with Login. Trying to figure this out!
-
If you don't use Firewall, Cloudflare in your situation will have almost no effect.
We used our analytics to determine the countries where the traffic was coming from. Then went into CF FW.
Click the blue Help link for each tool to decide upon the settings that you want to try.
Here is what we used....
Security Level... Medium
Challenge Passage... one day
Access rules.... country name, challenge, this website
Impact of the above.... Many bots already recognized by CF will be blocked. Access rules will present each visitor from those countries a form similar to a captcha. They must pass the captcha to get in.
After you turn this on, watch your short term stats. You should see an increase in blocking.
We ran the above for a few weeks without any obvious SEO impact. Then switched our DNS back to normal, moving away from CF.... but kept the $20/month account and our settings in place. CF was time-consuming to set up.
-
This looks very similar to what we are seeing. We took CloudFlare as well - but stayed with Free account with "Site Under Attack" mode, which should force the visits to verify.
Will it be possible for you to share the settings on CloudFlare? Did you use their Firewall as well? Also, did you see any SEO impact, by any chance?
-
One morning, a few months ago we saw lots of mobile phone traffic building. All was hitting our homepage which is very resource intensive. All of this traffic generated one page view. All of the traffic was coming from a few countries in Asia and Africa. No referrer. Looked like a DDOS attack.
We go to Cloudflare, got a $20/month account, switched DNS to CF, forced untrusted visits from those countries to verify before allowing entry. Squeezed this traffic down to almost nothing within a few hours. Left CF run for a few weeks. Rouge traffic disappeared.
Now we have CF ready to go with all settings in place. Can turn it on in two minutes and have the shield in place as DNS propagates.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
My client redesigned their site. Once it went live, ALL of their rankings disappeared. Even branding. Help?
Does anybody know why this might happen? When we made the new site, we just changed the skins. The source code was the same, the content was the same. Even when I search their brand name and their city, their URL won't show up. When I search their URL into Google, it won't even pull up their homepage: it only pulls up /contact-us and some other subpages. Any tips on what I should be looking out for?
Intermediate & Advanced SEO | | TaylorRHawkins1 -
Need to update Google Search Console profile for http to https change. Will a "change of address" option suffice or do we need to create a new GSC profile?
In the past I have seen most clients create new Google Search Profile when they update to a https URL. However a colleague of mine asked if just updating the change of address option will suffice https://support.google.com/webmasters/answer/83106. Would it be best to just update the change of address for the Google Search Console profile to keep the data seamless? Thanks
Intermediate & Advanced SEO | | RosemaryB0 -
Creating a site search engine while keeping SEO factors in mind
I run and own my own travel photography business. (www.mickeyshannon.com) I've been looking into building a search archive of photos that don't necessarily need to be in the main galleries, as a lot of older photos are starting to really clutter up and take away the emphasis from the better work. However, I still want to keep these older photos around. My plan is to simplify my galleries, and pull out 50-75% of the lesser/older photos. All of these photos will still be reachable by a custom-build simple search engine that I'm building to house all these older photos. The photos will be searchable based on keywords that I attach to each photo as I add them to my website. The question I have is whether this will harm me for having duplicate content? Some of the keywords that would be used in the search archive would be similar or the same to the main gallery names. However, I'm also really trying to push my newer and better images out there to the front. I've read some articles that talk about noindexing search keyword results, but that would make it really difficult for search engines to even find the older photos, as searching for their keywords would be the only way to find them. Any thoughts on a way to work this out that benefits, or at least doesn't hurt me, SEO-wise?
Intermediate & Advanced SEO | | msphotography0 -
Site Speed, is it worth it from a SEO point?
Hi, I understand a site which loads quickly is greater for the user but how does site speed affect rankings? I mean does Google log the speed pages load, the faster it loads the better the signal? So say I have a page which loads in 1.5sec would Google 'Rate' the site better if it loaded in say 0.8sec? Thanks.
Intermediate & Advanced SEO | | followuk0 -
SEO and former site
Hi, my client had a site built and hosted with Avvo but we now shut it down and are using a new server. My concern is that Avvo's internal link structure is causing SEO issues. For example, his site will list for "San Diego Criminal Defense Attorney", but is then removed for no reason. Far worse, while he had the AVVO site, it would never rank at all on Google. He's got great content, and no spammy links. This is the site: www.thesandiegocriminallawyer.com. Any thoughts of what I could do to disavow the AVVO pages that Google still has indexed? Does it matter? Or, is it simply a function of time? Thank you for your help.
Intermediate & Advanced SEO | | mrodriguez14400 -
2 Ecommerce sites & SEO
Hi, i am managing 2 ecommerce sites that sell a lot of identical products. snowsupermarket.co.uk - public webshop shop.snowbusiness.com - trade webshop Should i optimise the 2 sites to target different keywords for all products or, should i keep the keywords the same but, vary the meta data/ description etc. to avoid duplication. Is there a clear argument to have to ecommerce websites ranking high for our products & dominating page 1, even though they will be technically competing against each other? Thanks, Ben
Intermediate & Advanced SEO | | SnowFX0 -
SEO Features of Different Shopping Cart, Need Help on Selecting BEST Cart
I want to move my existing online store to a new Multilanguage Shopping Cart. After reading Andrew Bleakley's review, I have to make a dissisions between the following shopping cart. New to SEO, I will like to have your impressions on there SEO Features and HELP me select the BEST SEO frendly shopping cart. corecommerce: Search Engine Friendly
Intermediate & Advanced SEO | | BigBlaze205
• Entire store is search engine optimized
• Dynamically generates static html pages with clean URL's (no numbers and special characters inside the URL's) for products, categories and custom content pages (ie about us, etc.)
• Auto Generated Meta Tags for your store to create web site page rankings that matter!
• Built in Canonical URL's
• Header tags usage for your product names
• Auto-build of the Google XML Sitemap
• Meta tags for all products, categories and content pages
• Add your own custom meta tags from your store
• You determine the page titles
• You can add custom content for the category pages
• Use of alt and title tags for images
• Use of bread crumb trails
• Customer SEO page slugs (naming) for products and categories americommerce: Have a look at there page, the list is to long. http://www.americommerce.com/ecommerce-seo.html ------------------------------ asho Web Optimisation - SEO
Fully Search Engine Optimised (SEO) structure
Optimised and updated by industry leading SEO experts
Source code optimised for search engines
Page based META management. Titles, descriptions and keywords
Link popularity program between Ashop Commerce customers
Always up to date with new search engine algorithms
Spider friendly URLs
301 Redirect and 302 Redirect support for any page
Free SEO tips & tools
Auto HTML and CSS page generation
Google, Yahoo and Bing verification meta inclusion
Inbuilt automatic XML site map generation (Google, Yahoo, Bing)
Correct use of robots.txt file
Correct use of NOFOLLOW attribute
Auto set up with correct hierarchy for H tags
Auto creation of alt text on menu text links and images
Tableless design structure Pinnaclecart Cutting-edge search engine optimization
Flat URL generation (www.yoursite.com/product/product-name.htm)
Ability to create your own URL structure (www.yoursite.com/create-your-own-url.html)
Manage all URL's at the category, product and page level.
If you're moving from a different application, you can change the URL's to match the old URL's.
Meta keyword, title and description for each product page
Meta keyword, title and description for each category page
Meta keyword and description for home page and all pages created via the control panel
Upload / create robot.txt file
Ability to generate meta tags based on product descriptions
Ability to modify HTML or CSS via browser
Automatically generated site map
Generates XML site map for Google Base
Valid WC3 template design
Image ALT tags
Design generates very lightweight, 100% HTML page without CSS or PHP coding
Creates "breadcrumb" navigation
Search-engine-friendly architecture
Ability to upload customized HTML pages to assist in How would you rate those carts structure in a SEO point of view? My existing store, http://www.filtrationmontreal.com/ (OsCommerce) need SEO improvement and moving it to a SEO Frendly Shopping Cart is the best thing I can do to increase sales and conversions. Thank you for your support, help and precious time. BigBlaze0