Any idea why this page is an absolute magnet for bots?
-
This page on our client's website seems to be an absolute magnet for bots, and it's skewing our Google Analytics stats:
https://cbisonline.com/us/catholic-socially-responsible-esg-investing/proxy-voting/
We already filter out lots of bots in GA, primarily through a segment we created several years ago and continue to build upon, but plenty of spam traffic still manages to slip through – mostly to the page above. Last quarter, almost all of it came from two random cities in Europe, so we're going to filter out traffic from those places. (At least for now – not an ideal solution, I know.)
But I'm really wondering what drives so many bots to that page in particular.
Any insights would be greatly appreciated!
-
I know how painful this can be, first you can filter the bots and exclude the traffic from the analytics so It doesn't mess up with your numbers and stats in analytics. Second, If you somehow able to find out the source of bots block them via robots.txt, third there might be a direct attack by competitors to any of your specific URLs, there are a lot of tools available online for botting.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Analytics is treating my blog like all the content is just on the home page.
Hello all, I installed Google Analytics on a main website and a blog (blog.travelexinsurance.com) While it appears to be tracking correctly (and when I test it in real time it shows that I'm visiting) but it is treating the entire blog as though it's one page. So I can't see data on blog post X. All I see is that X visitors came to my blog in aggregate. So I see blog.travelex.com has 999 visitors, but it doesn't show that /travel-luggage got 50 visits, while /insurace-tips got 75 and so forth. I assume I screwed up the tracking somehow, but can't figure out where I went wrong. Tracking on the main domain works just fine. It's specific to the blog.
Reporting & Analytics | | Patrick_G0 -
I have few similar job forms that were created for different positions. SEOMoz says, its "duplicate pages". So how do I resolve it? I want my jobs to be searchable in Search Engines.
Hi There, I have few similar job forms that were created for different positions. SEOMoz says, its "duplicate pages". So how do I resolve it? I want my jobs to be searchable in Search Engines. Thanks !
Reporting & Analytics | | pointstar0 -
Figuring Out the Source of "direct traffic" by looking at landing page parameters
I have a client who runs an e-commerce website, and I noticed that 40% of his traffic and 25% of his sales are all attributable to Direct Traffic. At first, I tried to solve this problem by tagging all of the previously untagged links in his e-newsletter, which I expect to be very helpful. However, then I looked at the landing pages for his direct traffic, and I see that it is almost entirely filled with thousands of unique URLs that begin with a question mark followed by the name of his e-newsletter or shopping cart vendor. It would be the equivalent of having a url like the following: "www.willmarlow.com/?constantcontact=keya;sldkfjsdlfkjdf;sldkjf" If we have this amount of information in the link, shouldn't there be a way to add additional parameters to the URL to move this traffic out of the Direct column? Has anyone encountered this before? Thanks.
Reporting & Analytics | | williammarlow0 -
2 days in the past week Google has crawled 10x the average pages crawled per day. What does this mean?
For the past 3 months my site www.dlawlesshardware.com has had an average of about 400 pages crawled per day by google. We have just over 6,000 indexed pages. However, twice in the last week, Google crawled an enormous percentage of my site. After averaging 400 pages crawled for the last 3 months, the last 4 days of crawl stats say the following. 2/1 - 4,373 pages crawled 2/2 - 367 pages crawled 2/3 - 4,777 pages crawled 2/4 - 437 pages crawled What is the deal with these enormous spike in pages crawled per day? Of course, there are also corresponding spikes in kilobytes downloaded per day. Essentially, Google averages crawling about 6% of my site a day. But twice in the last week, Google decided to crawl just under 80% of my site. Has this happened to anyone else? Any ideas? I have literally no idea what this means and I haven't found anyone else with the same problem. Only people complaining about massive DROPS in pages crawled per day. Here is a screenshot from Webmaster Tools: http://imgur.com/kpnQ8EP The drop in time spent downloading a page corresponded exactly to an improvement in our CSS. So that probably doesn't need to be considered, although I'm up for any theories from anyone about anything.
Reporting & Analytics | | dellcos0 -
Homepage on page 2 for site:domain
Hi all, today I noticed that our homepage is located on page 2 if you do the site:domain query. As far as I know, the site:domain results mirror the importance in the eyes of Google. Some time ago, our homepage was the first result. I have to say that we do not often have changing elements or new content on the homepage, it is more like a static page. But still the most linked to page on the domain... What conclusion can I come to? Is our homepage of lower importance to Google than some time ago? Is it a problem for SEO? As we backed down our advertisments, the traffic from branded keywords fell the last months - could this be an explanation? And, most important: do I have to worry? (Besides, the SEO-traffic is fine and growing..)
Reporting & Analytics | | accessKellyOCG0 -
Ideas for a strange surge in direct traffic
Being the type of person that can't stop checking my Google Analytics, I noticed this morning that between the hours of 12 and 2 central time last night I recieved a strange surge of direct traffic. My site typically gets around 40 direct visits per day (most of them coming during peak hours around the time people are getting off of work). I received 150 direct visits during this random time in the middle of the night. My bounce rate soared as almost every visit was a bounce. The visitors locations are spread out as if it is natural human traffic. Every single one of the visitors is using a chrome browser. Has anyone else run into something like this? All I can think of is that someone might have an addon or toolbar for chrome that linked to my site for a while in a way that caused unsuspecting visitors to end up on my page. For now I'm keeping my fingers crossed and hoping the traffic doesn't return, as it could be bad news for my Adsense. *Edit: Also of particular interest, each direct visit went to an internal page on my site and no two of the 150 visits went to the same internal page. I also added an image showing a normal complete day's direct traffic and my direct traffic for today so far (The bulk of the surge came yesterday but the shot from today illustrates the surge better because it is missing my naturally daily direct traffic that comes in the afternoon) heXFb#LiiEr
Reporting & Analytics | | pattersonla0 -
Posting on blog comments with anchor text on high ranked pages effective?
So i've identified some blogs which have a fairly high ranking and lots of traffic. They also allow anchor text in the name field. Does it make sense for me to comment on these blogs, or does google treat these with less authority that true page links? Any advice is greatly appreciated! TIA
Reporting & Analytics | | symbolphoto0 -
Is 10 Keyword Targets for Page Rank too many?
My client has selected 10 keywords that they want to rank on the first page of Google for. Is 10 keywords too many to try and rank for? I have heard that you should focus on top 5 keywords instead.
Reporting & Analytics | | dseasterling0