Any idea why this page is an absolute magnet for bots?
-
This page on our client's website seems to be an absolute magnet for bots, and it's skewing our Google Analytics stats:
https://cbisonline.com/us/catholic-socially-responsible-esg-investing/proxy-voting/
We already filter out lots of bots in GA, primarily through a segment we created several years ago and continue to build upon, but plenty of spam traffic still manages to slip through – mostly to the page above. Last quarter, almost all of it came from two random cities in Europe, so we're going to filter out traffic from those places. (At least for now – not an ideal solution, I know.)
But I'm really wondering what drives so many bots to that page in particular.
Any insights would be greatly appreciated!
-
I know how painful this can be, first you can filter the bots and exclude the traffic from the analytics so It doesn't mess up with your numbers and stats in analytics. Second, If you somehow able to find out the source of bots block them via robots.txt, third there might be a direct attack by competitors to any of your specific URLs, there are a lot of tools available online for botting.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
UTM Links Showing Up as Separate Pages in Google Analytics
Hey everyone, I was just looking at landing pages in Google Analytics, and in addition to just the URL of the landing page, the UTM links are being listed as separate pages. Is this normal? I anticipated seeing the landing page URL and then using the secondary dimension to see source/medium. If this isn't normal, what would I check next?
Reporting & Analytics | | rachelmeyer0 -
Google Analytics - Next Page Path is the Same URL?
Hey Everyone, I have a Google analytics question. I'm looking through a client's site and when I look at the next page path, I get the same URL as the next path. For example, on the homepage, the next page path I get is the homepage again? This happens for all URL's, is this an implementation error? Is there a way to fix this? Thanks!
Reporting & Analytics | | EvansHunt0 -
800,000 pages blocked by robots...
We made some mods to our robots.txt file. Added in many php and html pages that should not have been indexed. Well, not sure what happened or if there was some type of dynamic conflict with our CMS and one of these pages, but in a few weeks we checked webmaster tools and to our great surprise and dismay, the number of blocked pages we had by robots.txt was up to about 800,000 pages out of the 900,000 or so we have indexed. 1. So, first question is, has anyone experienced this before? I removed the files from robots.txt and the number of blocked files has still been climbing. Changed the robots.txt file on the 27th. It is the 29th and the new robots.txt file has been downloaded, but the blocked pages count has been rising in spite of it. 2. I understand that even if a page is blocked by robots.txt, it still shows up in the index, but does anyone know how the blocked page affects the ranking? i.e. while it might still show up even though it has been blocked will google show it at a lower rank because it was blocked by robots.txt? Our current robots.txt just says: User-agent: *
Reporting & Analytics | | TheCraig
Disallow: Sitemap: oursitemap Any thoughts? Thanks! Craig0 -
Why such a high page rank with so low metrics in OSE
Hi,
Reporting & Analytics | | sebastiankoch
The website is:
www.s123parka123ble.com (remove the 123) All websites I have ever seen with similar metrics in OSE have normally a PR of 2 or 3 or max 4. This one is PR 5 and I would like to know why. I also noticed that they do not redirect the urls without www. to www. Which is normally bad ... can it be good for some reason in this case? It is PR 5 since a long time I just can´t get why it is PR 5. Please have a look. Thanks!0 -
Why did I loose all my product page rankings (e-commerce site)
This friday I noticed that I'd lost pretty much all my product pages in the SERP and also their rankings for the product names. These are products I both have introduced to the market (sweden) and also some that I've been the only one selling. I've analyzed a couple of different ranking-faults. Examples: **"super mario väggdekaler" should rank **http://www.roligaprylar.se/Super-Mario-Vaeggdekaler.html as #1 and has done for several years. Instead this search in my internal search engine ranks #10-#15 with no relevance. www.roligaprylar.se/?q=mario%20v%E4g "jedi morgonrock" should rank www.roligaprylar.se/Jedi-Morgonrock.html as #1 or #2 but instead this url ranks as #12 www.roligaprylar.se/product_detail.php?pid=Jedi-Morgonrock "Charlie sheen bobblehead" (in the swedish serp this should be the most simple term to rank on. previously #1) my internal search engine ranks for #8 with this url <cite>www.roligaprylar.se/?q=Charlie%20Sheen%20Bobblehead</cite>J So I've drawn these conclusions and actions Products that don't rank well longer but still ranks with their alternative non-rewritten url has gotten deep links from affilliates (i track affilliate ids and stuff via this link) and have replaced the original url which is rewritten. Action: Canonical urls for these non-rewritten products to the rewritten version. For example on this product page www.roligaprylar.se/product_detail.php?pid=Jedi-Morgonrock I've placed a canonical for this url www.roligaprylar.se/Jedi-morgonrock.html With the products not ranking at all or when searches in my search engine shows up I suspect some kind of dup content punishment where Google thinks the search result is more important than the product page. Action: All search-pages are now noindex,follow I also increased product name density in terms of keywords on the product page. But I'm still owned and losing tons of money during the holidays (buying adwords at obscene amounts instead hehe). So just wanted to hear with you guys. Are my conclusions and actions correct? What have I missed, what more could I do to reverse this? Thanks Dan
Reporting & Analytics | | nuttinalle0 -
Why Does This Page Rank Badly?
Hi, The page in question is: http://www.toymart.com/details.php?id=1764 The problem is that this and most of the other 10,000 pages used to rank well but now are really struggling.
Reporting & Analytics | | ToyMart3
I am begining to suspect that I have some sort of Google penalty but I cannot know for sure.
I believe I comply with all Google guidelines and I think the SEO is good.
Possibly the eBay affiliate links are the problem but they form a large part of the content and user experience.
The page gives a price guide for items in different conditions and has various other tools for the user. Any thought would be appreciated. Thanks for your time in advance. Alan0 -
How do I find out how well a page converts in Analytics
Hello All, I am looking to find out how well a page converts in Analytics. A simple request you would thing, but no! First off let me list what I don't want to know: I don't want to know the conversion rate of a product I don't want to know the conversion rate based on the landing page What I want to know is how many people click to add the product to their basket on a particular page (which I understand is not strictly the conversion rate, but whatever). So the ways I have tried unsuccessfully are: The Analytics overlay (the in page Analytics thing) - this doesn't work because the "Add to Basket" button is not a link, it is an input. The Navigation Summary - this doesn't work because most of the time the /shopping_cart.php URL doesn't come up in the short list, and if you search for the URL in the search box beneath the percentages get all skewed. The most obvious solution would be Event tracking but I can't get that implemented in the short term. So does anyone have the answer to this most curious of conundrums? Thanking you in advance, Rich
Reporting & Analytics | | tonyatfat0 -
For an optimized site, any available stats / guesstimates on what is avg % of traffic to homepage vs. second-level pages?
I'm interested in passing this info on to a client who experienced a period of time when an incorrect GA code was installed on their homepage. They were able to get Google stats on second level pages only. This is a site that gets 80 + % of visits from organic search engine referrals. They do minimal advertising. Thanks in advance.
Reporting & Analytics | | alankoen1230