Bing seriously hitting our website
-
Hi
I have a strange query, Bing in the last four weeks have been seriously crawling our site, and while at the moment this isn't affecting our servers, coming into the busy time of the year I am just wondering if anyone else is seeing this.
They are basically crawling the entire site (including nofollow pages) even though according to Bing Webmaster tools, they know our sitemap.
Is anybody else seeing any unusual activity with the Bing bot.
Thanks
Andy
-
long time ago I saw that on a client website - as german we could block bingbot in robots.txt with no risk to loose traffic.
I don't know why but the server was highly stressed by bing bot.
So yes I saw something like that - a little bit more than a year ago - but I wasn't interested in the "why?" - I just blocked the bot.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why my website disappears for the keywords ranked, then reappears and so on?
Hello to everyone. In the last 2 weeks my website emorroidi.imieirimedinaturali.it has a strange behavior in SERP: it disappears for the keywords ranked and then reappears, and so on. Here's the chronicle of the last days: 12/6: message in GWT: Improvement of the visibility of the website in search. 12/6 the website disappears for all the keywords ranked 16/6 the website reappears for all the keywords ranked with some keywords higher in ranking 18/6 the website disappears for all the keywords ranked 22/6 the website reappears for all the keywords ranked 24/6 the website disappears for all the keywords ranked... I can't explain this situation. Could it be a penalty? What Kind? Thank you.
Intermediate & Advanced SEO | | emarketer0 -
Changing website framework: Any negative SEO ramifications?
Hello! We have a website that is built using Asp.net. My colleague and I are wondering whether or not changing the framework from Asp.net to php or html would have any negative impact on current rankings. My colleague was told by an SEO company that doing this would have a big negative effect, but we just can't see why that would be. The URLs of the site do not have an .asp extension, so we don't feel there would be any issues with 404s after the migration. The content, meta data and URL structure would remain the same. We posted this question in the Webmaster Central Forum and were told by a top contributor that it wouldn't have any negative impact, but we wanted a second opinion here. Thanks!
Intermediate & Advanced SEO | | BBEXNinja0 -
Penguin hit Website - Moving to new domain
Hey! I am working on a Penguin hit Website. Still ranking for all brand keywords and blog articles are still being returned in Google SERPs, but the website is showing up for only 3 or 4 money keywords. It is clearly a penguin hit as it was ranked 1st page for all money keywords before latest update (3.0). We already did a link cleanup and disavowed all bad backlinks. Still, the recovery process could take over 2 years from previous experience, and in 2 years, the site will suffer a slow death. Solution: We own the .com version of the domain, currently being served on the .net. We bought the .com version about 6 years ago, it is clean and NOT redirected to the .net (actual site). We were thinking about moving the whole Website to the .com version to start over. However, we need to make sure Google doesn't connect the 2 sites (no pagerank flow). Of course Google will notice is the same content, but there won't be any pagerank flowing from the old site to the new one. For this, we thought about the following steps: Block Googlebot (and only googlebot) for the .net version via robots.txt. Wait until Google removes all URLs from the index. Move content to the .com version. Set a 301 redirect from .net to .com (without EVER removing the block on googlebot). Thoughts? Has anyone went over this before? Other ideas? Thanks!
Intermediate & Advanced SEO | | FedeEinhorn0 -
Why is my website not ranking? Has A grade on-site from Moz.
I have a website that I am trying to get to up the SERPs. However the site isn't appearing in the search - even when I search for the business name. The site is http://www.jl-engineering.com/ The keyword targeted is DPF Cleaning. Could anyone explain to me why the site isn't showing at all - and how to fix this? Thanks
Intermediate & Advanced SEO | | SWD.Advertising0 -
Weird meta description for website launch
Hi all, We just launched a new website: http://www.allwatchapps.com/ There is no link yet, but everything seems allright in google webmaster tools: everypage seems to be indexed, and content keywords are good. However, when I search for "allwatchapps" in google, I got a meta description for the homepage: 26 mai 2014 - Contact. : + 33 (0)6.33.27.78.63 : info@allwatchapps.com : Grenoble - Lyon - Chambéry - Annecy - Paca - Paris ... It is the date of the page, which I want to disable (where does it com from?! I use Yoast SEO plugin and didn't find the option), and the footer contact info, why is that?... Thanks, best, Benoit.
Intermediate & Advanced SEO | | 2MSens0 -
Is Amazon EC2 a viable solution for Wordpress websites?
I'm getting very interested in Amazon Web Services lately as an alternative to reseller hosting. Anyone have experience on their cloud with Wordpress sites? Would be nice to be able to spin up sites to faster service if needed, but not sure if its more pricey and not ready for that adoption yet.
Intermediate & Advanced SEO | | williammarlow1 -
How would the rich snippets be treated in AJAX website?
Hi guys We have started to rewrite our website http://www.edamam.com on AJAX, and the idea is to have all the website on AJAX in the next few months. Although it would probably be difficult to index even with the Google Crawling protocol, and some other issues might appear, the engineers insist that from technology point of view this is the best way to go. We have already rewritten the internal search result pages, e.g. http://www.edamam.com/recipes/pasta and last week we set the Google Crawling protocol for AJAX to some of the individual recipe pages to test it. I'd like to ask for you opinion on whether the rich snippets we have in the search results will be affected by this change? Are there specific actions we need to take to preserve them? What other hot tips you have for dealing with AJAX on any level of the website? Thanks in advance Lily
Intermediate & Advanced SEO | | wspwsp0 -
SEO Audit Strategy For A Complex Website?
I am looking for a list of SEO audit tools and strategies for a complex website. The things I am looking for include (but not limited to): finding all the subdomains of the website listing all the 301's, 302's, 404's, etc finding current canonical tags suggesting canonical tags for certain links listing / finding all current rel=nofollow's on the website listing internal links which use & don't use 'www.' finding duplicate content on additional domains owned by this website I know how to find some of the items above, but not sure if my methods are optimal and/or the most accurate. Thank you in advance for your input!
Intermediate & Advanced SEO | | CTSupp0