Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Bing seriously hitting our website

Intermediate & Advanced SEO

417

Andy-Halliday last edited by

Hi

I have a strange query, Bing in the last four weeks have been seriously crawling our site, and while at the moment this isn't affecting our servers, coming into the busy time of the year I am just wondering if anyone else is seeing this.

They are basically crawling the entire site (including nofollow pages) even though according to Bing Webmaster tools, they know our sitemap.

Is anybody else seeing any unusual activity with the Bing bot.

Thanks

Andy
1 Reply Last reply
Reply Quote 0
paints-n-design last edited by

long time ago I saw that on a client website - as german we could block bingbot in robots.txt with no risk to loose traffic.
I don't know why but the server was highly stressed by bing bot.
So yes I saw something like that - a little bit more than a year ago - but I wasn't interested in the "why?" - I just blocked the bot.
1 Reply Last reply
Reply Quote 0

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

If my website do not have a robot.txt file, does it hurt my website ranking?

After a site audit, I find out that my website don't have a robot.txt. Does it hurt my website rankings? One more thing, when I type mywebsite.com/robot.txt, it automatically redirect to the homepage. Please help!
Intermediate & Advanced SEO | | binhlai

0
Best Sitemap for Large Website

i have more than 3500 pages on my website. Please let me know the best sitemap plugin for my website.
Intermediate & Advanced SEO | | Michael.Leonard

1
Schema.org Data Appears on Website

Hello Moz World, I would like to incorporate Schema Data onto my website. My website has Meta tags in the of the document, which incorporates our keywords. And, in the footer, I have my businesses address, logo and other relevant information. Everything flows because it is stylized using CSS. When I input the schema.org data it appears on the website as text w/ a hyperlink. See Code: My Company
DESCRIPTION. STREET
CITY
STATE
ZIP
United States
Phone: NUMBER I've tried to put it inside the head, body & footer of the HTML code. I want my website to show up properly through Google Structured Data Testing Tool however, I don't want the text to show up on my website not stylized. It sticks out like a soar thumb no matter where I incorporate it. My questions are; Should I even bother with Schema.org? And, is there a way to incorporate it into my website so it does not show up and Google can still pull it up? Thanks ahead of time for all of the awesome responses! B/R Will H.
Intermediate & Advanced SEO | | MarketingChimp10

0
Website Not Ranking Organically - Not Links, Not Domain Authority...

This is regarding the domain: http://lesliekays.com We got a new client about 5 months back who had a website that was hacked. It took several months, but we've cleaned up most of the spammy links and completely rebuilt their website. We have been successful with every other client that we have ever done getting our customers to rank well organically, but we just can't figure this one out. I'm willing to offer a REWARD to the single person who can figure this out for us. (Let's not get carried away, a small reward). This customer has great quality links to their site too. We are looking for answers other than: 1. Backlinks 2. Content 3. Malware 4. Domain or Page authority 5. 404 errors 6. We have utilized Googles Webmaster tools endlessly It is something else and we can not identify it! Let me know what you think! I will give a public shout out to the person who helps us identify this issue!
Intermediate & Advanced SEO | | Tosten

0
Rel=canonical on pre-migration website

I have an e-commerce client that is migrating platforms. The current structure of their existing website has led to what I would believe to be mass duplicate content. They have something north of 150,000 indexed URLs. However, 143,000+ of these have query strings and the content is identical to pages without any query string. Even so, the site does pretty well from an organic stand point compared to many of its direct competitors. Here is my question: (1) I am assuming that I should go into WMT (Google/Bing) and tell both search engines to ignore query strings. (2) In a review of back links, it does appear that there is a mish mash of good incoming links both to the clean and the dirty URLs. Should I add a rel=canonical via a script to all the pages with query strings before we make our migration and allow the search engines some time to process? (3) I'm assuming I can continue to watch the indexation of the URLs, but should I also tell search engines to remove the URLs of the dirty URLs? (4) Should I do Fetch in WMT? And if so, what sequence should I do for 1-4. How long should I wait between doing the above and undertaking the migration?
Intermediate & Advanced SEO | | ExploreConsulting

0
Urls in Bilingual websites

1-I have a bilingual website. Suppose that I am targeting a page for keyword "book" and I have included it in that page url for the English version: English version: www.abc.com/book Can I use the translation of "book" in the second language of the website url instead of "book" ? Please let me know which of the following urls are right " French Verison: www.abc.com/fr/book or www.abc.com/fr/livre livre=Book in French 2- Does Google have any tool to check if the second language page of the website has exactly the same content as the English version. What I want to do is for example for a certain page in English version, my targeted keyword is "book" . So my content would be around books. But in the French version of this page, I want to focus on keyword "Pencil" in French instead of "book". Is it wrong or any consequences? That was the main reason for the question number one. Because if it is ok to do what I explained in item 2 then I will set my urls like: In English : www.abc.com/book In French: www.abc.com/fr/crayon crayon=Pencil in French
Intermediate & Advanced SEO | | AlirezaHamidian

0
Using author on every page of website?

I'm currently get to grips with schema and one thing im using is author on my blog posts and seeing my photo etc on organic searches which are related. I see one of my competitors is using author on every page on their website, not just blog posts etc. Are there any recommendation when it should be used? Should it be site wide or is it really intended for blog posts etc? Would it be wrong for me to use on every page of my website as one of my businesses is myself as a lone person? This is what you get when searching for driving lessons in just about any town! https://www.google.co.uk/#gs_rn=15&gs_ri=psy-ab&tok=LS_DOrAHswmHC9_8AJZEJA&suggest=p&pq=driving instructor brighton&cp=20&gs_id=1k2&xhr=t&q=driving+lessons+crawley&es_nrs=true&pf=p&sclient=psy-ab&oq=driving+lessons+craw&gs_l=&pbx=1&bav=on.2,or.r_cp.r_qf.&bvm=bv.47244034,d.d2k&fp=45c2f917e11bca99&biw=1680&bih=843 Any comments welcome! Antony
Intermediate & Advanced SEO | | Ant71

0
URL strategy mobile website

Hello everyone, We are facing a challenging decision about where our website (Flash Gaming website) is going. We are in the process of creating html5 games in the same theme of the flash games that we provide to our users. Now our main concern is to decide how to show this new content to the user? Shall we create brand new set of urls such as : http://www.mydomain.com/games/mobile/kids/ Or shall we adapt the main desktop url : http://www.mydomain.com/games/kids/ and show the users two different versions of the page depending on whether they are using a mobile device (so they see a mobile version) or a pc/laptop (so they a see desktop version). Or even redirect people to a sub-domain : http://m.mydomain.com/ The main idea we had is to keep the same url structure, as it seems that google is giving the same search results if you are using a mobile device or not. And creating a new set of urls or even a sub-domain, may involve a lot of work to get those new links to the same PA as the desktop URL that is here and know since a while now. Also the desktop page game should not be accessible to the mobile devices, so should this be redirected (301?) to the mobile homepage of the site? But how google will look at the fact that one url is giving 2 different contents, CSS etc, and also all those redirects might look strange... we are worried that doing so will hurt the page authority and its ranking ... but we are trying to find the best way to combine SEO and user experience. Any input on this will be really appreciated. Cheers,
Intermediate & Advanced SEO | | drimlike

0