Google Indexed = 35, 445 pages, Bing Indexed = 243 pages... Why?
-
Dear MozSquad,
Can anyone check our site and let me know if there's anything super apparent that would cause Bing to treat us like a bum on the street? I recently made some structural changes which really helped with Google, but Bing didn't even budge. It's a lot harder to keep up with all the SEO initiatives I have in mind with it being a small start-up where I'm responsible for planning the entire Internet Marketing campaign, giving constant input on UX and site design, etc on top of 900 other things, so I figured it'd be a good time to use The Moz to help a brother out. Ideas?
Domain: homeandgardendesignideas.com (yeah, I know it's a little long =P)
-
Certainly no issues for Bing, they're actually hitting us more than Google.
| 2 | 102718 | 7.22% | Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) |
| 3 | 75772 | 5.33% | Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) | -
Mike,
I think that actually did give me some pretty good insight which I hadn't thought of when I was initially considering methods to answer this question.
After digging into the index with some filters, what I'm seeing is that Bing is clearly lagging far behind Google regarding the speed in which they're picking up on changes. I'm looking at piles of things that were changed and re-structured weeks (or even a couple months) ago and it hasn't picked them up at all. I don't think it's a problem on my end, because Google clearly has no problem crawling me. I guess I'll need to double-check the server logs and see what Bingbot's habits are.
I've always assumed they would be equal in how long t takes to update their indexes, etc and that they'd simply have slightly different algorithms, but looks like Goog/Bingie may differ much more in operation than I thought.
-
Maybe give this Bing Index Explorer tool a whirl?
"The Index Explorer tool in the Reports & Data section provides you with a unique view of how Bing sees your site. It reflects all the URLs we have seen on the web, including redirects, broken links, or those blocked by robots.txt, organized in an file explorer-like fashion. This view can help you get some really detailed insights into how your site was seen by the search engine during recent crawls. It can help discover both issues on your site as well as opportunities."
Hope this helps.
Mike
-
I should have mentioned, I setup Bing Webmaster Tools originally and have kept up-to-date sitemaps in it for the past 3 or 4 months.
I've always noticed Bing to kind of lag behind Google, but I'm really surprised to only see ~500 pages indexed. I was once hired to do the SEO for an auto dealer who had dirty SEO and keyword stuffing all over his poorly structured site and I remember Bing being much more responsive to their site than they are to ours, even though they didn't even have BWMT setup prior to my involvement. Weird.
-
Bing seems to always index much slower than Google, but agree with Mike. Anything you can do to help Bing crawl your site, do it.
-
Did you submit a new sitemap in your Bing Webmaster Tools?
Mike
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google ranking content for phrases that don't exist on-page
I am experiencing an issue with negative keywords, but the “negative” keyword in question isn’t truly negative and is required within the content – the problem is that Google is ranking pages for inaccurate phrases that don’t exist on the page. To explain, this product page (as one of many examples) - https://www.scamblermusic.com/albums/royalty-free-rock-music/ - is optimised for “Royalty free rock music” and it gets a Moz grade of 100. “Royalty free” is the most accurate description of the music (I optimised for “royalty free” instead of “royalty-free” (including a hyphen) because of improved search volume), and there is just one reference to the term “copyrighted” towards the foot of the page – this term is relevant because I need to make the point that the music is licensed, not sold, and the licensee pays for the right to use the music but does not own it (as it remains copyrighted). It turns out however that I appear to need to treat “copyrighted” almost as a negative term because Google isn’t accurately ranking the content. Despite excellent optimisation for “Royalty free rock music” and only one single reference of “copyrighted” within the copy, I am seeing this page (and other album genres) wrongly rank for the following search terms: “free rock music”
On-Page Optimization | | JCN-SBWD
“Copyright free rock music"
“Uncopyrighted rock music”
“Non copyrighted rock music” I understand that pages might rank for “free rock music” because it is part of the “Royalty free rock music” optimisation, what I can’t get my head around is why the page (and similar product pages) are ranking for “Copyright free”, “Uncopyrighted music” and “Non copyrighted music”. “Uncopyrighted” and “Non copyrighted” don’t exist anywhere within the copy or source code – why would Google consider it helpful to rank a page for a search term that doesn’t exist as a complete phrase within the content? By the same logic the page should also wrongly rank for “Skylark rock music” or “Pretzel rock music” as the words “Skylark” and “Pretzel” also feature just once within the content and therefore should generate completely inaccurate results too. To me this demonstrates just how poor Google is when it comes to understanding relevant content and optimization - it's taking part of an optimized term and combining it with just one other single-use word and then inappropriately ranking the page for that completely made up phrase. It’s one thing to misinterpret one reference of the term “copyrighted” and something else entirely to rank a page for completely made up terms such as “Uncopyrighted” and “Non copyrighted”. It almost makes me think that I’ve got a better chance of accurately ranking content if I buy a goat, shove a cigar up its backside, and sacrifice it in the name of the great god Google! Any advice (about wrongly attributed negative keywords, not goat sacrifice ) would be most welcome.0 -
Google changing my Title
I noticed today that Google is showing a different Title in searches for the homepage. It is showing a title which I believe was active as of late last year or early January. The new title is in the title tag, in Google cache and in MOZ crawls as well. Not sure why it would still be showing a different title in the search and wanted to see if anyone can explain the reason. Thanks
On-Page Optimization | | campaigneast0 -
Building a new page: What on-page SEO would you build in?
Hi all, Building a new page for a fairly competitive keyword. Need to make sure the on-page SEO is pretty top notch, because link building (including internal links) will be difficult. I've optimised the meta description, the alt tags and image names, and included the keyword in the Title Tags. Not a great deal I can do with regards to optimising for mobile or considering migrating to the AMP project because this is handled externally. What else would you suggest? Cheers in advance, Rhys
On-Page Optimization | | SwanseaMedicine1 -
Google Index HTTPS
Hi,
On-Page Optimization | | JohnHuynh
I had a HTTP protocol file which indexed. Now I want to change this file to HTTPS protocol. I wonder that is there any effects?
I don't know HTTPS would be indexed by google or not? Thanks,0 -
I have more pages in my site map being blocked by the robot file than I have being allowed to be crawled. Is Google going to hate me for this?
Using some rules to block all pages which start with "copy-of" on my website because people have a bad habit of duplicating new product listings to create our refurbished, surplus etc. listings for those products. To avoid Google seeing these as duplicate pages I've blocked them in the robot file, but of course they are still automatically generated in our sitemap. How bad is this?
On-Page Optimization | | absoauto0 -
Dupelicate content home page and custom page question
I am working on a website that got hit by the penguin update. Didn't get hit terribly bad, but dropped from number one to number 9. As I'm going through the pages, the theme and content is a mess. To give an example, say the site is about custom colored marbles. The main page content covers custom colored marbles, custom promotional marbles, custom glass marbles, etc. Custom colored marbles is mentioned and covered on all pages, which I am going back and trying to make each page theme specific. There is also a custom page, so I am at a cross roads on how best to employ the focus of the custom page and the home page. I am thinking the home page should emphasize colored marbles, and the custom page should emphasize custom colored marbles. My fear is that making such a drastic change will bounce the site completely off front page and that it will take time for the custom page to come up in rankings. AS it stands now I am confused as to how it even ranks on first page as there's two pages with custom colored marbles emphasis. Id like to clean this up as much as possible so there are no big hits with future google updates, but I don't want the site to drop off either as that would be hard to explain to the owner. Yeah, we are cleaning up your site and making it google compliant and in so doing you no longer rank on first page. That won't put food on the table. Thanks for any advise on this.
On-Page Optimization | | anthonytjm0 -
Optimally, how many times should the key word or phrase you are targeting for a particular page be mentioned or appear on that page?
Our marketing team is debating how many times the key phrase on each of our web store's product pages should include the word/phrase we are trying to be competitive with. Can you advise?
On-Page Optimization | | Glynlyon0 -
Changing page titles and google penalties?
I just recently learned that changing your page title earns you a google penalty. Unfortunately i learned this after playing around with my page titles a bit to get the most optimal page titles. Does anybody know how long this google penalty lasts? is it forever? or just temporary?
On-Page Optimization | | adriandg0