Google Indexed = 35, 445 pages, Bing Indexed = 243 pages... Why?
-
Dear MozSquad,
Can anyone check our site and let me know if there's anything super apparent that would cause Bing to treat us like a bum on the street? I recently made some structural changes which really helped with Google, but Bing didn't even budge. It's a lot harder to keep up with all the SEO initiatives I have in mind with it being a small start-up where I'm responsible for planning the entire Internet Marketing campaign, giving constant input on UX and site design, etc on top of 900 other things, so I figured it'd be a good time to use The Moz to help a brother out. Ideas?
Domain: homeandgardendesignideas.com (yeah, I know it's a little long =P)
-
Certainly no issues for Bing, they're actually hitting us more than Google.
| 2 | 102718 | 7.22% | Mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm) |
| 3 | 75772 | 5.33% | Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) | -
Mike,
I think that actually did give me some pretty good insight which I hadn't thought of when I was initially considering methods to answer this question.
After digging into the index with some filters, what I'm seeing is that Bing is clearly lagging far behind Google regarding the speed in which they're picking up on changes. I'm looking at piles of things that were changed and re-structured weeks (or even a couple months) ago and it hasn't picked them up at all. I don't think it's a problem on my end, because Google clearly has no problem crawling me. I guess I'll need to double-check the server logs and see what Bingbot's habits are.
I've always assumed they would be equal in how long t takes to update their indexes, etc and that they'd simply have slightly different algorithms, but looks like Goog/Bingie may differ much more in operation than I thought.
-
Maybe give this Bing Index Explorer tool a whirl?
"The Index Explorer tool in the Reports & Data section provides you with a unique view of how Bing sees your site. It reflects all the URLs we have seen on the web, including redirects, broken links, or those blocked by robots.txt, organized in an file explorer-like fashion. This view can help you get some really detailed insights into how your site was seen by the search engine during recent crawls. It can help discover both issues on your site as well as opportunities."
Hope this helps.
Mike
-
I should have mentioned, I setup Bing Webmaster Tools originally and have kept up-to-date sitemaps in it for the past 3 or 4 months.
I've always noticed Bing to kind of lag behind Google, but I'm really surprised to only see ~500 pages indexed. I was once hired to do the SEO for an auto dealer who had dirty SEO and keyword stuffing all over his poorly structured site and I remember Bing being much more responsive to their site than they are to ours, even though they didn't even have BWMT setup prior to my involvement. Weird.
-
Bing seems to always index much slower than Google, but agree with Mike. Anything you can do to help Bing crawl your site, do it.
-
Did you submit a new sitemap in your Bing Webmaster Tools?
Mike
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Will Google Count Links Loaded from JavaScript Files After the Page Loads
Hi, I have a simple question. If I want to put an image with a link to another site like a banner ad on my page, but do not want it counted by Google. Can I simply load the link and banner using jQuery onload from a separate .js file? The ideal result would be for Google to index a script tag instead of a link.
On-Page Optimization | | CopBlaster.com1 -
Should you do on-page optimization for a page with rel=canonical tag?
If you ad a rel=canonical tag to a page, should you still optimize that page? I'm talking meta description, page title, etc.
On-Page Optimization | | marynau0 -
Strange google indexing behaviour
Hi all Looking for a second opinion on a strange issue with has occurred on my site. The site is a magento store and because I am using all the default merchant descriptions at the moment I have noindexed the product pages (there are 300k products, the plan is to rewrite the content as we go, starting with most popular sellers). The Gbot is blocked from the pages and all the products have header tag. We forgot to noindex the popular search terms page on the site and as a result google has indexed some search result pages - we may keep this open, not sure yet, We are seeing a very strange thing in the serps. Google has indexed the search result pages, as mentioned above, however, the description and title tag being used do not belong to that page, they belong to the product page the search result links to. If i do a search in google for the indexed pages i get the categories and lots of, what appears to be, product pages. https://www.google.co.uk/search?q=site:arropa.co.uk/store&espv=2&biw=1536&bih=772&ei=LE5xVd3qA4HlUNnggKgH&start=250&sa=N One would assume that a page listed with the title of Ladies 1 Pair Young Trasparenze Mumbai Animal Print . and the description of Come on, program a little of your crazy side! Part of the edgy, sassy Young Trasparenze Medley, these soft touch, nontransparent stockings function a crazy, (along with the price) would be an entry for that individual product. However, clicking on that product opens up a search results page (very slowly as the site is processing an update still - it is not for public use thus far) which can be seen here http://arropa.co.uk/store/catalogsearch/result/?q=+ladies+1+pair+young+trasparenze+mumbai+animal+print+tights+75+off+military+l+ yes, the search result page is for that particular item but nowhere on the page is the title, description and price, nor has it ever been. Am a little puzzled about this and what it would do re duplicate content as im using the manufacturer data at present. Ideally i would like to keep the search results pages open. Any thoughts would be most welcome. Couple of things to note. Im aware the site is too slow for general public use. It will be fully cached once running, as i say, it has 300k+ products so isn't small. Also, am aware that there are no images. They exist but we are moving the images around, hence being down. Always a fun task when there are 25gb of the things!! Many thanks Carl
On-Page Optimization | | WonkyDog0 -
Blocking Subdomain from Google Crawl and Index
Hey everybody, how is it going? I have a simple question, that i need answered. I have a main domain, lets call it domain.com. Recently our company will launch a series of promotions for which we will use cname subdomains, i.e try.domain.com, or buy.domain.com. They will serve a commercial objective, nothing more. What is the best way to block such domains from being indexed in Google, also from counting as a subdomain from the domain.com. Robots.txt, No-follow, etc? Hope to hear from you, Best Regards,
On-Page Optimization | | JesusD3 -
Form Only Pages Considered No Content/Duplicate Pages
We have a lot of WordPress sites with pages that contain only a form. The header, sidebar and footer content is the same as what's one other pages throughout the site. Each form page has a unique page title, meta description, form title and questions but the form title, description and questions add up to probably less than 100 words. Are these form pages negatively affecting the rankings of our landing pages or being viewed as duplicate or no content pages?
On-Page Optimization | | projectassistant0 -
Google Search - One page having problems
this issue is concerning my site - cruvoir.com we retail designer clothing online, and currently have 17 'designer' pages - one for each manufacturer brand name. We target these brand names for our campaign and track the progress with Moz and try to focus them in Google search. Of many of the designer names, we rank pretty well in Google search (usually under #15 when searching for the specific brand. All brands are doing well, except one brand : "Lost And Found" - a designer label we carry. This is the page for this brand name : https://cruvoir.com/5-lost-and-found we cannot figure it out. It happens to be our most important label we carry. when we search for this brand name or include it in any other search terms, we never are in the google search results. I expect it is a crawl issue, but we have covered all our ground in optimizing this brand page. It seems this page is also indexed with Google. But we cannot figure out why it does not rank us in search.
On-Page Optimization | | cruvoir0 -
Why Google did not index exactly these 2 pages? Any ideas?
Dear Community, on 27th of July I relaunched my own website and submitted the sitemap as well I send the index-page to crawl it including all linked pages. Already the next day the new pages have been indexed. Today I checked them manually if they have been indexed. The result is that 2 of 13 pages have not been indexed, here marked in bold: http://inlinear.com/
On-Page Optimization | | inlinear
http://inlinear.com/suchmaschinenoptimierung-online-marketing.php
http://inlinear.com/design/
http://inlinear.com/design/printmedien-gestaltung.php
http://inlinear.com/design/corporate-design-und-corporate-identity.php
http://inlinear.com/design/corporate-raum-design.php
http://inlinear.com/webentwicklung/
http://inlinear.com/virtueller-rundgang-360grad-fotografie.php
http://inlinear.com/business-atlas-online-verzeichnis.php
http://inlinear.com/baudokumentation-bauueberwachung.php
http://inlinear.com/ueber-uns.php
http://inlinear.com/blog/
http://inlinear.com/kontakt/ The page "/design/" (which is the index.php of this folder should be the main-page because its about WEB DESIGN.
Should I create a copy and call it /design/web-design.php? May be Google prefers a meaningful URL than the index.php? So I put then a rel=canonical to web-design.php in my index.php? design/corporate-design-und-corporate-identity.php
The URL is a little long, but this should not be the reason? Or might be a reason that another page which is still in the index, but not online anymore (even redirecting to /design/) is still more dominant? Strange.... orshould I simply wait a little or try submitting these to sites manually to google? When checking Google Webmasters Tools Google tells me that just 3 pages have been indexed.
When I was checking which page is indexed or not I checked each URL with the site-search option:
site:inlinear.com/pageX.php ... when Google shows this page, it was a sign that it was indexed but why webmasters tools show up only 3 pages? (see screenshot) Do you have any ideas?
Thank You 🙂 indexed.png0 -
Links to Product pages
Hello all, I am still rather new to SEO and learning a lot every day. I do have a question. On our product search result pages (example http://shop.ferguson.com/search/bathroom-lighting)
On-Page Optimization | | Ferguson
It is currently set up so the image, text, price etc of a product is linking to that product page. Our question is, if we were to link the image and the product name - will this be seen as two links to the same page? Is this a bad thing having multiple links to the same page? I searched around to see how other ecommerce sites have similar pages setup and it seems they link the image and also the product name, and the description is not click-able, which allows a user to "Highlight" the text (this is not possible on ours) Which would be to correct approach for SEO as well as User Interface, the way we have it set up, or by going with the method of the question I asked, Thank you for any information on this! Nick0