Bing's indexed pages vs pages appearing in results
-
Hi all
We're trying to increase our efforts in ranking for our keywords on Bing, and I'm discovering a few unexpected challenges. Namely, Bing is reporting 16000+ pages have been crawled... yet a site:mywebsite.com search on Bing shows less than 1000 results.
I'm aware that Duane Forrester has said they don't want to show everything, only the best. If that's the case, what factors must we consider most to encourage Bing's engine to display most if not all of the pages the crawl on my site?
I have a few ideas of what may be turning Bing off so to speak (some duplicate content issues, 301 redirects due to URL structure updates), but if there's something in particular we should monitor and/or check, please let us know. We'd like to prioritize
Thanks!
-
Yep, if Bing Webmaster Tools doesn't show problems with the sitemap, I'd focus on the points I highlighted back in mid-June on this thread (make content robust, unique, and make sure text is in HTML).
Good luck,
Kristina
-
Hello again Kristina
Bing's showing 38,885 pages indexed... and I've noticed the amount of pages vary after clicking through several pages.
So I guess the problem isn't why aren't they indexing, but rather why aren't they showing all pages. I'd assume this is related to page quality (content, on-page ranking factors, etc)?
-
I haven't heard of Bing keeping historically submitted sitemaps and confusing them, although I know that they're very picky about the number of inaccuracies they find in a sitemap, so it's possible they keep the latest one around so they can refer to it if the current one seems to have holes.
That said - when you search for your site, are the same pages coming up on the first page? What about the second? Third? The number of pages that come up when you search for site:mysite.com are approximations and can vary even as you scroll through the results pages. The more important question is, how many pages does Bing say are indexed in Bing Webmaster Tools?
-
Just an update:
Bing reported a successful crawl after submitting a new one, then rejected it based on an error that it didn't describe. Took it down, made a change to URL itself (somehow the .gz extension wasn't there) and resubmitted on 7/7/13.
Since then, Bing has reported a successful crawl, then reported a successful crawl on 6/30/13 (7 days before submission?), then reported a failed crawl on 7/5/13 (2 days before submission?) and now today again reporting a successful crawl on 7/7/13.
So my question now is... does Bing keep record of historically submitted sitemaps and confuse them with new submissions of the same ones? I've yet to see Bing actually index what's in the sitemaps, as a site: operator search is still a daily fluctuation between 1200 and 3300 results, sometimes going up to 4400. But again, this is daily. Right now, searching site:roadtrippers.com on Bing reports 4,420 results. Later today, I imagine it'll be around 3,300 or 1,200.
Any suggestions at all would be greatly appreciated.
-
Good luck!
If these tips don't work, you should follow up here again, but include a little more information about your site. It's possible that Bing IS crawling all of your pages properly, but something about them is making Bing think that they aren't valuable enough to be in their indexes. I'd particularly look to see if:
- Content seems to be duplicate, either within your site or if it's duplicated elsewhere
- Content is extremely thin (less than 100 words on a page/no unique text above the fold)
- Content is unreadable by Bing: check the cached version of a page that's not indexed and make sure you can read the unique content
Hope this helps! I'm going to mark this question as "answered," only because if you have a follow up question, it'll probably be more specific now that you have more information, and I'd like all of that info to be included in the original question.
Best,
Kristina
-
Hey Kristina
It has not unfortunately.
Bing reports successful crawls, however it's not crawling it - at all.
After reading more about Bing's sitemap preferences, there are a few things left to try. I'm using this post on Bing's forums http://www.bing.com/blogs/webmaster/f/12248/t/659635.aspx#9602607 as a reference for now. We're going to make a temporary separate sitemap for Bing to test what is suggested in that link. Hopefully something sticks and we can make some progress going forward!
Brandon
-
Hi Brandon,
Just wanted to check in - did using 1 sitemap work?
Kristina
-
I believe I've found the solution - as recently as 2009, Bing was only crawling one sitemap per website. It also said Bing would only crawl the most recently submitted sitemap but it doesn't appear that was the case for our site.
So I've since removed the old sitemap and am waiting to see some evidence of our new sitemap being crawled and indexed.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What happens when we change redirects to pass linkjuice to different pages from backlinks? Google's stand?
Hi Moz community, We have employed different pages (topics) at same URLs for years. This has brought different backlinks to same page which has led to non relevancy of backlinks. Now we are planning to redirect some URLs which may improve or drop rankings of certain pages. If we roll back the redirects in case of ranking drop, will there be any negative impact from Google? Does Google notice anything about redirect changes beside just passing pagerank from backlinks? Thanks
Algorithm Updates | | vtmoz0 -
What's the correct format when you Disavow a single page? with or without www.?
Hi Y'all. Can't seem to find an article on disavowing a single page. Â Do i use A, B, or submit both A and B? Example: A. http://disavowexample.com B. http://www.disavowexample.com Which one does Google prefer? Â I know for some I just find the canonical url of the page (which show www,) but wanted your expert advice! Thanks
Algorithm Updates | | Shawn1240 -
Complete website redesign: original domain vs subdomain vs new domain ?
Hello dear community fellas!
Algorithm Updates | | PayPro
The story goes like this: my company has a good ol' website launched back in 2008 and since then nothing much was updated there. Our rank dropped significantly because, well, barely any SEO was done for it. Me and my team decided to redesign the whole thing: content, structure, visuals, links, everything but this time really making it right. However, with our oldie we managed to get a nice user base, so we still want to get all the traffic juice out of it. Now the questions is where do you think is the best place to publish our new website: Our original domain www.companyname.com? Create a subdomain new.companyname.com? Totally new domain www.namecompany.com? Cheers!0 -
Content vs articles vs blogs is there a difference?
I was wondering is there really a difference between website content, articles or blogs and most important do search engines see it differently? My website is pretty much an ecommerce site and most of my long text is on my blog. The only other pages that have much content is the homepage, all the other pages may have a paragraph. I am just wondering if i need to make more actual pages with text/content or is having my blogs good enough? I am no expert in seo and just wondering if i am wasting too much money on getting blogs written or should i get more content. Content being a page called commercial printing and blog being a page called why do do i need commercial printing? Also would it matter to the users who find the site? Would the users come to my site just looking for information or would they actually think of me for the service?
Algorithm Updates | | topclass0 -
Vanity URL's and http codes
We have a vanity URL that as recommended is using 301 http code, however it has been discovered the destination URL needs to be updated which creates a problem since most browsers and search engines cache 301 redirects. Is there a good way to figure out when a vanity should be a 301 vs 302/307? If all vanity URL's should use 301, what is the proper way of updating the destination URL? Is it a good rule of thumb that if the vanity URL is only going to be temporary and down the road could have a new destination URL to use 302, and all others 301? Cheers,
Algorithm Updates | | Shawn_Huber0 -
Specific Page Penalty?
Having trouble to figure out why one of our pages is not ranking in SERPs, on-page optimisation looks decent to me. Checked by using gInfinity extension and searched for the page URL. Can one page be penalised from Google engines (.ie / .com ) and the rest of the website not penalised? The (possible) penalised page is showing in Google places in SERPs. I assume this would not show if it was penalised. Would appreciate any advice. Thanks
Algorithm Updates | | notnem0 -
Singular vs plural SEO
Hi everyone, OK I've been looking at the Google adwords keyword tool and it's thrown some of my On-page SEO into question (everything said here are examples, I haven't used any real life terms or figures). Lets say my page is about "Green Apples", let's say the keyword tool shows that the singular version "Green Apple" gets more searches (as an example). Should I optimize for the singular or the plural? Also lets say my title tag for that page is "Green Apples | Apples Galore UK" would Google/SEOmoz count that as an optimisation for the singular "Green Apple" or do the search engines take the title literally and don't differenciate between singular and plurals? Thanks in advance everyone! Regards, Ash
Algorithm Updates | | AshSEO20112 -
(Ireland & USA) Speilling 'Z' v's 'S'
Hi, My site is called ExampleVirtualisation.ie it's only new but when I type Example Virtualistion (the S in the word) into Google.ie The suggestive spelling for Example virtualiztion (with the Z) keeps coming up. When I click the Suggestion Spelling with Example Virtualiztion (Z) another website arrives in position 1. My site is not being reconised for the Z type spelling. How can I get found? I was thinking of purchasing the ExampleVirtualiztion.ie (Z) as well & redirecting to my S spelling site. Also optimising my title & des tags with both S & Z spellings. I've only recently submitted my sitemap.xml in Google -hopefully this will help my site to be found. Apologies if the Questions sounds a bit tricky, Your advise is welcome thank you.
Algorithm Updates | | GlenBOB0