Bing's indexed pages vs pages appearing in results
-
Hi all
We're trying to increase our efforts in ranking for our keywords on Bing, and I'm discovering a few unexpected challenges. Namely, Bing is reporting 16000+ pages have been crawled... yet a site:mywebsite.com search on Bing shows less than 1000 results.
I'm aware that Duane Forrester has said they don't want to show everything, only the best. If that's the case, what factors must we consider most to encourage Bing's engine to display most if not all of the pages the crawl on my site?
I have a few ideas of what may be turning Bing off so to speak (some duplicate content issues, 301 redirects due to URL structure updates), but if there's something in particular we should monitor and/or check, please let us know. We'd like to prioritize
Thanks!
-
Yep, if Bing Webmaster Tools doesn't show problems with the sitemap, I'd focus on the points I highlighted back in mid-June on this thread (make content robust, unique, and make sure text is in HTML).
Good luck,
Kristina
-
Hello again Kristina
Bing's showing 38,885 pages indexed... and I've noticed the amount of pages vary after clicking through several pages.
So I guess the problem isn't why aren't they indexing, but rather why aren't they showing all pages. I'd assume this is related to page quality (content, on-page ranking factors, etc)?
-
I haven't heard of Bing keeping historically submitted sitemaps and confusing them, although I know that they're very picky about the number of inaccuracies they find in a sitemap, so it's possible they keep the latest one around so they can refer to it if the current one seems to have holes.
That said - when you search for your site, are the same pages coming up on the first page? What about the second? Third? The number of pages that come up when you search for site:mysite.com are approximations and can vary even as you scroll through the results pages. The more important question is, how many pages does Bing say are indexed in Bing Webmaster Tools?
-
Just an update:
Bing reported a successful crawl after submitting a new one, then rejected it based on an error that it didn't describe. Took it down, made a change to URL itself (somehow the .gz extension wasn't there) and resubmitted on 7/7/13.
Since then, Bing has reported a successful crawl, then reported a successful crawl on 6/30/13 (7 days before submission?), then reported a failed crawl on 7/5/13 (2 days before submission?) and now today again reporting a successful crawl on 7/7/13.
So my question now is... does Bing keep record of historically submitted sitemaps and confuse them with new submissions of the same ones? I've yet to see Bing actually index what's in the sitemaps, as a site: operator search is still a daily fluctuation between 1200 and 3300 results, sometimes going up to 4400. But again, this is daily. Right now, searching site:roadtrippers.com on Bing reports 4,420 results. Later today, I imagine it'll be around 3,300 or 1,200.
Any suggestions at all would be greatly appreciated.
-
Good luck!
If these tips don't work, you should follow up here again, but include a little more information about your site. It's possible that Bing IS crawling all of your pages properly, but something about them is making Bing think that they aren't valuable enough to be in their indexes. I'd particularly look to see if:
- Content seems to be duplicate, either within your site or if it's duplicated elsewhere
- Content is extremely thin (less than 100 words on a page/no unique text above the fold)
- Content is unreadable by Bing: check the cached version of a page that's not indexed and make sure you can read the unique content
Hope this helps! I'm going to mark this question as "answered," only because if you have a follow up question, it'll probably be more specific now that you have more information, and I'd like all of that info to be included in the original question.
Best,
Kristina
-
Hey Kristina
It has not unfortunately.
Bing reports successful crawls, however it's not crawling it - at all.
After reading more about Bing's sitemap preferences, there are a few things left to try. I'm using this post on Bing's forums http://www.bing.com/blogs/webmaster/f/12248/t/659635.aspx#9602607 as a reference for now. We're going to make a temporary separate sitemap for Bing to test what is suggested in that link. Hopefully something sticks and we can make some progress going forward!
Brandon
-
Hi Brandon,
Just wanted to check in - did using 1 sitemap work?
Kristina
-
I believe I've found the solution - as recently as 2009, Bing was only crawling one sitemap per website. It also said Bing would only crawl the most recently submitted sitemap but it doesn't appear that was the case for our site.
So I've since removed the old sitemap and am waiting to see some evidence of our new sitemap being crawled and indexed.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Ecommerce SEO: Is it bad to link to product/category pages directly from content pages?
Hi ! In Moz' Whiteboard friday video Headline Writing and Title Tag SEO in a Clickbait World, Rand is talking about (among other things) best practices related to linking between search, clickbait and conversion pages. For a client of ours, a cosmetics and make-up retailer, we are planning to build content pages around related keywords, for example video, pictures and text about make-up and fashion in order to best target and capture search traffic related to make-up that is prevalent earlier in the costumer journey. Among other things, we plan to use these content pages to link directly to some of the products. For example a content piece about how to achieve full lashes will to link to particular mascaras and/or the mascara category) Things is, in the Whiteboard video Rand Says:
Algorithm Updates | | Inevo
_"..So your click-bait piece, a lot of times with click-bait pieces they're going to perform worse if you go over and try and link directly to your conversion page, because it looks like you're trying to sell people something. That's not what plays on Facebook, on Twitter, on social media in general. What plays is, "Hey, this is just entertainment, and I can just visit this piece and it's fun and funny and interesting." _ Does this mean linking directly to products pages (or category pages) from content pages is bad? Will Google think that, since we are also trying to sell something with the same piece of content, we do not deserve to rank that well on the content, and won't be considered that relevant for a search query where people are looking for make-up tips and make-up guides? Also.. is there any difference between linking from content to categories vs. products? ..I mean, a category page is not a conversion page the same way a products page is. Looking forward to your answers 🙂0 -
Satisfaction survey on Google search results
Anybody else noticing Google satisfaction surveys on long-tail results? I'm only seeing it when there are no ads... 6071fb3341.png
Algorithm Updates | | Propecta1 -
Local Results for Regional Headquarters
A potential client of mine is an appliance and furniture retailer in the region with several brick & mortar stores. They have their headquarters (and main store) located here in town, and then in several towns within an approximately 25 mile radius, they have satellite stores that specialize in certain products. They see their best results both for hits and for in-store conversions from Google Local results, wherein people search for "Furniture" or "Television Stores" and they appear in the top two or three results. The problem is, the satellite stores have a limited inventory (they are actually brand specific stores operated by the client in a sort of franchise concept. Each one has their own website). The client wants to optimize for the headquarters, and I am considering various options. I know that since they have a presence in these towns that are within 25 miles, I could set up an "area of service" listing by verifying their other stores as locations for the main store, which would get their central store and main website listed in the local results in those towns. However, if this project comes together well, I will also be doing SEO for their satellite stores. I don't want to list those locations as part of the headquarters store, and then later be unable to list them as their own business locations, as well. Example: Customer in HOMETOWN searches "Furniture" - They get headquarter's local listing and website. Customer in SATELLITE AREA A searches "Furniture" - They get satellite's local listing and website. Customer in SATELLITE AREA A searches "Television Store" - Satellite Store A doesn't stock TV's, but the HOMETOWN store does. Customer gets headquarter's local listing and website based on "area of service" set up through SATELLITE STORE A. Is there a way to do this? This isn't black hat at all, even if it seems slightly iffy. The store is still local (just less local than some others), and the company does sell those products. Just not at the satellite locations. Because of the Franchise style of the Satellite stores, they're not allowed to associate those products directly with the satellite stores in any way.
Algorithm Updates | | 20_Creative0 -
How come google image search doesn't link to the right page?
For one site I work with the images link to the home page of the site rather than the page the image lives on. I think this is hurting my bounce rate quite a bit. Thoughts?
Algorithm Updates | | NetvantageMarketing0 -
Local Vs National SEO Rankings
Hi Guys, I just had a quick question, is it truly possible to rank number one worldwide/nationally for a keyword phrase these days such as, Computer repair services. I'm not too concerned with the local serps that come up above the fold. I'm just more concerned, if Google is looking to serve more local results into the regular serps listing? I hope that makes sense thanks. Best, Peter
Algorithm Updates | | PeterRota0 -
Should you include Website Title in all page title tags?
We recently spent analyzing some of the best SEO software companies on the U.S. market fishing for the best practices in SEO and I saw one thing in common : They all had website titles in all the page title tags separated by " | " Is that the best practice for SEO or is it just for Branding? Interestingly enough, the website titles were completely unrelated to the pages' content or keywords. (Here's my personal opinion on what it looked like: "riding on a bicycle" | Ferrari ) But when I looked up the keywords ... ranked #1 or #2 spots, in some serious competition. (So in the example above, "bicycle" would be in the top spot)
Algorithm Updates | | HMCOE0 -
Privacy page ranking above home page in serps
I'm using OSE to try and get some clues as to why my privacy page would rank higher than my home page. Could anyone help me figure out which metrics to review to rectify the issue? My key word is: Mardi Gras Parade Tickets The url that is ranking is <cite>www.mardigrasparadetickets.com/pages/privacy</cite> I'm happy to be ranking in the top 3 for the keyword, but I'd rather hoped it wouldn't be my privacy page. Any help would be awesome, Cy
Algorithm Updates | | Nola5040 -
How did a competitor's brand name get in google's related search list?
When doing a google search for the term "ulster county real estate" the related search list at the bottom of the serp includes 7 obviously related search terms and 1 brand name of a competitor. (see attachment) The competitor doesn't rank for this term organically at all yet he enjoys a link on the first page with those of us that do by being in the related search list? I don't get it. Anyone know how something like this happens? Innhs.png
Algorithm Updates | | jhogan801