Why bing is not indexing our website?
-
We are up almost a six month already, google indexed 46,900 pages.
We have decent traffic and a lot of real external links to us.
No single page has been indexed by bing or yahoo.
I have submitted sitemap to bing's webmaster tool two weeks ago and still it is in Pending stage.
here is our address: www.showme.com
and here is site map: http://www.showme.com/sitemapxml.php
What can be the reason of that?
Thanks for your help.
Karen Bdoyan
-
GET 200 = All good
GET 304 =
<a id="sec10.3.5">10.3.5</a> 304 Not Modified
If the client has performed a conditional GET request and access is allowed, but the document has not been modified, the server SHOULD respond with this status code. The 304 response MUST NOT contain a message-body, and thus is always terminated by the first empty line after the header fields.
The response MUST include the following header fields:
- Date, unless its omission is required by section 14.18.1
If a clockless origin server obeys these rules, and proxies and clients add their own Date to any response received without one (as already specified by [RFC 2068], section 14.19), caches will operate correctly.
- ETag and/or Content-Location, if the header would have been sent in a 200 response to the same request
- Expires, Cache-Control, and/or Vary, if the field-value might differ from that sent in any previous response for the same variant
If the conditional GET used a strong cache validator (see section 13.3.3), the response SHOULD NOT include other entity-headers. Otherwise (i.e., the conditional GET used a weak validator), the response MUST NOT include other entity-headers; this prevents inconsistencies between cached entity-bodies and updated headers. If a 304 response indicates an entity not currently cached, then the cache MUST disregard the response and repeat the request without the conditional. If a cache uses a received 304 response to update a cache entry, the cache MUST update the entry to reflect any new field values given in the response. Hope I helped, Info http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html Thomas
-
I found 115,029 301 redirects, i have software from Bing that shows the same violations as Bing sees.,
most are trailing slash issues from “/” to without trailing slash
Here is a sample
The link to "http://www.showme.com/learn/" has resulted in HTTP redirection to "http://www.showme.com/learn".
Each page I check has a huge number of requests mostly to js files and files from other domains
this page for instance Subtracting Negative Numbers
http://www.showme.com/sh/?i=47657
Resulted in all the request you see below, nott that besides js files of wich you have way too many, they ar alomost all from other domains.I cant say what bing thinks, but its not normal when you look at it, there is not much content that does not come from other domains, it may be that bing sees this as a thin site, an affiliate site or some sort of spam.
URL Method Result Type Received Taken Initiator Wait?? Start?? Request?? Response?? Cache read?? Gap??
http://www.showme.com/sh/?i=47657 GET 200 text/html 17.10 KB 2.40 s click 0 15 2340 47 0 78516
http://cdn.optimizely.com/js/6084057.js GET 304 text/javascript 276 B < 1 ms -
Thank you for responses,
Now I have very simple static SiteMap : http://www.showme.com/sitemap.xml
And as far as I checked with Screaming Frog tool, there is no urls with 301 redirections
Still no single page been indexed by Bing, I also added manually few pages... no result, There is just 0 files indexed for our domain.
What can be the reason of such strike by bing?
-
Hi Karen,
There are a long list of URLs in your site which, although they do (eventually) load in a browser, appear to be returning a Status of 0 - Connection Timeout.
It is well recognized that Bing crawlers are very sensitive to URLs in sitemaps that return significant numbers of errors. In this case it appears that the crawler may be encountering pages in the site that it sees as unfetchable.
The majority of these URLs are in the following format - http://www.showme.com/sh/?i=36999 (this is one of them), although this one also returns the same result http://www.showme.com/topic/Geography
If you download the Screaming Frog tool from screamingfrog.com and run it, you will see the list of files that are returning this status.
It appears that the amount of time these pages are taking to load is causing a problem for some crawlers.
Hope that helps,
Sha
-
2 things.
your site map takes for ever to load,
and the links in site map have a trailing "/" but then 301 redirect to a non traling "/" url
http://www.showme.com/careers/ redirects to http://www.showme.com/careersalso Duane Forester from bing states , you should not places every url into your site map, nut only the most important pages, he also states that if your sitemap is not acurate Bing will ignore it.
but anyhow in bing WMT you can submit pages directly to the index, in the index section look for submit urls.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Bing & Yahoo Traffic
Traffic to my three sites from Bing and Yahoo has been declining over the past year. Meanwhile traffic from Google has been increasing. A year ago Bing and Yahoo brought in 34% of my traffic. Now it's only 19%. What can I do to optimise specifically for Bing/Yahoo? I have Webmaster tools. Or could it be that my customers (largely aged 60+) are moving over to Google? Thanks
Algorithm Updates | | WTH0 -
Google stopped showing time frame for the cached results of the websites; Why? Any alternatives?
Hi Moz community If we Google "site:website.com"; it'll list the cached pages from the website. And we used to check them on required date range like how and which pages got indexed. But date range is not working now and the results are missing the pages which got indexed at the selected date range. Any idea why Google does this? Any alternatives to find the recently indexed pages? Thanks
Algorithm Updates | | vtmoz0 -
Ranking impact: Traffic in website pages vs sub directory vs sub domain
Hi all, I need clarification on this. Not every time website main pages rank, some times even pages from sub directories or sub domains like blogs or guides; especially for branded keywords. I just wonder what happens when so much traffic is generating in sub directories and sub domains just because of limited landing pages in main website. Will this traffic be counted as traffic in main website as per Google? Traffic increase in main website really an ranking factor? Will the "brand + topic" related keywords' traffic is more for a website; will it ranking improves even for "topic keywords"? Thanks
Algorithm Updates | | vtmoz0 -
Why does Google say they have more URLs indexed for my site than they really do?
When I do a site search with Google (i.e. site:www.mysite.com), Google reports "About 7,500 results" -- but when I click through to the end of the results and choose to include omitted results, Google really has only 210 results for my site. I had an issue months back with a large # of URLs being indexed because of query strings and some other non-optimized technicalities - at that time I could see that Google really had indexed all of those URLs - but I've since implemented canonical URLs and fixed most (if not all) of my technical issues in order to get our index count down. At first I thought it would just be a matter of time for them to reconcile this, perhaps they were looking at cached data or something, but it's been months and the "About 7,500 results" just won't change even though the actual pages indexed keeps dropping! Does anyone know why Google would be still reporting a high index count, which doesn't actually reflect what is currently indexed? Thanks!
Algorithm Updates | | CassisGroup0 -
Google's not indexing my blog posts anymore! Why?
Google just recently stopped indexing my blog posts immediately after being published, why could this be? I would usually post a blog post and it would be in google results within 45 seconds, now they don't show up until 6 hours later, if at all (a few never even showed up). Also, my home page doesn't even refresh when I make a change to the site. My site is CantStopHipHop [dot] comI have all in one SEO, xml sitemap generator, and webmaster tools and nothing seemed irregular in the settings.I appreciate any thoughts/help/suggestions.
Algorithm Updates | | bb2550 -
Website taken a hit?
We have recently (yesterday 12<sup>th</sup> April) taken a hit for our main keywords it seems that there is no constant fall but it seems to be the most competitive words as anything that ranked purely on content still seems to rank which makes me assume that we have just lost a lot of power from links (are SEO did build quite a few links from article sites he also built a few blog network links which we did not know till we got the webmaster message 3 weeks ago (24<sup>th</sup> may) and we have made him remove them all but some still show which a) he can’t contact or b) were scrapers). But on the other hand we still have decent on site content and some good links from graphic design blogs (review articles) which would suggest a penalty as some sites with poor links and poor on site content are outranking us for a couple of our good keywords. I cannot decide if this is a penalty, keyword anchor text penalty (this is wiping more power out than the bad links) or just devaluation of links (but as said before our good links are still much more powerful than the competitors out ranking us and with our content we should easily not have lost many places). If I was going to come up with an idea it would be like the bad links have taken twice there power away from the site, so our on site content is still good but compared to medium on site and crap links they are out ranking us. (we did use a lot of anchor text with keywords in) If this is the case if we build gooad quality review links, press releases and make them more natural not go for normal link building – articles ect would this help and has anyone ever dealt with this before and have any idea how to know what is happing and how long it might take to recover.
Algorithm Updates | | BobAnderson0 -
Changes in Sitemap Indexation in GWT?
I've noticed some significant changes in the number and percentage of indexed URLs for the sitemaps we've been submitting to Google. I've been tracking these numbers directly from Google Webmaster Tools>Site Configuration>Sitemaps. We've made some changes that could be causing the changes we're seeing, but I want to confirm that this wasn't just a change in the way Google reports the indexation. Has anyone else noticed major changes, greater than a 30% change, in the indexation of your sitemaps in the past week? Thanks, Joe
Algorithm Updates | | JoeAmadon0 -
Why would my keywords never ranking in Bing but have great position in both Google and Yahoo?
I have several keywords ranking top 5 for Google and Yahoo but nothing from Bing. Any ideas?
Algorithm Updates | | CIEEwebTeam0