Why bing is not indexing our website?
-
We are up almost a six month already, google indexed 46,900 pages.
We have decent traffic and a lot of real external links to us.
No single page has been indexed by bing or yahoo.
I have submitted sitemap to bing's webmaster tool two weeks ago and still it is in Pending stage.
here is our address: www.showme.com
and here is site map: http://www.showme.com/sitemapxml.php
What can be the reason of that?
Thanks for your help.
Karen Bdoyan
-
GET 200 = All good
GET 304 =
<a id="sec10.3.5">10.3.5</a> 304 Not Modified
If the client has performed a conditional GET request and access is allowed, but the document has not been modified, the server SHOULD respond with this status code. The 304 response MUST NOT contain a message-body, and thus is always terminated by the first empty line after the header fields.
The response MUST include the following header fields:
- Date, unless its omission is required by section 14.18.1
If a clockless origin server obeys these rules, and proxies and clients add their own Date to any response received without one (as already specified by [RFC 2068], section 14.19), caches will operate correctly.
- ETag and/or Content-Location, if the header would have been sent in a 200 response to the same request
- Expires, Cache-Control, and/or Vary, if the field-value might differ from that sent in any previous response for the same variant
If the conditional GET used a strong cache validator (see section 13.3.3), the response SHOULD NOT include other entity-headers. Otherwise (i.e., the conditional GET used a weak validator), the response MUST NOT include other entity-headers; this prevents inconsistencies between cached entity-bodies and updated headers. If a 304 response indicates an entity not currently cached, then the cache MUST disregard the response and repeat the request without the conditional. If a cache uses a received 304 response to update a cache entry, the cache MUST update the entry to reflect any new field values given in the response. Hope I helped, Info http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html Thomas
-
I found 115,029 301 redirects, i have software from Bing that shows the same violations as Bing sees.,
most are trailing slash issues from “/” to without trailing slash
Here is a sample
The link to "http://www.showme.com/learn/" has resulted in HTTP redirection to "http://www.showme.com/learn".
Each page I check has a huge number of requests mostly to js files and files from other domains
this page for instance Subtracting Negative Numbers
http://www.showme.com/sh/?i=47657
Resulted in all the request you see below, nott that besides js files of wich you have way too many, they ar alomost all from other domains.I cant say what bing thinks, but its not normal when you look at it, there is not much content that does not come from other domains, it may be that bing sees this as a thin site, an affiliate site or some sort of spam.
URL Method Result Type Received Taken Initiator Wait?? Start?? Request?? Response?? Cache read?? Gap??
http://www.showme.com/sh/?i=47657 GET 200 text/html 17.10 KB 2.40 s click 0 15 2340 47 0 78516
http://cdn.optimizely.com/js/6084057.js GET 304 text/javascript 276 B < 1 ms -
Thank you for responses,
Now I have very simple static SiteMap : http://www.showme.com/sitemap.xml
And as far as I checked with Screaming Frog tool, there is no urls with 301 redirections
Still no single page been indexed by Bing, I also added manually few pages... no result, There is just 0 files indexed for our domain.
What can be the reason of such strike by bing?
-
Hi Karen,
There are a long list of URLs in your site which, although they do (eventually) load in a browser, appear to be returning a Status of 0 - Connection Timeout.
It is well recognized that Bing crawlers are very sensitive to URLs in sitemaps that return significant numbers of errors. In this case it appears that the crawler may be encountering pages in the site that it sees as unfetchable.
The majority of these URLs are in the following format - http://www.showme.com/sh/?i=36999 (this is one of them), although this one also returns the same result http://www.showme.com/topic/Geography
If you download the Screaming Frog tool from screamingfrog.com and run it, you will see the list of files that are returning this status.
It appears that the amount of time these pages are taking to load is causing a problem for some crawlers.
Hope that helps,
Sha
-
2 things.
your site map takes for ever to load,
and the links in site map have a trailing "/" but then 301 redirect to a non traling "/" url
http://www.showme.com/careers/ redirects to http://www.showme.com/careersalso Duane Forester from bing states , you should not places every url into your site map, nut only the most important pages, he also states that if your sitemap is not acurate Bing will ignore it.
but anyhow in bing WMT you can submit pages directly to the index, in the index section look for submit urls.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Have you ever seen or experienced a page indexed which is actually from a website which is blocked by robots.txt?
Hi all, We use robots file and meta robots tags for blocking website or website pages to block bots from crawling. Mostly robots.txt will be used for website and expect all the pages to not getting indexed. But there is a condition here that any page from website can be indexed by Google even the site is blocked from robots.txt; because crawler may find the page link somewhere on internet as stated here at last paragraph. I wonder if this really the case where some webpages have got indexed. And even we use meta tags at page level; do we need to block from robots.txt file? Can we use both techniques at a time? Thanks
Algorithm Updates | | vtmoz0 -
How to outrank list and lifestyle websites
Hi everyone, We have a fully optimised client site with Moz optimisation scores of 95% and above. Each month we also create 1-2 backlinks. However, for the keywords we track, our client's site is stuck and no longer moving up at the bottom of page 1 and further down to page 2 and 3. The keywords ranking on first page are also getting very low click through rates - between 1% and 3%. The sites that outrank us are a mix of: Top X Places to visit... X Best Places to see... Trip advisor Things to do in... A guide to the best... Is there a chance for us to outrank the type of sites above? Will persevering in link building do the trick? I understand this may take a while because we have a fixed time and budget for each of our clients. If we can't outrank these lifestyle and list sites, will beating just direct competitors be enough? However, this won't change the low CTR issue... Another solution we're looking at is to change our keywords, which may be a bit tough because the current ones we track, even though they are a little broad, are exactly what the client offer and already have low search volumes. Going more specific will surely have lesser search volumes. Thanks in advance.
Algorithm Updates | | nhhernandez0 -
Searching for Compelling Hard Data on why B2B Websites Should Be Responsive
I am being asked to provide hard data in support the migration to a responsive website for a large B2B website. I have searched for any case studies showing before/after comparisons - no luck. I can easily show: Current data on desktop vs mobile visitors, their bounce rate, pages per visit, etc. Google Analytics Benchmark data - really compelling stuff there! In the past year, 100K visitors have come to the site from mobile devices. GWMTs shows the client not receiving mobile impressions for important keywords, All the close competitors have gone responsive. In APAC regions, mobile is more widely used than in the USA. BUT, I can’t show that making this expensive and time-consuming transition will result in more revenue. The client is a financial services software company, with a 2-3 year sales cycle. Has anyone seen data to support this transition? Thanks everyone! Have a great long weekend.
Algorithm Updates | | RosemaryB0 -
Did anyone else get a massive drop off in Bing recently?
Only for one set of my keywords. But I fell from first page to off the map in one fell swoop. Did this happen to anyone else? Should I be worried?
Algorithm Updates | | CleanEdisonInc0 -
Guides to determine if a client's website has been penalized?
Has anyone come across any great guides to pair with client data to help you determine if their website has been penalized? I'm also not talking about an obvious drop in traffic/rankings, but I want to know if there's a guide out there for detecting the subtleties that may be found in a client's website data. One that also helps you take into account all the different variables that may not be related to the engines. Thanks!
Algorithm Updates | | EEE30 -
Site-wide Footer Link on Client/Friend Website - Dangerous?
Hi Guys, I've got a friend / client / business associate who's website I helped develop. It's a three letter dot-com, so good trust, and an eCommerce site, so lot's of pages. When I launched my new site about 6 weeks ago I put "Official IT Partner of MySite.com" in the footer. No keywords in the anchor text, just the domain URL... There are no other external links like that on the site whatsoever, and I haven't been hit by Penguin. I'm ranking well for local targeted keywords a few weeks after launch, and traffic continues to increase... I am worried that Google will see this is unnatural, but I've received no warning or experienced any decline in rankings. There's about 2800 pages linking from the site to my site, all in the footer of course. Would it be better to remove the link from the footer and add it just to the home page and a couple of other high authority pages, or should I leave it be. It's not "unnatural", I am affiliated with the site and work in partnership with the site, but it does fit that profile. I'm thinking about removing the footer link and adding a small graphic on the home page of the linking site which links to my root domain, with a couple of broad keyword anchored links in a description underneath that also link to relevant pages on my site... What do you think? 2800 links w/ my URL as anchor text from high Domain Authority / Low Page Authority pages (the homepage and a few other pages have decent authority) to my root domain OR Three different links from one High DA/ High PA homepage (one image alt, two anchored w/ broad keywords) to three different pages on my site. Again, there are no other site-wide external links on the domain, and I'm pretty sure I escaped the Penguin. Looking forward to hearing the different points of view. Thanks, Anthony
Algorithm Updates | | Anthony_NorthSEO2 -
I need help with drastic SERP difference between Bing and Google
One of our sites that has been around for a couple of years has about 60,000 pages showing on google, however, bing only shows 90 pages for the site. This same phenomenon has been happening across the board for our sites. Any ideas to improve our indexing results for bing?
Algorithm Updates | | atuomala0 -
What are the first ten steps you should do with a new website
First of all i would like to say how amazing this forum is, i have learnt a lot with all the great help. I am launching a new site mainly to allow me to learn seo and to understand what is involved in building a new site and get it to the search engines. the site is here which i have started today which is a lifestyle magazine is http://www.womenlifestylemagazine.com/ What i am trying to understand is, what are the first most important steps when trying to get google and traffic to your site. the site will be complete in the next week or so but in the meantime i want to use this site to learn more about seo and how you get the site discovered by visitors and search engines and the time scale behind it. I am hoping that other people who are new to seo and are building a new site will be able to use this post to learn about what is involved and learn like me. Would be great to hear from people who have started their own site so we can all understand what are the important steps to make and which things we should do in which order. thank you everyone
Algorithm Updates | | ClaireH-1848860