Why bing is not indexing our website?
-
We are up almost a six month already, google indexed 46,900 pages.
We have decent traffic and a lot of real external links to us.
No single page has been indexed by bing or yahoo.
I have submitted sitemap to bing's webmaster tool two weeks ago and still it is in Pending stage.
here is our address: www.showme.com
and here is site map: http://www.showme.com/sitemapxml.php
What can be the reason of that?
Thanks for your help.
Karen Bdoyan
-
GET 200 = All good
GET 304 =
<a id="sec10.3.5">10.3.5</a> 304 Not Modified
If the client has performed a conditional GET request and access is allowed, but the document has not been modified, the server SHOULD respond with this status code. The 304 response MUST NOT contain a message-body, and thus is always terminated by the first empty line after the header fields.
The response MUST include the following header fields:
- Date, unless its omission is required by section 14.18.1
If a clockless origin server obeys these rules, and proxies and clients add their own Date to any response received without one (as already specified by [RFC 2068], section 14.19), caches will operate correctly.
- ETag and/or Content-Location, if the header would have been sent in a 200 response to the same request
- Expires, Cache-Control, and/or Vary, if the field-value might differ from that sent in any previous response for the same variant
If the conditional GET used a strong cache validator (see section 13.3.3), the response SHOULD NOT include other entity-headers. Otherwise (i.e., the conditional GET used a weak validator), the response MUST NOT include other entity-headers; this prevents inconsistencies between cached entity-bodies and updated headers. If a 304 response indicates an entity not currently cached, then the cache MUST disregard the response and repeat the request without the conditional. If a cache uses a received 304 response to update a cache entry, the cache MUST update the entry to reflect any new field values given in the response. Hope I helped, Info http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html Thomas
-
I found 115,029 301 redirects, i have software from Bing that shows the same violations as Bing sees.,
most are trailing slash issues from “/” to without trailing slash
Here is a sample
The link to "http://www.showme.com/learn/" has resulted in HTTP redirection to "http://www.showme.com/learn".
Each page I check has a huge number of requests mostly to js files and files from other domains
this page for instance Subtracting Negative Numbers
http://www.showme.com/sh/?i=47657
Resulted in all the request you see below, nott that besides js files of wich you have way too many, they ar alomost all from other domains.I cant say what bing thinks, but its not normal when you look at it, there is not much content that does not come from other domains, it may be that bing sees this as a thin site, an affiliate site or some sort of spam.
URL Method Result Type Received Taken Initiator Wait?? Start?? Request?? Response?? Cache read?? Gap??
http://www.showme.com/sh/?i=47657 GET 200 text/html 17.10 KB 2.40 s click 0 15 2340 47 0 78516
http://cdn.optimizely.com/js/6084057.js GET 304 text/javascript 276 B < 1 ms -
Thank you for responses,
Now I have very simple static SiteMap : http://www.showme.com/sitemap.xml
And as far as I checked with Screaming Frog tool, there is no urls with 301 redirections
Still no single page been indexed by Bing, I also added manually few pages... no result, There is just 0 files indexed for our domain.
What can be the reason of such strike by bing?
-
Hi Karen,
There are a long list of URLs in your site which, although they do (eventually) load in a browser, appear to be returning a Status of 0 - Connection Timeout.
It is well recognized that Bing crawlers are very sensitive to URLs in sitemaps that return significant numbers of errors. In this case it appears that the crawler may be encountering pages in the site that it sees as unfetchable.
The majority of these URLs are in the following format - http://www.showme.com/sh/?i=36999 (this is one of them), although this one also returns the same result http://www.showme.com/topic/Geography
If you download the Screaming Frog tool from screamingfrog.com and run it, you will see the list of files that are returning this status.
It appears that the amount of time these pages are taking to load is causing a problem for some crawlers.
Hope that helps,
Sha
-
2 things.
your site map takes for ever to load,
and the links in site map have a trailing "/" but then 301 redirect to a non traling "/" url
http://www.showme.com/careers/ redirects to http://www.showme.com/careersalso Duane Forester from bing states , you should not places every url into your site map, nut only the most important pages, he also states that if your sitemap is not acurate Bing will ignore it.
but anyhow in bing WMT you can submit pages directly to the index, in the index section look for submit urls.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
My website is not configured in AMP pages, but it is mobile-friendly.
Hi
Algorithm Updates | | rayabahadur
My website is not configured in AMP pages, but it is mobile-friendly.
Last month, my website was ranked to 10 positions for this keyword (Magento Development Company).
Sometimes it's showing on 25 positions but not in the top 5 positions. Here is my URL (for analysis):
https://www.nevinainfotech.com/magento-development-service/
Would you please explain why my keyword rankings are often not showing in the search listings?
Would you mind letting me know is there anything I need to change?
Thank0 -
Have you ever seen or experienced a page indexed which is actually from a website which is blocked by robots.txt?
Hi all, We use robots file and meta robots tags for blocking website or website pages to block bots from crawling. Mostly robots.txt will be used for website and expect all the pages to not getting indexed. But there is a condition here that any page from website can be indexed by Google even the site is blocked from robots.txt; because crawler may find the page link somewhere on internet as stated here at last paragraph. I wonder if this really the case where some webpages have got indexed. And even we use meta tags at page level; do we need to block from robots.txt file? Can we use both techniques at a time? Thanks
Algorithm Updates | | vtmoz0 -
Best length for a video on a website
Most of us deal with UI/UX questions and SEO questions from clients on a daily basis. I was discussing video length with a client recently and I realized that he was in his video. This made me think about the thrill of seeing yourself in video might cause someone to make their video longer at the expense of UX. So, I thought I would put it to the Moz community. If a company is doing a "typical" home page "Explainer" video that tells about a company. This can be in the B2B or B2C sectors. I want to withhold my opinion at this point for the discussion.
Algorithm Updates | | RobertFisher0 -
Images added to website automatically become URLs - is this an issue?
Hello Mozzers! I've just been trawling through a website and noticed all of the images had their own URLs. There's a bespoke CMS and that's how it works with images... So out of 1447 urls, 1314 are images. Firstly, is this an issue / problem from an SEO perspective. If it is, how should I deal with it? Thanks in advance, Luke
Algorithm Updates | | McTaggart0 -
Do search engines always pay heed to no index instructions?
Hi, I am currently working on a site that relies solely on it's images to attract traffic. My concern is that search engines will index our images, make them available through image searches and therefore allow our potential visitors to bypass our website completely. I know that there are a number of methods available such as disallowing images in robots.txt or using "noimageindex" tags in the HTML etc. but do search engines always pay attention to these requests? Does anyone have any experience with no indexing images? Or are there any methods that are guaranteed to work? Thanks in Advance.
Algorithm Updates | | BallyhooLtd0 -
Since authorship markup requires a domain email, how can a community website allow users to link their Google+ profile?
It seems that Google now requires authors to have a valid email on the domain. This is easy for the traditional web publication. But what about community websites like SEOmoz? How can a community website allow users to link their Google+ profile? Will community websites like SEOmoz be required to 1. Give all users a domain email 2. Ask users to validate the email address with Google? Seems overly complicated.
Algorithm Updates | | designquotes0 -
Clients asks: How long till on Bing and Yahoo?
Hi there, One of my clients had asked me how long it would take for his site to get up on Yahoo and Bing. He's currently on Google, but those other search engines are lagging. It's been a week or so since his site launched, but I'm not sure what to tell him as I don't really know much about Yahoo and Bing.
Algorithm Updates | | StephBertha0 -
Site-wide Footer Link on Client/Friend Website - Dangerous?
Hi Guys, I've got a friend / client / business associate who's website I helped develop. It's a three letter dot-com, so good trust, and an eCommerce site, so lot's of pages. When I launched my new site about 6 weeks ago I put "Official IT Partner of MySite.com" in the footer. No keywords in the anchor text, just the domain URL... There are no other external links like that on the site whatsoever, and I haven't been hit by Penguin. I'm ranking well for local targeted keywords a few weeks after launch, and traffic continues to increase... I am worried that Google will see this is unnatural, but I've received no warning or experienced any decline in rankings. There's about 2800 pages linking from the site to my site, all in the footer of course. Would it be better to remove the link from the footer and add it just to the home page and a couple of other high authority pages, or should I leave it be. It's not "unnatural", I am affiliated with the site and work in partnership with the site, but it does fit that profile. I'm thinking about removing the footer link and adding a small graphic on the home page of the linking site which links to my root domain, with a couple of broad keyword anchored links in a description underneath that also link to relevant pages on my site... What do you think? 2800 links w/ my URL as anchor text from high Domain Authority / Low Page Authority pages (the homepage and a few other pages have decent authority) to my root domain OR Three different links from one High DA/ High PA homepage (one image alt, two anchored w/ broad keywords) to three different pages on my site. Again, there are no other site-wide external links on the domain, and I'm pretty sure I escaped the Penguin. Looking forward to hearing the different points of view. Thanks, Anthony
Algorithm Updates | | Anthony_NorthSEO2