Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Google will index us, but Bing won't. Why?
-
Same issue on my website GGTalks . I have tried everything including reaching them out on mail and forums but always no response or automated response
-
We also have the same problem with our website stirile , images are indexed but links not, in webmaster tools shows that we have some links indexed... What to do?
-
Bing Webmasters shows 127 indexed pages for aussie-slots.com yet none of them display using site: in bing search ??
-
Yes, we are also facing this issue.
Our Website is [webtracktechnologies.com](link url)
We are getting different results on searching keyword "webtracktechnologies" from Google and Bing.
The Main difference is that we are getting same results in SERP of Google as we have written in our website's Title and description but Bing is showing different results. -
What just happened to me is surprising... after a long time without Bing showing my website https://poema.es in its results, this week it has shown it again without doing anything... Have you fixed something? (I have not modified this website recently.)
Respuesta original en español: Es sorprendente lo que me acaba de pasar.... despues de mucho tiempo sin que Bing vuelva a mostrar mi web https://poema.es en sus resultados, esta semana ha vuelto a mostrarla sin hacer completamente nada... ¿Han arreglado algo? (Yo no he modificado esta web recientemente.)
-
The same problem I faced with my website https://hindiallkuchh.com/ some pages are also not indexed like ...
https://hindiallkuchh.com/us-stock-forecast/s-p-500-forecast-2022-2023-2025-2030-2040-2050/
https://hindiallkuchh.com/us-stock-forecast/lucid-stock-forecast-price-prediction/
https://hindiallkuchh.com/us-stock-forecast/rivian-stock-forecast/ -
Did you write anything unfavorable about Microsoft? I wrote an article -- Mac vs. PC. Guess which one won? Guess who de-indexed me shortly after writing it? That's right. Bing, bing, bing.
I don't know about your situation, but Bing was hammering away at my site with two of their bots, even though they de-indexed me. It appears the bot traffic increased after I was de-indexed.
I recommend blocking Bing's bots. Add these to your robots.txt, if you want to block Bing's bots:
User-agent: Bingbot
Disallow: /User-agent: AdIdxBot
Disallow: /Their web crawler throttling thing is a big lie. You can set it to the lowest level, and they still hammer away at your site -- 3.1K bot hits a day. It makes no difference. I don't think anything in Bing Webmaster Central really works well.
-
Bing de-indexed my site, Appledystopia, because I wrote some honest reviews of Microsoft products. Some were favorable, and some not so much, but all were honest.
I have a degree from UCLA and worked as a senior software engineer for 20+ years in the Silicon Valley, so my opinion matters, and my reviews were fair and relevant. Nonetheless, my site was de-indexed.
Even worse, after Bing de-indexes you, they HAMMER AWAY at your site with bots. I was getting 3100 bot hits per day on my site. I believe they do this to slow down one's server -- a sort of legitimate DDoS attack. I researched this, and they assault some sites with bots but not others.
My advice -- if Bing doesn't index you and has no will to do so, block their bots. Just add these lines to your robots.txt:
User-agent: Bingbot
Disallow: /User-agent: AdIdxBot
Disallow: /You can do just fine without Bing. They have such a paltry market share, and they hammer sites with bots so hard it's like a DDoS attack every 24 hours. The increase in bot traffic coincides with de-indexing, so it seems to be a strategy to increase page load times.
I'm fed up with Bing. I'm filing a complaint with the California State Attorney General's office. This is abusive, predatory behavior. If you write anything bad about Microsoft, they will de-index your site from Bing and attack it with bots. When I look at Cloudflare, I see the vast majority of bot traffic is from Bing, and I'm not even indexed. Google doesn't hammer away at your site like this, and neither does Bing if you're in good standing.
The best thing all web publishers can hope for is the end of Bing and DuckDuckGo (they use the Bing index). I'm all for competition with Google, but these search engines don't compete. They just cause problems.
-
Experiencing the same problem with ledburypoetry.org.uk. Page 1 listing on Google, nothing in Bing (or SEs that depend on Bing such as Ecosia). Webmaster tools tell me the URL is known but cannot appear because it 'has issues which are preventing indexation.' Have followed their guidelines as far as possible
Scans come back with 0 errors and just a warning about 'HTML size is too long' but I think that's a Bing error as it's a page with a form on and others have commented on this anomaly elsewhere.
If I submit the URL to Webmaster tools URL Inspection it tells me it's OK and I then submit for inclusion but never have any success it getting the site to appear. Done this several times since September.
I advise everyone I know not to rely on Bing to find what they are looking for as clearly other sites are not listed but my tree-hugging colleague insists on only using Ecosia to search in order to plant more trees so it would be an achievement to get listed again.
Totally frustrated by Bing and wish everyone would stop using it. It is really annoying that on new Windows installs you have to work quite hard to not have Edge and Bing as the default search.
-
This is happening to me too, no idea why. I have logged support tickets and they just give a generic reply about community guidelines.
They added it back into the index to only de index a month later which was odd.
No issues with Google. Any ideas guys?
-
@ganesh_anegondi We just got a reply from Bing support.
"Usually, our Bingbots will take 2 to 3 weeks to crawl any newly added site and start indexing those sites on Bing search results. As it is a SUPER FRESH URLs, it will take a few crawl cycles like 2 to 3 weeks for our bots to index the site on Bing search results."
So, Bing is very slow in terms of crawling and indexing in comparison with Google. Will check and update in 2-3 weeks time.
-
I can see your site in bing.
-
They blocked my email id and support is not responding at all. Come on Bing guys you should tell the reason why the site is blocked.
You blocked it which means you know the reason.
I am also trying to block Bing, This is what I am doing and planning to...
- Block the Bing bot on my site. Go to hell
- Stop using Edge and wherever feasible advocate either Chrome, Firefox, Vivaldi, or Brave.
- Stop using Microsoft office and use Google workspace( It is better)
- Completely move to Linux. Kick Windows...
- Never ever use Bing Search.
We the end user make a product successful, you can't ignore us.
-
We're also having a similar issue with VineHost. Google indexes the site perfectly fine and shows no errors, but Bing just won't crawl at all.
-
@ganesh_anegondi I feel Bing is taking issue with even the minor issues such as no alt tags or lengthy title tag or no description etc. of FinPlay. Will try fixing them and submitting them again.
Raised a support ticket but haven't heard back yet.
-
My site https://www.finplay.in/ is also facing the same problem. Google is indexing the website fine, Bing is ignoring some sections, specifically our financial news section https://finplay.in/news/
Maybe they are considering it as duplicate content? I don't know the issue, will write to support now and keep you posted on how it goes.
-
Buenas tardes,
En el mismo servidor tengo varias webs y todas funcionan correctamente con Bing, salvo https://quitar.wiki que por alguna extraña razon dejo de ser indexada y por más que contacto con el soporte no me ayudan. Concretamente les he pedido que me digan si hice algo mal para corregirlo o lo que necesiten, pero nada.... no facilitan detalles....
Por favor, si alguien logra identificar el problema, compartir en este hilo. ¡Gracias!
Saludos.
-
Opps!...naughty boy, appears I have a ( Meta Description tag missing ).. somewhere deep in the bowels of aussie-slots.com, site was first indexed some 20 years ago and have been de-indexed for the last 2 years.
rogerc -
Did anyone find a way to fix this issue
I have contacted the bing people via email they check my pet website does not break any violations and has 0 penalties.
But it keeps says discovered not crawled
-
@vivesweb said in [Google will index us, but Bing won't. Why?]
Hi. Did you do something special? Like adding domains to disavow list, or something similar? Can you please give us some details about what you've done?
(/community/q/post/330803):
A week ago I received an email from Bing, indicating that they unlocked the domain and proceeded to index it (after 6 months of waiting). Looks like it's starting to come out again. We will have to wait a few weeks to see the result
-
Hi All,
Same issue here with my site.
Not sure what is wrong. Google has indexed it very well and sending traffic.
What is wrong with Bing?
Connected multiple times with support team, below is plain response from them.
What are the different guidlines bing following?
Why not share actual problem if you blocked the site.Thank you for your patience!
After further review, it appears that your site https://www.imaginelinux.com/ did not meet the standards set by Bing the last time it was crawled.
Bing constantly prioritizes the content to be indexed that will drive highest users satisfaction. Please review our Bing Webmaster Guidelines, to better understand criteria for most valuable content.
-
@Alex_RevelInteractive I have the exact same issue. Sort of.
Our root domain is being index and crawled fine, but our support portal with forums at support.example.com is not being either indexed or crawled at all. It is just says "Error" in red in the Bing Webmaster console. Not one single clue to the reason/s why.. -
What happening guys in google and Bing. Both are good search engine, but google is doing their jobs very well but bing didn't. My site https://www.beforecart.com/ also get hit and kicked me out from indexing result. Even they don't allow my post which is error free.
For an example this post which is completly error free kicked off.
https://www.beforecart.com/rivian-stock-price-prediction-2022-2023-2025-2030-2040-2050/I tried everything but noway.. Nothing helped me in this regards.. Still searching.. If anybody help me it would be much helpful for me.
-
My site has been around since 2012 and was indexed by Bing for a long time. Shortly after writing an unfavorable article about Microsoft, my site was de-indexed from Bing. It's not a huge deal. I never got a lot of traffic from Bing -- maybe 3 to 5%. Still, it's good to have that.
I actually wrote a long article about it. I found it upsetting, because their customer service is very Kafkaesque. They keep you in the dark, play games. Bing also indexes porn, white supremacy, InfoWars. Clearly, this is about protecting the Microsoft brand.
My site does quite well on Google. I have hundreds of top ranking pages.
They keep telling me that they can't tell me why there's a block on my site. They removed it, and blocked me again, shortly thereafter.
I'm wondering -- how many of you have written articles about Microsoft? I'm thinking of reporting this as anti-competitive behavior to the California DoJ. It's also possible that competitors are paying off rogue agents at Microsoft, who block sites at the behest of others.
I mean, the KKK website, InfoWars, and all sorts of nasty porn are indexed. Mine site isn't. Yours aren't being indexed either. Clearly, something fishy is going on here!
https://www.appledystopia.com/reviews/bing-sucks/
This makes me appreciate Google all the more.
-
@calvinfab I did as you said, but Bing keeps getting silly errors? while Google search console is still normal? Is it because Bing has a problem recently?
Google gets 80k link index while Bing hasn't received 1k yet? -
I also discovered that all the pages for https://www.thequickweb.com were de-indexed.
I can't still figure the reasons. There is no issues with it on Google.
I am wondering the reasons Bing is de-indexing a lot of websites.
-
Same problem here with https://loveforbikes.com - Bing URL submission tool complained about too long meta descriptions. Fixed - still nohing.
-
So, my site is not perfect, but I cannot see any valid reason here for de-indexing, and has been like this for over a year now.
Any requests to Bing are met with just another canned reply. All good with Google and most other search engines. Would really be nice if they told us just what they are whinging about then we could fix it. I have the feeling that if we presented them with a completely blank site they would still find problems. We live in hope.Website : https://aussie-slots.com/
Status
Completed
4 days ago
Total pages scanned 200
Errors 1
Warnings 127
Issue details
Meta Description tag missing Error 1
Alt attribute for images is missing Warning 116
Meta robots tag contains restrictive robots directives
Warning 7
Title too short Warning 4
More than one h1 tag Notice 71 -
@pbsbluejay I've finally received a reply from them regarding the issue. Let's see if it actually works.
"Firstly, I am happy to provide you information that our Product Review Group succeeded in resolving the issue which prevented your site from showing in our index. After submitting your site to be reviewed, the team has decided to lift the block. Allow up to two to three weeks for your site to be crawled, indexed, and serving again.
I am unable to provide you the specifics of the block, as our Product Review team does not share the details of the block."
-
@Alex_RevelInteractive Keep on contacting support. Check Bing Webmaster Tools - Site Explorere - URLS with malware. Our site showed around 100 URLS with malware.
Verified we did not have anything. Received this response after contacting them around 5 times with "no response" over the course of 3 months.
Thank you for your patience!
I am happy to inform you that the issue related to your site https://removed/ has been resolved.
If your site is not crawled or indexed, it may take up to 2-3 weeks for your site to serve again. Additionally, you can submit your URL using IndexNow feature to get them recrawled faster.
Please review our Webmaster Guidelines, especially the section Things to Avoid, to avoid this in the future.
Please let me know if you have any follow-up questions or concerns and I would be more than happy to assist.
Take care and stay safe!
Sincerely,
Bing Webmaster Support Team -
@ajayporwal8824 ... I received no response from them each time I requested support. It appears Bing is undermanned going by the message you received whereas no one else appears to have received the same reply. At least this tells us they are aware of the indexing/deindexing issues. Please keep us informed here should you hear back from them.
-
We have a 4-year-old website https://droidowl.com/ but Bing still does not index us. We've contacted the Bing support team a month ago stating the issue with some of our sites that are indexed on Google but not on Bing.
This is the reply I am getting for the past month from Bing support
"I have been following up with the Engineering team and haven't heard back from the Engineering team yet and I will keep you posted."
-
Still can't get Bing to index my websites that were indexed for years. Since Bing controls Yahoo's listings, my websites are not appearing in Yahoo as well.
Google, there are no issues whatsoever. Both my sites are indexed.
My Bing Webmaster Tools shows the following...
1. You are a verified administrator - Nothing has changed there
2. Security & Privacy >> Copyright Removal Notices - Nothing listed
3. robots.txt Tester - No issue there; Nothing is being blocked, just the basic code...
User-Agent: *
Disallow:
[Sitemap]4. Blocked URL - I only blocked the cached for many of my site's URLs showing, "Error 404 Not Found"
5. Site Scan shows: Pages Scanned: 1000; Errors: 561; Warnings: 652 - I have been working on this but don't see how my entire website was deindexed for... Meta Description tag missing, Blocked by robots.txt [not the case], Meta robots tag contains restrictive robots directives, Alt attribute for images is missing, Html size is too long, Title too long, Meta Description too long or too short, Title too short, More than one h1 tag, and H1 tag missing.
6. Sitemaps: I corrected/updated my sitemaps weeks ago; All is good
7. Site Explorer - Showing malware for the domain and every URL on my websites.
All my URLs show the following... Discovered but not crawled: The inspected URL is known to Bing but has some issues which are preventing indexation. We recommend you to follow Bing Webmaster Guidelines to increase your chances of indexation. If you think this URL should be indexed, click on Request indexing button. We will index it if we can fetch it and it adheres to Bing Webmaster guidelines. [I clicked the Request Indexing button and still no index]
Other URL issues appear in Site Explorer whereas I'm working on some of that but again I don't see how both my sites and all URLs are a problem to Bing and Yahoo.
Malware Scan at https://sitecheck.sucuri.net/: Domain and other URLs show 'No Malware Found & No Site is not Blacklisted' [Bing shows malware for all my URLs]. Google Search Console shows no malware at all. So I take this as all external backlinks pointing to websites and posts/pages have no malware either.
I have contacted Bing support repeatedly with no response from them. I recall having a similar issue with Bing years ago. They responded quickly and resolved the issue which wasn't my website. Something triggered an alarm on their end. Once they reset things on their end, my website got indexed again.
If anyone has a solution or path to correcting the issue, my ears are open. But I don't think the issue has to do with my websites. I'm leaning more towards the issue being on Bing's side.
-
Hello,
If you are visible in Google Search and want to get visibility in Bing Search you should need to setup bing webmaster account & request to index and distribute ranking in bing search.
And if you don't know how to do all things you should hire an SEO experts company that will help you to get visibility in bing search.
Thanks.
-
Google is crawling my site, but bing is not crawling it.
The inspected URL has been indexed, despite being blocked from crawling by robots.txt. Please make sure that the block is valid as this might prevent us from showing description about the page in the search results.
Last crawl attempted
02 Aug 2022 at 15:16
Crawl allowed?
No
Page Fetch
Failed
Indexing allowed?
Yeshttps://www.aadamrealestate.com/
Any help would be greatly appreciated.
-
My website
https://www.aadamrealestate.com/
is not getting indexed by bingbot, i have added the bing number in rankmath but still nothing
-
Hi, I am facing same issue. Can anyone tell me how to solve this. Please! Here is my website: https://www.thetechlearn.com/
-
Same for me too, Google still index my website. But for Bing I have a problem to index, I don't know why, When I ask Bing to index my website still the crawl errors too. [https://38.242.242.111](link url)
-
Bing is in the dark ages. Give them a few hundred years.
-
My website has the same issue. New pages won't index for some reason. The website is:
Thank you for any advice.
-
Same thing here...
Both my sites were deindexed in Bing and Yahoo over 6 months ago and I didn't know it until now. Both were indexed for years. However, both sites are indexed in Google. You would have thought it would be the other way around if there was some kind of penalty which I don't have the foggiest idea if Bing/Yahoo penalized my sites. Nothing indicates a penalty inside my Bing Webmaster Tools.
It appeared the sitemaps to both my sites needed to be updated and so I did that and resubmitted both sitemaps. It's been days now and both sites are still not indexed in Bing and Yahoo. I sent a support message twice within the week with no response from them. It never took them this long to reply back to me in the past.
-
Same issue is occurring in our website https://www.thepngworld.com/
Any success lead yet?
-
@Alex_RevelInteractive
I had a same problem but got it resolved within 5 months. what I did is I removed broken links from site. I checked inbound and outbound links of the site. I scanned the referring sites in a free virus dectector, I removed inbound and outbound links that were connecting to sites that might have malware. I removed extra local schema which was stuffed into blog posts by rank math. Also checked whether your hosting is blocking bingbot or ask Hosting Support to check if there is malware in site or hosting. After checking all these things, I contacted bing webmaster Support by registering a ticket. It took 5months but site got indexed. -
Same for me too, no problem with Google albeit a bit slow at picking up new pages but on bing my indexed pages have slowly declined for no apparent reason. You get very little information as to how to reduce the crawl errors too. [https://woodleyoutlet.com](link url)
-
i am facing similar issue on my website https://videodownload.online . It was shown in search results before but now completely removed in Bing.
and it is shown in Google search results in first Page . I have contacted Bing support many time but they have sent only Automatic response text mostly . I also checked my website with Bing Webmasters tool which say this website can be shown in Search Results and i sent these screenshots to Bing support too . But there is not any valid response from Bing . I think this is the reason why Google is no. 1 search Engine and Bing is not near to it .
-
A week ago I received an email from Bing, indicating that they unlocked the domain and proceeded to index it (after 6 months of waiting). Looks like it's starting to come out again. We will have to wait a few weeks to see the result
-
I have had the same problem for at least two years and BING are totally unhelpful. Don’t hold your breath wating for help from BING. There won’t be any, you will wait for weeks and they will eventually say something like you should rebuild your site from scratch or you could sign up for paid BING advertising.
Rant over. There are thousands of people with similar issues and I’m sure many who have no clue they have effectively been blacklisted by BING.
Another approach that might help is if victims can come up with some common factors between effected sites.
In webmaster tools I check a URL it says the page it fine and can be indexed, but it also says there it too much html. My site has 85 pages and all have the same problem. If I create a very simple page it has the same problem
My site is running, Latest WordPress, Divi theme and Yoast Premium.
Other plugins that have been in use during this period are.
Accept Stripe payments
GDPR Cookie Consent,
Malcare
Monster insights EU-Compliance
Monster Insights pro
Really Simple SSL pro
WP Chat App
WP Fastest Cache premium
I am using Cloudflare CDN. I have never had any problems with Google. -
@alex_revelinteractive said in Google will index us, but Bing won't. Why?:
Bing is crawling our site, but not indexing it, and we cannot figure out why -- plus it's being indexed fine in Google. Any ideas on what the issue with Bing might be?
Here's are some details to let you know what we've already checked/established:
- We have 4 301’s and the rest of our site checks out
- We’ve already established our Robots is ok, and that we are fixing our site map/it's in fine shape
- We do not see anything blocking bingbot access to the site
- There is no varnish or any load balancers, so nothing on that end that would be blocking the access
- We also don't see any rules in the apache or the .htaccess config that would be blocking the access
yes, I have the same problem with my www.seodiscovery.com website, we are no1 for best SEO company in India but do not coming in the top 10 for bing.com
-
Without seeing your website with the structure and technical settings it is rather hard to say which reasons are responsible. Usually making request to Bing Webmastertools should index your pages easily.
-
rogerc@aussie-slots.com...Not sure why I am replying to these posts, probably just frustrated with Bing. As with a few others my site https://aussie-slots dot com appears on Google no problem but not on Bing, it dropped out 2 years ago after being indexed for some 20 years. Why the devil can they not just tell me what exactly they are whinging about as I can find nothing that would exempt the site from being indexed ??
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How can I get a photo album indexed by Google?
We have a lot of photos on our website. Unfortunately most of them don't seem to be indexed by Google. We run a party website. One of the things we do, is take pictures at events and put them on the site. An event page with a photo album, can have anywhere between 100 and 750 photo's. For each foto's there is a thumbnail on the page. The thumbnails are lazy loaded by showing a placeholder and loading the picture right before it comes onscreen. There is no pagination of infinite scrolling. Thumbnails don't have an alt text. Each thumbnail links to a picture page. This page only shows the base HTML structure (menu, etc), the image and a close button. The image has a src attribute with full size image, a srcset with several sizes for responsive design and an alt text. There is no real textual content on an image page. (Note that when a user clicks on the thumbnail, the large image is loaded using JavaScript and we mimic the page change. I think it doesn't matter, but am unsure.) I'd like that full size images should be indexed by Google and found with Google image search. Thumbnails should not be indexed (or ignored). Unfortunately most pictures aren't found or their thumbnail is shown. Moz is giving telling me that all the picture pages are duplicate content (19,521 issues), as they are all the same with the exception of the image. The page title isn't the same but similar for all images of an album. Example: On the "A day at the park" event page, we have 136 pictures. A site search on "a day at the park" foto, only reveals two photo's of the albums. 3QolbbI.png QTQVxqY.jpg mwEG90S.jpg
Technical SEO | | jasny0 -
Site indexed by Google, but (almost) never gets impressions
Hi there, I have a question that I wasn't able to give it a reasonable answer yet, so I'm going to trust on all of you. Basically a site has all its pages indexed by Google (I verified with site:sitename.com) and it also has great and unique content. All on-page grades are A with absolutely no negative factors at all. However its pages do not get impressions almost at all. Of course I didn't expect it to be on page 1 since it has been launched on Dec, 1st, but it looks like Google is ignoring (or giving it bad scores) for some reason. Only things that can contribute to that could be: domain privacy on the domain, redirect from the www to the subdomain we use (we did this because it will be a multi-language site, so we'll assign to each country a subdomain), recency (it has been put online on Dec 1st and the domain is just a couple of months old). Or maybe because we blocked crawlers for a few days before the launch? Exactly a few days before Dec 1st. What do you think? What could be the reason for that? Thanks guys!
Technical SEO | | ruggero0 -
My video sitemap is not being index by Google
Dear friends, I have a videos portal. I created a video sitemap.xml and submit in to GWT but after 20 days it has not been indexed. I have verified in bing webmaster as well. All videos are dynamically being fetched from server. My all static pages have been indexed but not videos. Please help me where am I doing the mistake. There are no separate pages for single videos. All the content is dynamically coming from server. Please help me. your answers will be more appreciated................. Thanks
Technical SEO | | docbeans0 -
How to Remove /feed URLs from Google's Index
Hey everyone, I have an issue with RSS /feed URLs being indexed by Google for some of our Wordpress sites. Have a look at this Google query, and click to show omitted search results. You'll see we have 500+ /feed URLs indexed by Google, for our many category pages/etc. Here is one of the example URLs: http://www.howdesign.com/design-creativity/fonts-typography/letterforms/attachment/gilhelveticatrade/feed/. Based on this content/code of the XML page, it looks like Wordpress is generating these: <generator>http://wordpress.org/?v=3.5.2</generator> Any idea how to get them out of Google's index without 301 redirecting them? We need the Wordpress-generated RSS feeds to work for various uses. My first two thoughts are trying to work with our Development team to see if we can get a "noindex" meta robots tag on the pages, by they are dynamically-generated pages...so I'm not sure if that will be possible. Or, perhaps we can add a "feed" paramater to GWT "URL Parameters" section...but I don't want to limit Google from crawling these again...I figure I need Google to crawl them and see some code that says to get the pages out of their index...and THEN not crawl the pages anymore. I don't think the "Remove URL" feature in GWT will work, since that tool only removes URLs from the search results, not the actual Google index. FWIW, this site is using the Yoast plugin. We set every page type to "noindex" except for the homepage, Posts, Pages and Categories. We have other sites on Yoast that do not have any /feed URLs indexed by Google at all. Side note, the /robots.txt file was previously blocking crawling of the /feed URLs on this site, which is why you'll see that note in the Google SERPs when you click on the query link given in the first paragraph.
Technical SEO | | M_D_Golden_Peak0 -
How to remove all sandbox test site link indexed by google?
When develop site, I have a test domain is sandbox.abc.com, this site contents are same as abc.com. But, now I search site:sandbox.abc.com and aware of content duplicate with main site abc.com My question is how to remove all this link from goolge. p/s: I have just add robots.txt to sandbox and disallow all pages. Thanks,
Technical SEO | | JohnHuynh0 -
Pages removed from Google index?
Hi All, I had around 2,300 pages in the google index until a week ago. The index removed a load and left me with 152 submitted, 152 indexed? I have just re-submitted my sitemap and will wait to see what happens. Any idea why it has done this? I have seen a drop in my rankings since. Thanks
Technical SEO | | TomLondon0 -
CDN Being Crawled and Indexed by Google
I'm doing a SEO site audit, and I've discovered that the site uses a Content Delivery Network (CDN) that's being crawled and indexed by Google. There are two sub-domains from the CDN that are being crawled and indexed. A small number of organic search visitors have come through these two sub domains. So the CDN based content is out-ranking the root domain, in a small number of cases. It's a huge duplicate content issue (tens of thousands of URLs being crawled) - what's the best way to prevent the crawling and indexing of a CDN like this? Exclude via robots.txt? Additionally, the use of relative canonical tags (instead of absolute) appear to be contributing to this problem as well. As I understand it, these canonical tags are telling the SEs that each sub domain is the "home" of the content/URL. Thanks! Scott
Technical SEO | | Scott-Thomas0 -
Site not ranking in Google but comes up #1 in Yahoo and Bing
Hi everyone, I've been working on SEO for this site for about 2 years and for some reason the site has just tanked in google. However it shows up #1 in yahoo and bing for the same search. http://www.nfsmn.com Phrase: "commercial foundation repair mn" If anyone can shed some light on the issue I would really appreciate it. They do have a sister-site: american-waterworks.com that may be causing issues as they link a lot of content to amww but not the other way around. Thanks Eric
Technical SEO | | reynoldsdesign0