Google will index us, but Bing won't. Why?
-
Same issue on my website GGTalks . I have tried everything including reaching them out on mail and forums but always no response or automated response
-
We also have the same problem with our website stirile , images are indexed but links not, in webmaster tools shows that we have some links indexed... What to do?
-
Bing Webmasters shows 127 indexed pages for aussie-slots.com yet none of them display using site: in bing search ??
-
Yes, we are also facing this issue.
Our Website is [webtracktechnologies.com](link url)
We are getting different results on searching keyword "webtracktechnologies" from Google and Bing.
The Main difference is that we are getting same results in SERP of Google as we have written in our website's Title and description but Bing is showing different results. -
What just happened to me is surprising... after a long time without Bing showing my website https://poema.es in its results, this week it has shown it again without doing anything... Have you fixed something? (I have not modified this website recently.)
Respuesta original en español: Es sorprendente lo que me acaba de pasar.... despues de mucho tiempo sin que Bing vuelva a mostrar mi web https://poema.es en sus resultados, esta semana ha vuelto a mostrarla sin hacer completamente nada... ¿Han arreglado algo? (Yo no he modificado esta web recientemente.)
-
The same problem I faced with my website https://hindiallkuchh.com/ some pages are also not indexed like ...
https://hindiallkuchh.com/us-stock-forecast/s-p-500-forecast-2022-2023-2025-2030-2040-2050/
https://hindiallkuchh.com/us-stock-forecast/lucid-stock-forecast-price-prediction/
https://hindiallkuchh.com/us-stock-forecast/rivian-stock-forecast/ -
Did you write anything unfavorable about Microsoft? I wrote an article -- Mac vs. PC. Guess which one won? Guess who de-indexed me shortly after writing it? That's right. Bing, bing, bing.
I don't know about your situation, but Bing was hammering away at my site with two of their bots, even though they de-indexed me. It appears the bot traffic increased after I was de-indexed.
I recommend blocking Bing's bots. Add these to your robots.txt, if you want to block Bing's bots:
User-agent: Bingbot
Disallow: /User-agent: AdIdxBot
Disallow: /Their web crawler throttling thing is a big lie. You can set it to the lowest level, and they still hammer away at your site -- 3.1K bot hits a day. It makes no difference. I don't think anything in Bing Webmaster Central really works well.
-
Bing de-indexed my site, Appledystopia, because I wrote some honest reviews of Microsoft products. Some were favorable, and some not so much, but all were honest.
I have a degree from UCLA and worked as a senior software engineer for 20+ years in the Silicon Valley, so my opinion matters, and my reviews were fair and relevant. Nonetheless, my site was de-indexed.
Even worse, after Bing de-indexes you, they HAMMER AWAY at your site with bots. I was getting 3100 bot hits per day on my site. I believe they do this to slow down one's server -- a sort of legitimate DDoS attack. I researched this, and they assault some sites with bots but not others.
My advice -- if Bing doesn't index you and has no will to do so, block their bots. Just add these lines to your robots.txt:
User-agent: Bingbot
Disallow: /User-agent: AdIdxBot
Disallow: /You can do just fine without Bing. They have such a paltry market share, and they hammer sites with bots so hard it's like a DDoS attack every 24 hours. The increase in bot traffic coincides with de-indexing, so it seems to be a strategy to increase page load times.
I'm fed up with Bing. I'm filing a complaint with the California State Attorney General's office. This is abusive, predatory behavior. If you write anything bad about Microsoft, they will de-index your site from Bing and attack it with bots. When I look at Cloudflare, I see the vast majority of bot traffic is from Bing, and I'm not even indexed. Google doesn't hammer away at your site like this, and neither does Bing if you're in good standing.
The best thing all web publishers can hope for is the end of Bing and DuckDuckGo (they use the Bing index). I'm all for competition with Google, but these search engines don't compete. They just cause problems.
-
Experiencing the same problem with ledburypoetry.org.uk. Page 1 listing on Google, nothing in Bing (or SEs that depend on Bing such as Ecosia). Webmaster tools tell me the URL is known but cannot appear because it 'has issues which are preventing indexation.' Have followed their guidelines as far as possible
Scans come back with 0 errors and just a warning about 'HTML size is too long' but I think that's a Bing error as it's a page with a form on and others have commented on this anomaly elsewhere.
If I submit the URL to Webmaster tools URL Inspection it tells me it's OK and I then submit for inclusion but never have any success it getting the site to appear. Done this several times since September.
I advise everyone I know not to rely on Bing to find what they are looking for as clearly other sites are not listed but my tree-hugging colleague insists on only using Ecosia to search in order to plant more trees so it would be an achievement to get listed again.
Totally frustrated by Bing and wish everyone would stop using it. It is really annoying that on new Windows installs you have to work quite hard to not have Edge and Bing as the default search.
-
This is happening to me too, no idea why. I have logged support tickets and they just give a generic reply about community guidelines.
They added it back into the index to only de index a month later which was odd.
No issues with Google. Any ideas guys?
-
@ganesh_anegondi We just got a reply from Bing support.
"Usually, our Bingbots will take 2 to 3 weeks to crawl any newly added site and start indexing those sites on Bing search results. As it is a SUPER FRESH URLs, it will take a few crawl cycles like 2 to 3 weeks for our bots to index the site on Bing search results."
So, Bing is very slow in terms of crawling and indexing in comparison with Google. Will check and update in 2-3 weeks time.
-
I can see your site in bing.
-
They blocked my email id and support is not responding at all. Come on Bing guys you should tell the reason why the site is blocked.
You blocked it which means you know the reason.
I am also trying to block Bing, This is what I am doing and planning to...
- Block the Bing bot on my site. Go to hell
- Stop using Edge and wherever feasible advocate either Chrome, Firefox, Vivaldi, or Brave.
- Stop using Microsoft office and use Google workspace( It is better)
- Completely move to Linux. Kick Windows...
- Never ever use Bing Search.
We the end user make a product successful, you can't ignore us.
-
We're also having a similar issue with VineHost. Google indexes the site perfectly fine and shows no errors, but Bing just won't crawl at all.
-
@ganesh_anegondi I feel Bing is taking issue with even the minor issues such as no alt tags or lengthy title tag or no description etc. of FinPlay. Will try fixing them and submitting them again.
Raised a support ticket but haven't heard back yet.
-
My site https://www.finplay.in/ is also facing the same problem. Google is indexing the website fine, Bing is ignoring some sections, specifically our financial news section https://finplay.in/news/
Maybe they are considering it as duplicate content? I don't know the issue, will write to support now and keep you posted on how it goes.
-
Buenas tardes,
En el mismo servidor tengo varias webs y todas funcionan correctamente con Bing, salvo https://quitar.wiki que por alguna extraña razon dejo de ser indexada y por más que contacto con el soporte no me ayudan. Concretamente les he pedido que me digan si hice algo mal para corregirlo o lo que necesiten, pero nada.... no facilitan detalles....
Por favor, si alguien logra identificar el problema, compartir en este hilo. ¡Gracias!
Saludos.
-
Opps!...naughty boy, appears I have a ( Meta Description tag missing ).. somewhere deep in the bowels of aussie-slots.com, site was first indexed some 20 years ago and have been de-indexed for the last 2 years.
rogerc -
Did anyone find a way to fix this issue
I have contacted the bing people via email they check my pet website does not break any violations and has 0 penalties.
But it keeps says discovered not crawled
-
@vivesweb said in [Google will index us, but Bing won't. Why?]
Hi. Did you do something special? Like adding domains to disavow list, or something similar? Can you please give us some details about what you've done?
(/community/q/post/330803):
A week ago I received an email from Bing, indicating that they unlocked the domain and proceeded to index it (after 6 months of waiting). Looks like it's starting to come out again. We will have to wait a few weeks to see the result
-
Hi All,
Same issue here with my site.
Not sure what is wrong. Google has indexed it very well and sending traffic.
What is wrong with Bing?
Connected multiple times with support team, below is plain response from them.
What are the different guidlines bing following?
Why not share actual problem if you blocked the site.Thank you for your patience!
After further review, it appears that your site https://www.imaginelinux.com/ did not meet the standards set by Bing the last time it was crawled.
Bing constantly prioritizes the content to be indexed that will drive highest users satisfaction. Please review our Bing Webmaster Guidelines, to better understand criteria for most valuable content.
-
@Alex_RevelInteractive I have the exact same issue. Sort of.
Our root domain is being index and crawled fine, but our support portal with forums at support.example.com is not being either indexed or crawled at all. It is just says "Error" in red in the Bing Webmaster console. Not one single clue to the reason/s why.. -
What happening guys in google and Bing. Both are good search engine, but google is doing their jobs very well but bing didn't. My site https://www.beforecart.com/ also get hit and kicked me out from indexing result. Even they don't allow my post which is error free.
For an example this post which is completly error free kicked off.
https://www.beforecart.com/rivian-stock-price-prediction-2022-2023-2025-2030-2040-2050/I tried everything but noway.. Nothing helped me in this regards.. Still searching.. If anybody help me it would be much helpful for me.
-
My site has been around since 2012 and was indexed by Bing for a long time. Shortly after writing an unfavorable article about Microsoft, my site was de-indexed from Bing. It's not a huge deal. I never got a lot of traffic from Bing -- maybe 3 to 5%. Still, it's good to have that.
I actually wrote a long article about it. I found it upsetting, because their customer service is very Kafkaesque. They keep you in the dark, play games. Bing also indexes porn, white supremacy, InfoWars. Clearly, this is about protecting the Microsoft brand.
My site does quite well on Google. I have hundreds of top ranking pages.
They keep telling me that they can't tell me why there's a block on my site. They removed it, and blocked me again, shortly thereafter.
I'm wondering -- how many of you have written articles about Microsoft? I'm thinking of reporting this as anti-competitive behavior to the California DoJ. It's also possible that competitors are paying off rogue agents at Microsoft, who block sites at the behest of others.
I mean, the KKK website, InfoWars, and all sorts of nasty porn are indexed. Mine site isn't. Yours aren't being indexed either. Clearly, something fishy is going on here!
https://www.appledystopia.com/reviews/bing-sucks/
This makes me appreciate Google all the more.
-
@calvinfab I did as you said, but Bing keeps getting silly errors? while Google search console is still normal? Is it because Bing has a problem recently?
Google gets 80k link index while Bing hasn't received 1k yet? -
I also discovered that all the pages for https://www.thequickweb.com were de-indexed.
I can't still figure the reasons. There is no issues with it on Google.
I am wondering the reasons Bing is de-indexing a lot of websites.
-
Same problem here with https://loveforbikes.com - Bing URL submission tool complained about too long meta descriptions. Fixed - still nohing.
-
So, my site is not perfect, but I cannot see any valid reason here for de-indexing, and has been like this for over a year now.
Any requests to Bing are met with just another canned reply. All good with Google and most other search engines. Would really be nice if they told us just what they are whinging about then we could fix it. I have the feeling that if we presented them with a completely blank site they would still find problems. We live in hope.Website : https://aussie-slots.com/
Status
Completed
4 days ago
Total pages scanned 200
Errors 1
Warnings 127
Issue details
Meta Description tag missing Error 1
Alt attribute for images is missing Warning 116
Meta robots tag contains restrictive robots directives
Warning 7
Title too short Warning 4
More than one h1 tag Notice 71 -
@pbsbluejay I've finally received a reply from them regarding the issue. Let's see if it actually works.
"Firstly, I am happy to provide you information that our Product Review Group succeeded in resolving the issue which prevented your site from showing in our index. After submitting your site to be reviewed, the team has decided to lift the block. Allow up to two to three weeks for your site to be crawled, indexed, and serving again.
I am unable to provide you the specifics of the block, as our Product Review team does not share the details of the block."
-
@Alex_RevelInteractive Keep on contacting support. Check Bing Webmaster Tools - Site Explorere - URLS with malware. Our site showed around 100 URLS with malware.
Verified we did not have anything. Received this response after contacting them around 5 times with "no response" over the course of 3 months.
Thank you for your patience!
I am happy to inform you that the issue related to your site https://removed/ has been resolved.
If your site is not crawled or indexed, it may take up to 2-3 weeks for your site to serve again. Additionally, you can submit your URL using IndexNow feature to get them recrawled faster.
Please review our Webmaster Guidelines, especially the section Things to Avoid, to avoid this in the future.
Please let me know if you have any follow-up questions or concerns and I would be more than happy to assist.
Take care and stay safe!
Sincerely,
Bing Webmaster Support Team -
@ajayporwal8824 ... I received no response from them each time I requested support. It appears Bing is undermanned going by the message you received whereas no one else appears to have received the same reply. At least this tells us they are aware of the indexing/deindexing issues. Please keep us informed here should you hear back from them.
-
We have a 4-year-old website https://droidowl.com/ but Bing still does not index us. We've contacted the Bing support team a month ago stating the issue with some of our sites that are indexed on Google but not on Bing.
This is the reply I am getting for the past month from Bing support
"I have been following up with the Engineering team and haven't heard back from the Engineering team yet and I will keep you posted."
-
Still can't get Bing to index my websites that were indexed for years. Since Bing controls Yahoo's listings, my websites are not appearing in Yahoo as well.
Google, there are no issues whatsoever. Both my sites are indexed.
My Bing Webmaster Tools shows the following...
1. You are a verified administrator - Nothing has changed there
2. Security & Privacy >> Copyright Removal Notices - Nothing listed
3. robots.txt Tester - No issue there; Nothing is being blocked, just the basic code...
User-Agent: *
Disallow:
[Sitemap]4. Blocked URL - I only blocked the cached for many of my site's URLs showing, "Error 404 Not Found"
5. Site Scan shows: Pages Scanned: 1000; Errors: 561; Warnings: 652 - I have been working on this but don't see how my entire website was deindexed for... Meta Description tag missing, Blocked by robots.txt [not the case], Meta robots tag contains restrictive robots directives, Alt attribute for images is missing, Html size is too long, Title too long, Meta Description too long or too short, Title too short, More than one h1 tag, and H1 tag missing.
6. Sitemaps: I corrected/updated my sitemaps weeks ago; All is good
7. Site Explorer - Showing malware for the domain and every URL on my websites.
All my URLs show the following... Discovered but not crawled: The inspected URL is known to Bing but has some issues which are preventing indexation. We recommend you to follow Bing Webmaster Guidelines to increase your chances of indexation. If you think this URL should be indexed, click on Request indexing button. We will index it if we can fetch it and it adheres to Bing Webmaster guidelines. [I clicked the Request Indexing button and still no index]
Other URL issues appear in Site Explorer whereas I'm working on some of that but again I don't see how both my sites and all URLs are a problem to Bing and Yahoo.
Malware Scan at https://sitecheck.sucuri.net/: Domain and other URLs show 'No Malware Found & No Site is not Blacklisted' [Bing shows malware for all my URLs]. Google Search Console shows no malware at all. So I take this as all external backlinks pointing to websites and posts/pages have no malware either.
I have contacted Bing support repeatedly with no response from them. I recall having a similar issue with Bing years ago. They responded quickly and resolved the issue which wasn't my website. Something triggered an alarm on their end. Once they reset things on their end, my website got indexed again.
If anyone has a solution or path to correcting the issue, my ears are open. But I don't think the issue has to do with my websites. I'm leaning more towards the issue being on Bing's side.
-
Hello,
If you are visible in Google Search and want to get visibility in Bing Search you should need to setup bing webmaster account & request to index and distribute ranking in bing search.
And if you don't know how to do all things you should hire an SEO experts company that will help you to get visibility in bing search.
Thanks.
-
Google is crawling my site, but bing is not crawling it.
The inspected URL has been indexed, despite being blocked from crawling by robots.txt. Please make sure that the block is valid as this might prevent us from showing description about the page in the search results.
Last crawl attempted
02 Aug 2022 at 15:16
Crawl allowed?
No
Page Fetch
Failed
Indexing allowed?
Yeshttps://www.aadamrealestate.com/
Any help would be greatly appreciated.
-
My website
https://www.aadamrealestate.com/
is not getting indexed by bingbot, i have added the bing number in rankmath but still nothing
-
Hi, I am facing same issue. Can anyone tell me how to solve this. Please! Here is my website: https://www.thetechlearn.com/
-
Same for me too, Google still index my website. But for Bing I have a problem to index, I don't know why, When I ask Bing to index my website still the crawl errors too. [https://38.242.242.111](link url)
-
Bing is in the dark ages. Give them a few hundred years.
-
My website has the same issue. New pages won't index for some reason. The website is:
Thank you for any advice.
-
Same thing here...
Both my sites were deindexed in Bing and Yahoo over 6 months ago and I didn't know it until now. Both were indexed for years. However, both sites are indexed in Google. You would have thought it would be the other way around if there was some kind of penalty which I don't have the foggiest idea if Bing/Yahoo penalized my sites. Nothing indicates a penalty inside my Bing Webmaster Tools.
It appeared the sitemaps to both my sites needed to be updated and so I did that and resubmitted both sitemaps. It's been days now and both sites are still not indexed in Bing and Yahoo. I sent a support message twice within the week with no response from them. It never took them this long to reply back to me in the past.
-
Same issue is occurring in our website https://www.thepngworld.com/
Any success lead yet?
-
@Alex_RevelInteractive
I had a same problem but got it resolved within 5 months. what I did is I removed broken links from site. I checked inbound and outbound links of the site. I scanned the referring sites in a free virus dectector, I removed inbound and outbound links that were connecting to sites that might have malware. I removed extra local schema which was stuffed into blog posts by rank math. Also checked whether your hosting is blocking bingbot or ask Hosting Support to check if there is malware in site or hosting. After checking all these things, I contacted bing webmaster Support by registering a ticket. It took 5months but site got indexed. -
Same for me too, no problem with Google albeit a bit slow at picking up new pages but on bing my indexed pages have slowly declined for no apparent reason. You get very little information as to how to reduce the crawl errors too. [https://woodleyoutlet.com](link url)
-
i am facing similar issue on my website https://videodownload.online . It was shown in search results before but now completely removed in Bing.
and it is shown in Google search results in first Page . I have contacted Bing support many time but they have sent only Automatic response text mostly . I also checked my website with Bing Webmasters tool which say this website can be shown in Search Results and i sent these screenshots to Bing support too . But there is not any valid response from Bing . I think this is the reason why Google is no. 1 search Engine and Bing is not near to it .
-
A week ago I received an email from Bing, indicating that they unlocked the domain and proceeded to index it (after 6 months of waiting). Looks like it's starting to come out again. We will have to wait a few weeks to see the result
-
I have had the same problem for at least two years and BING are totally unhelpful. Don’t hold your breath wating for help from BING. There won’t be any, you will wait for weeks and they will eventually say something like you should rebuild your site from scratch or you could sign up for paid BING advertising.
Rant over. There are thousands of people with similar issues and I’m sure many who have no clue they have effectively been blacklisted by BING.
Another approach that might help is if victims can come up with some common factors between effected sites.
In webmaster tools I check a URL it says the page it fine and can be indexed, but it also says there it too much html. My site has 85 pages and all have the same problem. If I create a very simple page it has the same problem
My site is running, Latest WordPress, Divi theme and Yoast Premium.
Other plugins that have been in use during this period are.
Accept Stripe payments
GDPR Cookie Consent,
Malcare
Monster insights EU-Compliance
Monster Insights pro
Really Simple SSL pro
WP Chat App
WP Fastest Cache premium
I am using Cloudflare CDN. I have never had any problems with Google. -
@alex_revelinteractive said in Google will index us, but Bing won't. Why?:
Bing is crawling our site, but not indexing it, and we cannot figure out why -- plus it's being indexed fine in Google. Any ideas on what the issue with Bing might be?
Here's are some details to let you know what we've already checked/established:
- We have 4 301’s and the rest of our site checks out
- We’ve already established our Robots is ok, and that we are fixing our site map/it's in fine shape
- We do not see anything blocking bingbot access to the site
- There is no varnish or any load balancers, so nothing on that end that would be blocking the access
- We also don't see any rules in the apache or the .htaccess config that would be blocking the access
yes, I have the same problem with my www.seodiscovery.com website, we are no1 for best SEO company in India but do not coming in the top 10 for bing.com
-
Without seeing your website with the structure and technical settings it is rather hard to say which reasons are responsible. Usually making request to Bing Webmastertools should index your pages easily.
-
rogerc@aussie-slots.com...Not sure why I am replying to these posts, probably just frustrated with Bing. As with a few others my site https://aussie-slots dot com appears on Google no problem but not on Bing, it dropped out 2 years ago after being indexed for some 20 years. Why the devil can they not just tell me what exactly they are whinging about as I can find nothing that would exempt the site from being indexed ??
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google is indexing bad URLS
Hi All, The site I am working on is built on Wordpress. The plugin Revolution Slider was downloaded. While no longer utilized, it still remained on the site for some time. This plugin began creating hundreds of URLs containing nothing but code on the page. I noticed these URLs were being indexed by Google. The URLs follow the structure: www.mysite.com/wp-content/uploads/revslider/templates/this-part-changes/ I have done the following to prevent these URLs from being created & indexed: 1. Added a directive in my Htaccess to 404 all of these URLs 2. Blocked /wp-content/uploads/revslider/ in my robots.txt 3. Manually de-inedex each URL using the GSC tool 4. Deleted the plugin However, new URLs still appear in Google's index, despite being blocked by robots.txt and resolving to a 404. Can anyone suggest any next steps? I Thanks!
Technical SEO | | Tom3_150 -
Review rich snippet isn't appearing anymore
Hi, We have recently lost the review rich snippet for product that used to consistently show it for a long time. On top of that we have also lost the breadcrumb. The markup hasn't changed on these pages and gwt data tool tester doesn't show any anomalies. A few weeks back we have deployed a new property that list reviews from the first site without actually being under the same domain. Would that be an issue, review may have been considered as plagiarism somehow? Is there a way for us to confirm this theory? What are others factors that may have lead us to lose those rich snippet? Thanks
Technical SEO | | mattam0 -
Google's ability to crawl AJAX rendered content
I would like to make a change to the way our main navigation is currently rendered on our e-commerce site. Currently, all of the content that appears when you click a navigation category is rendering on page load. This is currently a large portion of every page visit’s bandwidth and even the images are downloaded even if a user doesn’t choose to use the navigation. I’d like to change it so the content appears and is downloaded only IF the user clicks on it, I'm planning on using AJAX. As that is the case it wouldn’t not be automatically on the site(which may or may not mean Google would crawl it). As we already provide a sitemap.xml for Google I want to make sure this change would not adversely affect our SEO. As of October this year the Webmaster AJAX crawling doc. suggestions has been depreciated. While the new version does say that its crawlers are smart enough to render AJAX content, something I've tested, I'm not sure if that only applies to content injected on page load as opposed to in click like I'm planning to do.
Technical SEO | | znotes0 -
Which factors are effect on Google index?
Mywebsite have 455 URL submitedbut only 77 URLs are indexed. How can i improve more indexed URL?
Technical SEO | | magician0 -
Bing indexing
Hello, people~ I want to discuss about Bing indexation. I have a new web site which opened about 3 months ago. Google has no problem to index my site and all pages within the site indexed by Google. However, Bing and Yahoo is different story. I used manual submission, Bing webmaster tool to let Bing know about the site. However, Bing is not indexing my site yet. I researched about it and found that my site should have some external links before I get index by Bing. I check external links of my site with Google webmaster tool, SEOmoz tool and "link:" on Google. All tools show different number as below. Google webmaster Tool : more than 50 SEMoz site explorer : 5 link: on Google: none Why all method of checking links are different and which on should most depend on? Also how many links should I have in order to get index by Bing? Could you people please share your opinion?
Technical SEO | | Artience0 -
Negative effect on google SEO with 301's?
Cleaning up the website by consolidating pages - each with a little bit of useful info - into one definitive page that is really useful and full of good content. Doing 301's from the many old pages to the one new really good one. Didn't want to do rel canonicals because I don't want the old pages around, I want to get rid of them. Will google see the 301s and go nuts or see that there is one definitive, really good page with no duplicate content? The change is very good from a user perspective. Also, On-Page Report Cards on SEOMoz suggests that you put a rel canonical on a page to itself to tell google that this page is the definitive page. What do you think? Thanks so much for anyone who has time to answer - so many gurus - this is a great forum. - jean
Technical SEO | | JeanYates0 -
Google is indexing proxy (mirror) site.
We moved the site to a new hosting. Previously the site used Godaddy Windows Hosting with white domain masking. After moving the site we just mirrored the site. We have to use mirrored domain for PPC campaigns because it mirrored site contains true BRAND name and there is better conversion with that domain plus all trade marked keywords are approved for mirrored domain. Robots.txt User-agent: * Host: www.hermitagejewelers.com Disallow: /Bin Disallow: /css www.hermitagejewelers.com is the main domain. Mirror site is www.ermitagejewelers.com (Without the "H" at the beginning) Most of the keywords are now picked up by mirror site. I have not noticed any major changes in ranking except that it ranks for mirror site. We updated the sitemap. Website is designed very poorly (not by us). Also, we submitted the change address request for ermitagejewelers to hermitagejewelers in webmasters. Please let me know any advice to fix that problem. Thank you.
Technical SEO | | MaxRuso1 -
How do I use the Robots.txt "disallow" command properly for folders I don't want indexed?
Today's sitemap webinar made me think about the disallow feature, seems opposite of sitemaps, but it also seems both are kind of ignored in varying ways by the engines. I don't need help semantically, I got that part. I just can't seem to find a contemporary answer about what should be blocked using the robots.txt file. For example, I have folders containing site comps for clients that I really don't want showing up in the SERPS. Is it better to not have these folders on the domain at all? There are also security issues I've heard of that make sense, simply look at a site's robots file to see what they are hiding. It makes it easier to hunt for files when they know the directory the files are contained in. Do I concern myself with this? Another example is a folder I have for my xml sitemap generator. I imagine google isn't going to try to index this or count it as content, so do I need to add folders like this to the disallow list?
Technical SEO | | SpringMountain0