Sitemap Folders on Search Results
-
Hello!
We are managing SEO campaign of a video website. We have an issue about sitemap folders.
I have sitemaps like ** /xml/sitemap-name.xml .** But Google is indexing my /xml/ folder and also sitemaps and they appear in search results.
If i will add Disallow: /xml/ to my robots.txt and remove /xml/ folder from webmaster tools, Google could see my sitemaps? or it ignores them?
Will my site effect negatively after remove /xml/ folder completely from search results?
What should i do?
-
Hi Ahmet
I don't think the sitemap indexed is an issue. Also I wouldn't block it with robots.txt - cause they won't be able to crawl it!
-Dan
-
Hi Ahmet,
You could give it at try by add the lines to your robots.txt for a second and testing your sitemap from within Google Webmaster Tools to see if it's working. I can't give you a definitive answer on this one. In the cases I handled I just accepted that these sitemaps were ranking for some long long long tail queries.
-
Hi Martijn,
I wonder if i block my sitemaps from robots.txt, could google bot reach my sitemaps?
-
Hi Ahmet,
I've seen this a dozen times, somehow Google thinks site maps are in some way great content as they are putting them within the search results. But by using the Disallow in your robots.txt Google won't be able to find your sitemap, or at least they will provide you with an error because you excluded them.
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Suddenly keywords Disappeared from Google Search Results
Hello Guys Please help me, suddenly all of my site's keywords are disappeared from google search result, most of keywords are no.1 on google but today after 6pm i see the traffic decreasing and when i search my keywords there is no any keywords in search result. Only homepage keyword is showing. Please Help what is Happening with me.
Intermediate & Advanced SEO | | mianazeem4180 -
New page not topping on results
Hi, We have created a new page on our website for same keyword in slug but the page is not showing up for same keyword even combined with website name: website.com/keyword is new page and not listing on top of results for exact search query "website keyword". This page is listing as 3rd result and other pages are making on top even they don't match with page title, h1 tags and URL. This new page is indexed. How long it'll take to Google to adopt this? I don't think it'll remain same forever. Is there anything we can do from our end?
Intermediate & Advanced SEO | | vtmoz0 -
Editing A Sitemap
Would there be any positive effect from editing a site map down to a more curated list of pages that perform, or that we hope they begin to perform, in organic search? A site I work with has a sitemap with about 20,000 pages that is automatically created out of a Drupal plugin. Of those pages, only about 10% really produce out of search. There are old sections of the site that are thin, obsolete, discontinued and/or noindexed that are still on the sitemap. For instance, would it focus Google's crawl budget more efficiently or have some other effect? Your thoughts? Thanks! Best... Darcy
Intermediate & Advanced SEO | | 945010 -
Site: search showing funny results
Hi When i do a site: search on my domain the very last result it returns is a URL which is listed as my domain but does not exist on my website. When clicked it redirects to a really spammy page. If im not being clear just let me know, quite hard to explain the situation! Any thoughts to get rid of this?
Intermediate & Advanced SEO | | TheZenAgency0 -
XML Sitemap Indexation Rate Decrease
On September 28th, 2013 I saw my indexation rate decrease on my XML sitemap that I've submitted through GWT. I've since scraped my sitemap and removed all 404, 400 errors (which only made up ~5% of the entire sitemap). Any idea why Google randomly started indexing less of my XML sitemap on that date? I updated my sitemap 2 week before that date and had an indexation rate of ~85% - no I'm below 35%. Thoughts, idea, experiences? Thanks!
Intermediate & Advanced SEO | | RobbieWilliams0 -
Omitted results
Google used to display all my pages now most are under repeat the search with the omitted results included."_ what dose that mean? Dose this predict something bad?_ All pages are unique.
Intermediate & Advanced SEO | | Joseph-Green-SEO0 -
Do search results differ greatly when you search on mobile?
If you have a site with responsive design, is Google likely to look upon you more favourably and dramatically change rankings?
Intermediate & Advanced SEO | | BlueLinkERP0 -
Local language for folders in URLs?
Hi, We're working on a e-commerce project that will be launched in several countries. My question is this: Are there any advantages to name the URL-folders in the local language? Ie. International site: www.domain.com/product/adidas-model-x www.domain.com/category/adidas Norwegian site: www.domain.no/produkt/adidas-model-x www.domain.no/kategori/adidas As i like things tidy, I guess that would also mean we would have to rename the cart URLs and so on. ie. International site: www.domain.com/checkout Norwegian site: www.domain.no/kasse
Intermediate & Advanced SEO | | rtora0