Site Maps / Robots.txt etc
-
Hi everyone
I have setup a site map using a Wordpress pluggin: http://lockcity.co.uk/site-map/
Can you please tell me if this is sufficient for the search engines? I am trying to understand the difference between this and having a robots.txt - or do I need both?
Many thanks, Abi
-
Ahh I see thanks so much for your reply - is it best to get an XML site map rather than the one I have?
Thanks, Abi
-
A sitemap is for crawling your pages, either a user sitemap like you set up or a sitemap.xml file which is a streamlined way for Google to spider your site.
Robots.txt is used to direct the bots where NOT to go like if you don't want them crawling certain parts of your site like cgi-bin, js folder or images folder for example.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Reducing number of site pages?
Hi, I am looking through my site structure and I have a lot of pages left over from the days of article keywords. Probably 7 or 8 years ago, someone sold my husband on article key word pages. I have slowly gotten rid of a lot of them as they have fallen out out of the ranks. I would like to get rid of the rest, probably 5 or 6 pages. Will it hurt my rankings to delete pages and redirect them? My customers really like the simplicity of our site and I want to keep it that way, plus clean up flags that Moz is telling me is a problem. I think its easier to keep less pages top notch than have to worry with a lot of them. Especially since my customers aren't viewing them. Thanks in advance!
On-Page Optimization | | CalicoKitty20000 -
How many css and Javascript on ecommerce site?
Hello, I want any tool which seach css and javascript of whole ecommerce cite? Please suggest. Thanks! Dev
On-Page Optimization | | devdan0 -
301 Redirect to external site
Hi guys, We have a client who is getting their website redesigned through us. They are discontinuing couple of their services which will not get featured in the new site. They are fairly well ranked for these services and my client wishes to 301 redirect these pages to an external site owned by his friend so that they benefit out of the ranking. The question is: Will my client's website's general ranking get affected due to 301 redirecting to an external site? The external site is not spammy or red-flagged by Google (at the moment, at least). Thanks in advance!
On-Page Optimization | | RameshNair
Ramesh Nair0 -
Sudden Drop in Rankings/Traffic/Organic Impressions Without a Penalty
Hi Moz community! I have a question about a local client in Raleigh, NC - http://paragonbuildinggroup.com This client came to us from another agency who had previously not done such a great job with the design/development of the site, or with the marketing of it, so we are somewhat limited in terms of what we can do on design, user experience, etc. But, the SEO is all still easy to tweak and we've been working on it for some time now. As of July 5th, their keyword rankings have dropped dramatically (we're talking from first page rankings to nothing, according to Authority Labs), and they've fallen completely off the map in the SERPs. Their local listing doesn't appear in search results anymore, and WMT is showing a drastic drop in impressions (from 457 on July 3rd to 92 on July 5th). There have been no manual penalties on the site, no recent major development work done, and from what I can see, no signs of hacking and no bad backlinks. The only thing I can see is that Mozcast showed an 83 degree day with some clouds and rain on July 5th, the day that our rankings dropped off, but I can't find any documentation showing what might have changed. Any insight as to what might be going on? I'm completely stumped!
On-Page Optimization | | TriMarkDigital0 -
SEO For Replacement Site
I have a client with a website that has gotten a bit outdated. We've already built his new website and optimized it, but I'm trying to figure out the best way to replace the site while doing the least amount of damage to his current Google rankings. He's ranking #1 for some very competitive keywords that are responsible for the bulk of his revenue, so we want to jeopardize that. We've already built a new site and written all new content, although the homepage page title, h1 header and meta descriptions will all remain what they currently are. I'm also trying to keep the keyword density as close to the current site as possible. I am aware of transferring all existing site URLS using 301 redirects. Can anyone provide any tips that I should use when replacing the site? Should I expect a slight rankings drop or am I worrying about nothing?
On-Page Optimization | | atstickel0 -
Multiple Organization Schema on the same site
I creating a preferred supplier list on my site and wanted to use the Organization Schema for the company details. Is there a issue with having more than one org schema on the same site? or should I just use the one for my company. Thanks in advance
On-Page Optimization | | gregdicksonuk1 -
Working on this site...
and wondering what is wrong in terms of on page SEO (basically just want some feedback on tips/changes to make) http://www.stevenholmesstudio.com/ I'm assuming that the title shouldn't be just the img file name..any suggestions for what it should be?
On-Page Optimization | | callmeed0 -
Site wide internal links in footer
What is your take on site wide inernal links in the footer, e.g. for the most competitive keywords? Do you think those links are still useful or are those links of little value from your experience? It is an old school tactic but I still see many sites doing it.
On-Page Optimization | | Florakel0