Site Maps / Robots.txt etc
-
Hi everyone
I have setup a site map using a Wordpress pluggin: http://lockcity.co.uk/site-map/
Can you please tell me if this is sufficient for the search engines? I am trying to understand the difference between this and having a robots.txt - or do I need both?
Many thanks, Abi
-
Ahh I see thanks so much for your reply - is it best to get an XML site map rather than the one I have?
Thanks, Abi
-
A sitemap is for crawling your pages, either a user sitemap like you set up or a sitemap.xml file which is a streamlined way for Google to spider your site.
Robots.txt is used to direct the bots where NOT to go like if you don't want them crawling certain parts of your site like cgi-bin, js folder or images folder for example.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Blog Site Set-Up/Frequency
Hello! I am a new blogger that is just getting started. All I have done so far is purchase a domain name and signed up with Blue Host. From what I am reading, WordPress seems to be the most recommended plug-in to get going. There is a lot of material out there on SEO and I wanted the community's thoughts on where to start. My blog is intended to provide readers with information on a particular topic. It is a vast area with much to write about - I intend on populating the content myself/with the help of experts in the field. It is not news so it is not time sensitive. Here are my questions: 1. As this is a brand new site, should I be blogging every day or is couple of times a week sufficient? I am able to produce content fairly quickly in the beginning as there is a lot to write about. Should I write a whole lot of content first and then release it on a schedule (twice a week, daily, etc.)? As it is a new site, I don't want it to launch with just one article.. 2. I am taking a WordPress class next week, but as someone that is not too familiar with copy/backlinks, other mechanisms to boost SEO. does WordPress make it easy enough to optimize your site for search results or does it require more expertise? As far as I see, my first tasks are to 1. ) set up the site effectively so people can find it and 2.) create valuable/engaging content. Appreciate any advice on setting up the site, blogging frequency, other tips to get going. I don't want to launch a site and get dinged by Google for reasons I am unware of..At some point, when I have a robust set of content, I am thinking of FB advertising to increase traffic to the site. Seems a bit premature to do that at this point.. Thanks all in advance for your feedback!
On-Page Optimization | | mmprakash0 -
New site pages are indexed but not ranking for anything
I just built this site for a client http://primedraftarchitecture.com. It went live 3 weeks ago and the pages are getting indexed as per Webmaster Tools. But I'm not seeing it rank for anything. We're adding blog articles regularly and used Moz Local for local links and have been building links in other local directories (probably about 15 so far). Usually I get some rankings, although very low, after just a week or two for new sites. Does anyone see anything glaring that may be causing a problem?
On-Page Optimization | | DonaldS1 -
Word count and ranking/traffic
Hello All, Recently, a client of ours enlisted another firm to redesign their website, www.thepodhotel.com. The new site went live on February 20th. Since that date, we have seen a 30% drop in Google Organic traffic, year-over-year. Even a cursory glance at the site will tell you that there was quite a bit left on the table, from an SEO point of view. However, my question pertains to word count. The word count on the new site is quite a bit lower than the old site. How much value do you feel this has on rankings? Do you feel that, among the many other items that need to be addressed, we should be focusing on creating more copy? I appreciate all of your input. Frank
On-Page Optimization | | FrankSweeney0 -
Homepage title on pages/posts title
I want to see the title of the page/post. Right now it is indexing it like page name / homepage name site:forumlist.info Brief info about site
On-Page Optimization | | csfarnsworth
Build in wordpress
SEO Plugin "All in one SEO pack" Settings snapshot are available below http://i.imgur.com/G278Y1Z.png http://imgur.com/gb0YQUO http://imgur.com/fbXQgd1 http://imgur.com/atj3AS4 Anyone can guide me how to fix it?0 -
Redoing a site - 404 redirect or 301 redirect
I'm redoing a website, should i 404 the old pages, or 301 redirect to the main page? what is better? (around 100 pages)
On-Page Optimization | | mkmedia0 -
Checking for content duplication against content on your own site.
We are currently trying to rewrite our product descriptions and I'm afraid some of the salespeople that are writing the descriptions are plagiarizing one-another's writing. Is there a content duplication checker that will allow you to check a piece of writing against a specific site rather than all of the web?
On-Page Optimization | | MichealGooden0 -
SSL sites and SEO
I'm seeing a lot about how SSL sites can negatively affect SEO from the analytics perspective, but if duplicate content issues are addressed and load times are OK, what else is there to worry about? Any advice is much appreciated. Thank you!
On-Page Optimization | | PerfectPitchConcepts0 -
Similar Keywords/Different Pages
My question is about my content strategy regarding keywords and page creation. For this example I will use the following keywords: "widget financing" "widget leasing" "widget loans" "thingy financing" "thingy leasing" "leasing loans" "whatchamacallit financing" "whatchamacallit leasing" "whatchamacalit loans" You get the idea. Now I have created a separate page for each of these keywords. There are about 70 keywords and their respective pages. Although all of these describe the same thing I have re-written each page. In other words I didn't use the same content and just substituted the keywords. Each page is roughly 200 to 500 words. I do rank very well for most of these keywords. I would post some of the pages from my site here but I didn't know if that is frowned on. My fear/concern is will I get in trouble in a "post Panda" world. Again, the pages rank very well I just want to be in good graces with Google going forward.
On-Page Optimization | | leaseman0