Site Maps / Robots.txt etc
-
Hi everyone
I have setup a site map using a Wordpress pluggin: http://lockcity.co.uk/site-map/
Can you please tell me if this is sufficient for the search engines? I am trying to understand the difference between this and having a robots.txt - or do I need both?
Many thanks, Abi
-
Ahh I see thanks so much for your reply - is it best to get an XML site map rather than the one I have?
Thanks, Abi
-
A sitemap is for crawling your pages, either a user sitemap like you set up or a sitemap.xml file which is a streamlined way for Google to spider your site.
Robots.txt is used to direct the bots where NOT to go like if you don't want them crawling certain parts of your site like cgi-bin, js folder or images folder for example.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I analysis my domain (http://yourdigibuddy.com/) on moz domain analysis. But there is not data show and show message "No data here". What should I do?
_ I analysis my domain (http://yourdigibuddy.com/) on Moz domain analysis. But there is not data show and show the message "No data here". What should I do?_
On-Page Optimization | | MelissaDooley0 -
Robots.txt Question for E-Commerce Sites
Hi All, I have a couple of e-commerce clients and have a question about URLs. When you perform a search on website all URLs contain a question mark, for example: /filter.aspx?search=blackout I'm not sure that I want these indexed. Could I be causing any harm/danger if I add this to the robots.txt file? /*? Any suggestions welcome! Gavin
On-Page Optimization | | IcanAgency0 -
Alt text / internal linking
Hi everyone A question about best practice when linking from pictures on our homepage - hirespace.com We have an option of using divs with background images (nicer in terms of design) but it means that we can't use anchor text or alt text to show Google what these internal links are about. The other option is to use images which do not allow us as much flexibility in terms of CSS but would allow us to use alt text. There is also an opinion that we should have separate text links at the bottom of the homepage to get the anchor page in. What is best practice in this situation - is alt text worth sacrificing some CSS flexibility for? How important is anchor/alt text for internal linking? Thanks guys.
On-Page Optimization | | HireSpace0 -
Site Architecture: How do I best Optimize for Similar Keywords?
Hello Moz Community! I'm really struggling trying to decide on an improved site architecture. I run an online proofreading & editing website. This leaves us targeting many different niche keywords. For example: blog editing/proofreading, essay editing/proofreading, book editing/proofreading, resume... you get the point. I feel like editing & proofreading are similar enough to target on the same page(s). However, the issue is that I'm also having to deal with what I'm calling derivative keywords. For example, when I try to optimize for 'essay editing/proofreading', I also have to think about: paper editing, paper editor, paper correction, edit my paper, etc. I would have no problem optimizing the page for 'essay editing' in the title, H1, etc. and then targeting these words as secondary keywords within the body text, etc., however, I keep thinking 'a large slice of a small pie is better than a small slice of a big one.' You see, the keyword 'essay correction' has only about one-third the monthly searches as 'essay editing', but it is 50% less competitive. The same is loosely true for the rest of the 'derivative' keywords. I'd have no problem building specific pages for these derivative keyword groups, however, I'm very concerned how this would effect my site from a user experience perspective. I don't want to have a master "services" page with links to book editing, resume editing, essay editing, etc. and then also show paper editing, essay correction, etc. To me, this would be confusing... "What's the difference between essay editing and paper editing?". Any guidance is much appreciated. This has got my head spinning! Thanks!
On-Page Optimization | | TBiz0 -
Do you handle website on-page/site optimization?
Our website is gaining traction and we are looking for an individual who is an expert at examining websites to see if the structure and on-page optimization is being optimized, and what. Please contact me if you are interested. Thank you.
On-Page Optimization | | balboafinance0 -
Trouble with Old Site Name
Trying to figure out what is causing a site to show up under a former name in Google. The name of the client is Fortenberry Legal. They changed from Fortenberry Law Group over a year ago. I can't find any code on the site that uses the old name. For some reason, it still shows up as "Fortenberry Law Group" in Google. When I search for "Fortenberry Law Group," that shows up in Google with a full set of site links. When I search under the new name (Fortenberry Legal), that also shows up in Google but without the site links. Any thought on what could be causing this?
On-Page Optimization | | Falconberg0 -
How Can I Get Yahoo to Index My Site?
How Can I Get Yahoo to Index My Site? I have installed Bing webmaster tool two months ago -- is Yahoo that slow. My site has been out since May 2010 and for a year and a half, I only have 40 pages index. HELP!!!!
On-Page Optimization | | AppleCapitalGroup0 -
Is Google Places appropriate for an ecommerce site and blogs
I'm working with a client that has an ecommerce site. He has e physical addresses where they work, however, neither would want customers to go to their office. Is it inappropriate to create a Google Places listing in this situation? I'm working with another client who runs a blog for his PR agency. Is it OK to create a Google Places listing for a blog? He would welcome people to visit his agency.
On-Page Optimization | | EricVallee340